Jun 08 12:49:04.806752 ip-10-0-132-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 12:49:04.806763 ip-10-0-132-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 12:49:04.806770 ip-10-0-132-250 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 12:49:04.806996 ip-10-0-132-250 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 12:49:14.794621 ip-10-0-132-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 08 12:49:14.794644 ip-10-0-132-250 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6043b8e7a6d4455a9e4eae3368672899 -- Jun 08 12:51:24.526814 ip-10-0-132-250 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:51:24.977669 ip-10-0-132-250 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:24.977669 ip-10-0-132-250 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:51:24.977669 ip-10-0-132-250 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:24.977669 ip-10-0-132-250 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:51:24.977669 ip-10-0-132-250 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:24.978819 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.978732 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:51:24.982817 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982802 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:24.982817 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982817 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982820 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982824 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982827 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982830 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982833 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982836 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982838 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982841 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982845 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982847 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982850 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982853 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982855 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982859 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982862 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982864 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982866 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982869 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982872 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:24.982883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982875 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982879 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982883 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982886 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982889 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982893 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982896 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982900 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982903 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982906 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982909 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982912 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982914 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982917 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982919 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982922 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982925 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982927 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982930 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:24.983356 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982932 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982935 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982937 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982940 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982943 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982946 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982948 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982951 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982953 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982955 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982958 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982961 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982963 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982966 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982968 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982972 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982975 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982977 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982980 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982982 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:24.983822 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982985 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982988 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982990 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982993 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982996 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.982998 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983001 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983003 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983006 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983010 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983012 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983020 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983023 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983026 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983029 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983031 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983033 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983036 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983038 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983041 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:24.984403 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983043 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983046 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983048 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983051 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983053 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983056 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983059 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983062 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983065 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983067 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983070 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983072 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983075 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983077 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983080 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983083 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983085 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983089 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983093 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.984976 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983858 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983864 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983868 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983870 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983873 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983881 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983884 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983887 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983891 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983894 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983897 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983899 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983902 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983905 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983907 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983910 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983912 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983914 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983917 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983919 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:24.985447 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983923 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983926 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983929 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983933 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983957 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983960 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983963 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983966 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983969 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983973 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983978 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983982 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983986 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983989 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983993 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.983997 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984000 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984003 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984015 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:24.985953 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984019 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984024 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984028 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984031 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984034 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984038 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984041 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984046 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984050 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984053 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984057 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984060 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984064 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984070 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984074 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984078 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984081 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984086 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984090 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:24.986416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984094 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984098 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984101 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984105 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984109 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984113 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984117 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984121 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984126 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984130 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984133 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984137 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984140 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984152 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984157 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984162 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984166 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984170 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984173 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984178 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:24.986908 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984182 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984186 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984190 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984193 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984202 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984208 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984213 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984218 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984223 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984227 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984232 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984236 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984241 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984245 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984250 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984254 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984260 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984264 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984268 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.987391 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984273 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984277 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984722 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984728 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984732 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984735 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984739 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984743 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984747 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984750 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984753 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984756 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984759 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984762 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984765 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984768 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984771 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984774 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984777 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984780 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.987886 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984783 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984785 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984788 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984790 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984793 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984796 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984798 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984804 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984807 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984809 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984812 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984814 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984817 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984820 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984822 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984825 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984828 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984830 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984833 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984836 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:24.988369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984839 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984841 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984844 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984846 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984850 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984852 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984855 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984858 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984862 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984865 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984868 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984871 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984874 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984877 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984879 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984882 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984884 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984887 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984889 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:24.988868 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984893 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984896 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984898 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984901 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984903 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984905 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984908 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984911 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984913 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984916 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984918 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984921 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984923 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984926 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984929 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984933 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984936 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984939 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984942 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:24.989359 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984945 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984947 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984950 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984952 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984955 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984957 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984959 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984962 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984964 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984967 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984969 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984972 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984975 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984979 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984982 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984984 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984987 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984990 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984992 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984995 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.989849 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.984997 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985000 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985002 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985070 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985078 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985087 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985093 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985101 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985105 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985111 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985118 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985122 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985125 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985129 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985132 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985136 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985139 2568 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985141 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985145 2568 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985147 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985150 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985155 2568 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985158 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985161 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:51:24.990334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985164 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985168 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985172 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985176 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985179 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985182 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985186 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985189 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985192 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985196 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985199 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985203 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985206 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985209 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985212 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985215 2568 flags.go:64] FLAG: --enable-server="true" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985219 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985223 2568 flags.go:64] FLAG: --event-burst="100" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985227 2568 flags.go:64] FLAG: --event-qps="50" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985230 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985233 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985236 2568 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985239 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985242 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985245 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:51:24.990934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985248 2568 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985251 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985254 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985257 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985260 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985263 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985265 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985268 2568 flags.go:64] FLAG: --feature-gates="" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985272 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985275 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985278 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985285 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985288 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985291 2568 flags.go:64] FLAG: --help="false" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985294 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-132-250.ec2.internal" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985297 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985300 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985303 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985306 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985310 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985313 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985315 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985318 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:51:24.991534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985321 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985324 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985328 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985330 2568 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985333 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985336 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985339 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985342 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985345 2568 flags.go:64] FLAG: --lock-file="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985347 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985350 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985353 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985358 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985361 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985364 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985367 2568 flags.go:64] FLAG: --logging-format="text" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985370 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985373 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985376 2568 flags.go:64] FLAG: --manifest-url="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985378 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985388 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985391 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985395 2568 flags.go:64] FLAG: --max-pods="110" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985398 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985401 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:51:24.992135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985403 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985406 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985409 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985412 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985415 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985422 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985425 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985428 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985431 2568 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985434 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985440 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985443 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985446 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985449 2568 flags.go:64] FLAG: --port="10250" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985452 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985455 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07840542bde268651" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985458 2568 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985461 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985464 2568 flags.go:64] FLAG: --register-node="true" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985467 2568 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985470 2568 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985473 2568 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985476 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985479 2568 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985483 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:51:24.992748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985486 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985489 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985499 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985503 2568 flags.go:64] FLAG: --runonce="false" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985506 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985509 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985512 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985528 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985531 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985533 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985537 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985540 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985543 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985545 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985548 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985551 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985554 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985557 2568 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985560 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985565 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985568 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985571 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985575 2568 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985578 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985581 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:51:24.993380 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985584 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985587 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985590 2568 flags.go:64] FLAG: --v="2" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985598 2568 flags.go:64] FLAG: --version="false" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985602 2568 flags.go:64] FLAG: --vmodule="" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985606 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.985611 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985727 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985731 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985734 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985738 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985741 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985744 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985747 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985749 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985752 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985755 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985757 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985760 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985763 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985765 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:24.993997 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985768 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985771 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985773 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985776 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985779 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985782 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985784 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985787 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985789 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985792 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985795 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985797 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985800 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985802 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985805 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985807 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985810 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985814 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985817 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985819 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:24.994563 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985822 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985826 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985829 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985831 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985834 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985837 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985839 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985842 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985845 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985848 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985851 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985853 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985856 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985858 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985861 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985864 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985866 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985869 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985873 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.995061 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985877 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985880 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985883 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985885 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985888 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985890 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985893 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985895 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985898 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985900 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985904 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985907 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985909 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985912 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985916 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985918 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985921 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985924 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985926 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985929 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985931 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:24.995560 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985934 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985938 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985941 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985944 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985947 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985951 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985954 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985958 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985961 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985964 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985967 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985969 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985972 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985975 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985977 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985980 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985983 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985985 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985988 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:24.996087 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985990 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985993 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.985997 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.986000 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.986002 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.986005 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.986805 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.994187 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.994205 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.994222 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.994230 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994287 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994293 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994296 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.996565 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994300 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994304 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994308 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994310 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994313 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994315 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994318 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994321 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994324 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994326 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994329 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994331 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994334 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994337 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994339 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994342 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994345 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994347 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994350 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:24.996915 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994353 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994355 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994358 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994361 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994364 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994366 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994368 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994378 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994381 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994384 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994386 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994389 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994391 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994394 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994397 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994401 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994404 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994407 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994410 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994413 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:24.997369 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994416 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994429 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994433 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994436 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994439 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994442 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994445 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994447 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994450 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994453 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994455 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994458 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994461 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994463 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994466 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994468 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994471 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994474 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994476 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994480 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.997864 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994489 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994492 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994494 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994497 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994500 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994502 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994504 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994507 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994510 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994512 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994529 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994533 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994537 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994541 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994544 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994547 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994550 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994552 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994555 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994557 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:24.998348 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994560 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994562 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994565 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994567 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994570 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994573 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994575 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994578 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994581 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994583 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994586 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994589 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994592 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994603 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994606 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994609 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:24.998850 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994611 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.994616 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994761 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994766 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994769 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994771 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994774 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994777 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994779 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994782 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994785 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994787 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994790 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994794 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994797 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:24.999239 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994799 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994802 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994804 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994807 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994809 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994812 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994814 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994817 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994819 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994822 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994824 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994827 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994830 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994832 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994835 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994843 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994847 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994851 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994854 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994857 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:24.999787 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994860 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994862 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994865 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994868 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994870 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994873 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994875 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994878 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994881 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994883 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994885 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994888 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994890 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994893 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994895 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994898 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994901 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994903 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994906 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994908 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:25.000341 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994911 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994913 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994916 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994918 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994922 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994926 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994929 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994932 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994941 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994944 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994946 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994949 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994952 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994954 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994957 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994959 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994962 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994964 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994966 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:25.001205 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994969 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994972 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994974 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994976 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994979 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994981 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994984 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994986 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994989 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994991 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994994 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994996 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.994999 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995001 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995004 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995006 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995009 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995011 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995014 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995017 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:25.001815 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995019 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995022 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995030 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995033 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995035 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995038 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:24.995041 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.995045 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.995154 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.997569 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:24.999243 2568 server.go:1019] "Starting client certificate rotation" Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.000202 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:51:25.002300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.000265 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:51:25.004148 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.004132 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:51:25.009225 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.009210 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:51:25.021145 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.021125 2568 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:51:25.024248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.024234 2568 log.go:25] "Validated CRI v1 image API" Jun 08 12:51:25.025811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.025796 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:51:25.029287 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.029263 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a66243b2-f8a0-4e45-ae0f-93527fa19a79:/dev/nvme0n1p4 c9ad1eb9-b367-4e71-891d-31d962b482a5:/dev/nvme0n1p3] Jun 08 12:51:25.029355 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.029286 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:51:25.035813 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.035698 2568 manager.go:216] Machine: {Timestamp:2026-06-08 12:51:25.034248367 +0000 UTC m=+0.378672639 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099868 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8ebc6dcc75e7e9be95c0a856b0c3 SystemUUID:ec2a8ebc-6dcc-75e7-e9be-95c0a856b0c3 BootID:6043b8e7-a6d4-455a-9e4e-ae3368672899 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:38:b8:e6:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:38:b8:e6:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:bb:91:82:a5:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:51:25.035813 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.035801 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:51:25.035973 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.035931 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:51:25.039368 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.039344 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:51:25.039510 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.039372 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:51:25.040199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.040189 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:51:25.040229 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.040202 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:51:25.040229 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.040214 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:51:25.040291 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.040228 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:51:25.041528 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.041509 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:51:25.045930 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.045919 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:51:25.046220 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046211 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:51:25.046250 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046244 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:51:25.046298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046255 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:51:25.046298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046276 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:51:25.046298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046286 2568 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:51:25.046298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046295 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:51:25.046716 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046689 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:51:25.046776 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.046724 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:51:25.049744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.049706 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:51:25.051082 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.051062 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:51:25.052140 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.052125 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:51:25.052193 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.052157 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:51:25.053488 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053476 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053492 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053499 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053504 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053512 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053532 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053543 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053550 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:51:25.053553 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053557 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:51:25.053777 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053562 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:51:25.053777 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053571 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:51:25.053777 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.053577 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:51:25.054460 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.054449 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:51:25.054490 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.054461 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:51:25.057751 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.057737 2568 server.go:1268] "Started kubelet" Jun 08 12:51:25.057862 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.057801 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:51:25.057914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.057841 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:51:25.057914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.057910 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:51:25.058700 ip-10-0-132-250 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:51:25.059390 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.059292 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:51:25.059678 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.059593 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:51:25.059868 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.059851 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:51:25.059979 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.059962 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:51:25.060199 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.060177 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:51:25.063850 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.062782 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c31285236 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.057708598 +0000 UTC m=+0.402132871,LastTimestamp:2026-06-08 12:51:25.057708598 +0000 UTC m=+0.402132871,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.065390 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.065365 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:51:25.067125 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.067112 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:51:25.067201 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.067133 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:51:25.067201 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.067184 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.068277 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.068117 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:51:25.068388 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.068378 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:51:25.068584 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.068573 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:51:25.068658 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.068651 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:51:25.069653 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.069629 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:51:25.069739 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.069648 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:51:25.069873 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.069856 2568 factory.go:55] Registering systemd factory Jun 08 12:51:25.069950 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.069894 2568 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:51:25.069950 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.069890 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:51:25.070276 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070258 2568 factory.go:153] Registering CRI-O factory Jun 08 12:51:25.070276 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070277 2568 factory.go:223] Registration of the crio container factory successfully Jun 08 12:51:25.070428 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070356 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:51:25.070428 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070387 2568 factory.go:103] Registering Raw factory Jun 08 12:51:25.070428 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070403 2568 manager.go:1196] Started watching for new ooms in manager Jun 08 12:51:25.071007 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.070926 2568 manager.go:349] Starting recovery of all containers Jun 08 12:51:25.080937 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.080841 2568 manager.go:354] Recovery completed Jun 08 12:51:25.085737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.085720 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.087718 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.087703 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.087771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.087731 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.087771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.087742 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.088252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088234 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:51:25.088252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088251 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:51:25.088359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088264 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.088359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088272 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:51:25.088898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088882 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.088964 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088908 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.088964 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.088917 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.090344 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.090332 2568 policy_none.go:49] "None policy: Start" Jun 08 12:51:25.090388 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.090347 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:51:25.090388 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.090357 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:51:25.092248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.092235 2568 policy_none.go:47] "Start" Jun 08 12:51:25.102815 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.102751 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f23f0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.08771918 +0000 UTC m=+0.432143451,LastTimestamp:2026-06-08 12:51:25.08771918 +0000 UTC m=+0.432143451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.113804 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.113720 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f28057 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.087735895 +0000 UTC m=+0.432160165,LastTimestamp:2026-06-08 12:51:25.087735895 +0000 UTC m=+0.432160165,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.123069 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123052 2568 manager.go:337] "Starting Device Plugin manager" Jun 08 12:51:25.123172 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.123087 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:51:25.123172 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123098 2568 server.go:87] "Starting device plugin registration server" Jun 08 12:51:25.123361 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123348 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:51:25.123394 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123366 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:51:25.123440 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123427 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:51:25.123501 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123489 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:51:25.123609 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.123502 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:51:25.124146 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.124127 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:51:25.124229 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.124180 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.124423 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.124363 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f2a764 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.087745892 +0000 UTC m=+0.432170163,LastTimestamp:2026-06-08 12:51:25.087745892 +0000 UTC m=+0.432170163,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.141789 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.141702 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-250.ec2.internal.18b71c1c32f23f0c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f23f0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.08771918 +0000 UTC m=+0.432143451,LastTimestamp:2026-06-08 12:51:25.088896175 +0000 UTC m=+0.433320448,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.153634 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.144184 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:51:25.153634 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.145382 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:51:25.153634 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.145414 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:51:25.153634 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.145441 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:51:25.153634 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.145476 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 12:51:25.158617 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.158594 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 12:51:25.158695 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.158631 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-250.ec2.internal.18b71c1c32f28057\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f28057 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.087735895 +0000 UTC m=+0.432160165,LastTimestamp:2026-06-08 12:51:25.088912515 +0000 UTC m=+0.433336788,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.170319 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.170251 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-250.ec2.internal.18b71c1c32f2a764\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c32f2a764 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-250.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.087745892 +0000 UTC m=+0.432170163,LastTimestamp:2026-06-08 12:51:25.088920877 +0000 UTC m=+0.433345148,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.181866 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.181800 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-250.ec2.internal.18b71c1c3534b048 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-250.ec2.internal,UID:ip-10-0-132-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-250.ec2.internal,},FirstTimestamp:2026-06-08 12:51:25.125627976 +0000 UTC m=+0.470052233,LastTimestamp:2026-06-08 12:51:25.125627976 +0000 UTC m=+0.470052233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-250.ec2.internal,}" Jun 08 12:51:25.199216 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.199197 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vn24z" Jun 08 12:51:25.208449 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.208432 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vn24z" Jun 08 12:51:25.223702 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.223686 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.224603 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.224586 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.224660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.224617 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.224660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.224631 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.224660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.224653 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.244786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.244720 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.244786 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.244743 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-250.ec2.internal\": node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.246251 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.246224 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal"] Jun 08 12:51:25.246302 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.246291 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.248474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.248459 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.248589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.248487 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.248589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.248497 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.250908 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.250895 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.251031 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251015 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.251087 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251051 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.251597 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251580 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.251684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251597 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.251684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251613 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.251684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251620 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.251684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251625 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.251684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.251632 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.253786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.253773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.253863 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.253796 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:25.254453 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.254438 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:25.254546 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.254463 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:25.254546 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.254473 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:25.278046 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.278027 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-250.ec2.internal\" not found" node="ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.282121 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.282105 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.282323 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.282310 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-250.ec2.internal\" not found" node="ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.371121 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.371098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.371121 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.371125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.371284 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.371143 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa196d6cc65c8689ea2b6295977c450b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-250.ec2.internal\" (UID: \"aa196d6cc65c8689ea2b6295977c450b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.383209 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.383189 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.471560 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.471560 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.471771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa196d6cc65c8689ea2b6295977c450b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-250.ec2.internal\" (UID: \"aa196d6cc65c8689ea2b6295977c450b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.471771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471613 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa196d6cc65c8689ea2b6295977c450b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-250.ec2.internal\" (UID: \"aa196d6cc65c8689ea2b6295977c450b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.471771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.471771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.471619 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb8915ff6849d1522aea4476a1c836b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal\" (UID: \"cb8915ff6849d1522aea4476a1c836b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.483590 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.483573 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.584615 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.584506 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.584615 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.584549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.589273 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.589164 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:25.685235 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.685200 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.785774 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.785742 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.886430 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.886352 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.986990 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:25.986969 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:25.998159 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:25.998134 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:51:26.075093 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.075067 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:26.088078 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:26.088054 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:26.102273 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.102250 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:26.104955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.104938 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:26.105928 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.105913 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:26.105998 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.105940 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:26.105998 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.105951 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:26.111285 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:26.111258 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8915ff6849d1522aea4476a1c836b6.slice/crio-c841fffcf51d1cfafda8adf6f9bbf38ab45f21727a6a45df761ff001cc1d31ea WatchSource:0}: Error finding container c841fffcf51d1cfafda8adf6f9bbf38ab45f21727a6a45df761ff001cc1d31ea: Status 404 returned error can't find the container with id c841fffcf51d1cfafda8adf6f9bbf38ab45f21727a6a45df761ff001cc1d31ea Jun 08 12:51:26.113584 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:26.113392 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa196d6cc65c8689ea2b6295977c450b.slice/crio-8763cb262f2507a464e0096744de29f1f7ea19161bae01a1f142ff5acaeb94f8 WatchSource:0}: Error finding container 8763cb262f2507a464e0096744de29f1f7ea19161bae01a1f142ff5acaeb94f8: Status 404 returned error can't find the container with id 8763cb262f2507a464e0096744de29f1f7ea19161bae01a1f142ff5acaeb94f8 Jun 08 12:51:26.118593 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.118576 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:51:26.150729 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.150646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" event={"ID":"cb8915ff6849d1522aea4476a1c836b6","Type":"ContainerStarted","Data":"c841fffcf51d1cfafda8adf6f9bbf38ab45f21727a6a45df761ff001cc1d31ea"} Jun 08 12:51:26.151666 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.151639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" event={"ID":"aa196d6cc65c8689ea2b6295977c450b","Type":"ContainerStarted","Data":"8763cb262f2507a464e0096744de29f1f7ea19161bae01a1f142ff5acaeb94f8"} Jun 08 12:51:26.188171 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:26.188149 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:26.212315 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.212288 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:46:25 +0000 UTC" deadline="2028-03-14 10:50:09.987828642 +0000 UTC" Jun 08 12:51:26.212315 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.212313 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15477h58m43.77551802s" Jun 08 12:51:26.288882 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:26.288858 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:26.389463 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:26.389431 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-250.ec2.internal\" not found" Jun 08 12:51:26.458643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.458620 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:26.477844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.477819 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:26.567961 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.567932 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" Jun 08 12:51:26.585565 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.585545 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:51:26.586529 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.586501 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" Jun 08 12:51:26.594604 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:26.594585 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:51:27.047600 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.047574 2568 apiserver.go:52] "Watching apiserver" Jun 08 12:51:27.055726 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.055025 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:51:27.055726 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.055658 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-58wd4","openshift-multus/multus-dckjp","openshift-multus/network-metrics-daemon-njs7d","openshift-network-diagnostics/network-check-target-kj94g","kube-system/konnectivity-agent-hzdwg","kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s","openshift-dns/node-resolver-t5w26","openshift-network-operator/iptables-alerter-7d9fk","openshift-ovn-kubernetes/ovnkube-node-kr46l","kube-system/global-pull-secret-syncer-r5nlg","openshift-cluster-node-tuning-operator/tuned-cccq2","openshift-image-registry/node-ca-hmlr5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal"] Jun 08 12:51:27.058497 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.058447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.060958 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.060930 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.061356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.061336 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.061356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.061349 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tcwk5\"" Jun 08 12:51:27.061688 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.061670 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.061914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.061892 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:51:27.063049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.062941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.063049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.063015 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:27.063955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.063349 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.063955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.063351 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7gn2q\"" Jun 08 12:51:27.063955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.063810 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:51:27.064584 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.064360 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.066009 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.065818 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:27.066009 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.065926 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:27.068224 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.068207 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.068674 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.068655 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:51:27.072320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.070671 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:51:27.072320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.070738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cnkg5\"" Jun 08 12:51:27.072320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.070842 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:51:27.072320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.071326 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.074098 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.073317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.075263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.074818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.075263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.074840 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lfmlk\"" Jun 08 12:51:27.075263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.074855 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.075711 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.075686 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvn69\"" Jun 08 12:51:27.075935 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.075917 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.076117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.076100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.076206 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.076187 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.076698 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.076671 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:51:27.078201 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.078075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.080098 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.080078 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:51:27.081189 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081280 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-sys-fs\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081280 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f9710c-0c45-40de-bdee-000cee2b3227-serviceca\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.081280 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081264 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfp4\" (UniqueName: \"kubernetes.io/projected/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-kube-api-access-jgfp4\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081326 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e10d114-23eb-4173-9b77-e36f49813b91-agent-certs\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hdv\" (UniqueName: \"kubernetes.io/projected/90f9710c-0c45-40de-bdee-000cee2b3227-kube-api-access-g7hdv\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-hosts-file\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.081441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-socket-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-device-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081498 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xs25\" (UniqueName: \"kubernetes.io/projected/d62cca45-53e9-4441-b04a-bccc6617c34d-kube-api-access-8xs25\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f9710c-0c45-40de-bdee-000cee2b3227-host\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e10d114-23eb-4173-9b77-e36f49813b91-konnectivity-ca\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-tmp-dir\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-registration-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.081742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.081698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhqq\" (UniqueName: \"kubernetes.io/projected/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-kube-api-access-jrhqq\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.082695 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.082673 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.082843 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.082823 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:51:27.082927 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.082912 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-984v8\"" Jun 08 12:51:27.083057 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.083042 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:51:27.083203 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.083186 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.084778 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.084757 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:51:27.085089 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.085071 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.085441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.085417 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:51:27.085591 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.085572 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95s4v\"" Jun 08 12:51:27.087585 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.087546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.087673 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.087606 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:27.087733 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.087680 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:51:27.087969 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.087890 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:51:27.088158 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.088143 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:51:27.088236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.088164 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.088820 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.088804 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.088909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.088808 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:51:27.089077 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.089059 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gp9vg\"" Jun 08 12:51:27.090558 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.090541 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.092582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.092566 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:51:27.093085 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.093067 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:51:27.093336 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.093317 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88m2t\"" Jun 08 12:51:27.110540 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.110501 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2zp49" Jun 08 12:51:27.119387 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.119363 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2zp49" Jun 08 12:51:27.171082 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.171008 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:51:27.182852 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-kubelet\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-netns\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-bin\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ed3b4-d176-4a81-b333-7ce4be76b669-host-slash\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.182983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vd2q\" (UniqueName: \"kubernetes.io/projected/243ed3b4-d176-4a81-b333-7ce4be76b669-kube-api-access-4vd2q\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.183016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183007 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.183233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f9710c-0c45-40de-bdee-000cee2b3227-serviceca\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.183233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.183233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.183233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-socket-dir-parent\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-var-lib-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-env-overrides\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcm6\" (UniqueName: \"kubernetes.io/projected/ad62f8de-2563-48fe-b828-ee5e41127b99-kube-api-access-5pcm6\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hdv\" (UniqueName: \"kubernetes.io/projected/90f9710c-0c45-40de-bdee-000cee2b3227-kube-api-access-g7hdv\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-bin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-daemon-config\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183392 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-multus-certs\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-systemd\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243ed3b4-d176-4a81-b333-7ce4be76b669-iptables-alerter-script\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183485 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f9710c-0c45-40de-bdee-000cee2b3227-host\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-host\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183535 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f9710c-0c45-40de-bdee-000cee2b3227-serviceca\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5gn\" (UniqueName: \"kubernetes.io/projected/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-kube-api-access-2m5gn\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-cnibin\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f9710c-0c45-40de-bdee-000cee2b3227-host\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-kubelet\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-systemd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-sys\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfp4\" (UniqueName: \"kubernetes.io/projected/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-kube-api-access-jgfp4\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-os-release\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-conf-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcdgh\" (UniqueName: \"kubernetes.io/projected/dee330dd-8db9-4072-9175-e93505f3d5c6-kube-api-access-qcdgh\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysconfig\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.183988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-tmp\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-node-log\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-hosts-file\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183912 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-os-release\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183962 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-hosts-file\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-slash\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.183995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-socket-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xs25\" (UniqueName: \"kubernetes.io/projected/d62cca45-53e9-4441-b04a-bccc6617c34d-kube-api-access-8xs25\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-cnibin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-etc-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-config\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-socket-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184140 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-multus\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-netd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-run\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-sys-fs\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.184705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-tuned\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-sys-fs\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-system-cni-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-hostroot\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-modprobe-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e10d114-23eb-4173-9b77-e36f49813b91-konnectivity-ca\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-k8s-cni-cncf-io\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-registration-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-cni-binary-copy\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-conf\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184690 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-registration-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e10d114-23eb-4173-9b77-e36f49813b91-agent-certs\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184794 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.185550 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.184859 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-netns\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.184946 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:27.684909901 +0000 UTC m=+3.029334164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.184988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-etc-kubernetes\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-log-socket\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-dbus\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-ovn\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185135 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-system-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185127 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185190 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-systemd-units\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-script-lib\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185250 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-kubernetes\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-lib-modules\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-device-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-tmp-dir\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.186350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhqq\" (UniqueName: \"kubernetes.io/projected/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-kube-api-access-jrhqq\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62cca45-53e9-4441-b04a-bccc6617c34d-device-dir\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185406 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzzh\" (UniqueName: \"kubernetes.io/projected/da71e307-3542-4bcd-93b3-f641c706ea2e-kube-api-access-5nzzh\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad62f8de-2563-48fe-b828-ee5e41127b99-ovn-node-metrics-cert\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-kubelet-config\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185495 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e10d114-23eb-4173-9b77-e36f49813b91-konnectivity-ca\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185498 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-var-lib-kubelet\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.187123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.185685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-tmp-dir\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.189172 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.189138 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e10d114-23eb-4173-9b77-e36f49813b91-agent-certs\") pod \"konnectivity-agent-hzdwg\" (UID: \"3e10d114-23eb-4173-9b77-e36f49813b91\") " pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.195391 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.194881 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:27.195391 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.194907 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:27.195391 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.194921 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:27.195391 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.195012 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:27.694992752 +0000 UTC m=+3.039417011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:27.198364 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.198273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xs25\" (UniqueName: \"kubernetes.io/projected/d62cca45-53e9-4441-b04a-bccc6617c34d-kube-api-access-8xs25\") pod \"aws-ebs-csi-driver-node-r446s\" (UID: \"d62cca45-53e9-4441-b04a-bccc6617c34d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.198497 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.198405 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hdv\" (UniqueName: \"kubernetes.io/projected/90f9710c-0c45-40de-bdee-000cee2b3227-kube-api-access-g7hdv\") pod \"node-ca-hmlr5\" (UID: \"90f9710c-0c45-40de-bdee-000cee2b3227\") " pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.199595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.199008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhqq\" (UniqueName: \"kubernetes.io/projected/3f8b65ce-138b-4fe3-a710-3d242bab1f6d-kube-api-access-jrhqq\") pod \"node-resolver-t5w26\" (UID: \"3f8b65ce-138b-4fe3-a710-3d242bab1f6d\") " pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.200361 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.200336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfp4\" (UniqueName: \"kubernetes.io/projected/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-kube-api-access-jgfp4\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.285786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-bin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.285786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-daemon-config\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-multus-certs\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-multus-certs\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-bin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-systemd\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243ed3b4-d176-4a81-b333-7ce4be76b669-iptables-alerter-script\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.285984 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-systemd\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286005 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-host\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5gn\" (UniqueName: \"kubernetes.io/projected/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-kube-api-access-2m5gn\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-cnibin\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-kubelet\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286064 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-systemd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-sys\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-os-release\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-conf-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcdgh\" (UniqueName: \"kubernetes.io/projected/dee330dd-8db9-4072-9175-e93505f3d5c6-kube-api-access-qcdgh\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286151 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysconfig\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-tmp\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-node-log\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-os-release\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-slash\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-cnibin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-etc-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286268 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-host\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.286345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-config\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-multus\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-netd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-run\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-tuned\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-system-cni-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286428 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-daemon-config\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-run\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286492 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-hostroot\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286509 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243ed3b4-d176-4a81-b333-7ce4be76b669-iptables-alerter-script\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-netd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-hostroot\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-modprobe-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-k8s-cni-cncf-io\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286655 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-os-release\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.287187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-cni-binary-copy\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-conf\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286741 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-node-log\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-netns\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-config\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-etc-kubernetes\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-cnibin\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286842 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-kubelet\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-slash\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-systemd\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-modprobe-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286926 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286926 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286921 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-log-socket\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286985 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-netns\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-log-socket\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-conf-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287021 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-cnibin\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-dbus\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-ovn\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-dbus\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da71e307-3542-4bcd-93b3-f641c706ea2e-system-cni-dir\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-system-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-etc-kubernetes\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-systemd-units\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-script-lib\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-os-release\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-kubernetes\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-lib-modules\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzzh\" (UniqueName: \"kubernetes.io/projected/da71e307-3542-4bcd-93b3-f641c706ea2e-kube-api-access-5nzzh\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287286 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-cni-multus\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad62f8de-2563-48fe-b828-ee5e41127b99-ovn-node-metrics-cert\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-conf\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.288872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-kubelet-config\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-systemd-units\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287362 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c1dd8c-7311-4318-95c5-03dd64a347b6-kubelet-config\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287373 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dee330dd-8db9-4072-9175-e93505f3d5c6-cni-binary-copy\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-var-lib-kubelet\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-run-k8s-cni-cncf-io\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287402 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-run-ovn\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-kubelet\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.286989 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysconfig\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-kubernetes\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287494 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-lib-modules\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-sys\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-netns\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-bin\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ed3b4-d176-4a81-b333-7ce4be76b669-host-slash\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.289694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vd2q\" (UniqueName: \"kubernetes.io/projected/243ed3b4-d176-4a81-b333-7ce4be76b669-kube-api-access-4vd2q\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-host-var-lib-kubelet\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-socket-dir-parent\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-var-lib-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.287846 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-env-overrides\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-etc-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.287944 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-ovnkube-script-lib\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.287975 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:27.787958678 +0000 UTC m=+3.132382947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288006 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-var-lib-kubelet\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288042 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-system-cni-dir\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288102 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-sysctl-d\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-var-lib-openvswitch\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcm6\" (UniqueName: \"kubernetes.io/projected/ad62f8de-2563-48fe-b828-ee5e41127b99-kube-api-access-5pcm6\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.290594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288136 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ed3b4-d176-4a81-b333-7ce4be76b669-host-slash\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dee330dd-8db9-4072-9175-e93505f3d5c6-multus-socket-dir-parent\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288257 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-run-netns\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad62f8de-2563-48fe-b828-ee5e41127b99-host-cni-bin\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288593 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad62f8de-2563-48fe-b828-ee5e41127b99-env-overrides\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.288885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da71e307-3542-4bcd-93b3-f641c706ea2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.289236 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-etc-tuned\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.290030 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-tmp\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.291379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.290217 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad62f8de-2563-48fe-b828-ee5e41127b99-ovn-node-metrics-cert\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.295854 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.295834 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzzh\" (UniqueName: \"kubernetes.io/projected/da71e307-3542-4bcd-93b3-f641c706ea2e-kube-api-access-5nzzh\") pod \"multus-additional-cni-plugins-58wd4\" (UID: \"da71e307-3542-4bcd-93b3-f641c706ea2e\") " pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.298529 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.298489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcdgh\" (UniqueName: \"kubernetes.io/projected/dee330dd-8db9-4072-9175-e93505f3d5c6-kube-api-access-qcdgh\") pod \"multus-dckjp\" (UID: \"dee330dd-8db9-4072-9175-e93505f3d5c6\") " pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.298663 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.298645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5gn\" (UniqueName: \"kubernetes.io/projected/b2a3e2a3-c061-4743-b91f-ccc58ab2608f-kube-api-access-2m5gn\") pod \"tuned-cccq2\" (UID: \"b2a3e2a3-c061-4743-b91f-ccc58ab2608f\") " pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.302335 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.302312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vd2q\" (UniqueName: \"kubernetes.io/projected/243ed3b4-d176-4a81-b333-7ce4be76b669-kube-api-access-4vd2q\") pod \"iptables-alerter-7d9fk\" (UID: \"243ed3b4-d176-4a81-b333-7ce4be76b669\") " pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.303138 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.303117 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcm6\" (UniqueName: \"kubernetes.io/projected/ad62f8de-2563-48fe-b828-ee5e41127b99-kube-api-access-5pcm6\") pod \"ovnkube-node-kr46l\" (UID: \"ad62f8de-2563-48fe-b828-ee5e41127b99\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.375355 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.375313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" Jun 08 12:51:27.386794 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.386772 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmlr5" Jun 08 12:51:27.394479 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.394448 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:27.399222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.399199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5w26" Jun 08 12:51:27.407674 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.407650 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7d9fk" Jun 08 12:51:27.415342 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.415319 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58wd4" Jun 08 12:51:27.420979 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.420961 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dckjp" Jun 08 12:51:27.428640 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.428622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:27.434040 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.434023 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cccq2" Jun 08 12:51:27.690561 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.690469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:27.690721 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.690627 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:27.690721 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.690699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:28.690678714 +0000 UTC m=+4.035102986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:27.791773 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.791740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:27.791949 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:27.791789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:27.791949 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.791891 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:27.791949 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.791916 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:27.791949 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.791942 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:27.792115 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.791955 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:28.79193873 +0000 UTC m=+4.136362990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:27.792115 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.791956 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:27.792115 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:27.792016 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:28.792000655 +0000 UTC m=+4.136424928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:28.122512 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.122350 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:46:27 +0000 UTC" deadline="2028-02-10 12:32:05.497656586 +0000 UTC" Jun 08 12:51:28.122512 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.122508 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14687h40m37.37515271s" Jun 08 12:51:28.127855 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.127832 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8b65ce_138b_4fe3_a710_3d242bab1f6d.slice/crio-2a229a3163c3cb254a8d7053f73f0ad8d35d4f6503a4b7d4a6e7d6de788f16a5 WatchSource:0}: Error finding container 2a229a3163c3cb254a8d7053f73f0ad8d35d4f6503a4b7d4a6e7d6de788f16a5: Status 404 returned error can't find the container with id 2a229a3163c3cb254a8d7053f73f0ad8d35d4f6503a4b7d4a6e7d6de788f16a5 Jun 08 12:51:28.146431 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.146399 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62cca45_53e9_4441_b04a_bccc6617c34d.slice/crio-ea40388238e310a0ca49376e4e148c924dc85d1815156dc47c700babd69c6292 WatchSource:0}: Error finding container ea40388238e310a0ca49376e4e148c924dc85d1815156dc47c700babd69c6292: Status 404 returned error can't find the container with id ea40388238e310a0ca49376e4e148c924dc85d1815156dc47c700babd69c6292 Jun 08 12:51:28.147705 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.147686 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a3e2a3_c061_4743_b91f_ccc58ab2608f.slice/crio-cfd8e92931f78d6424d9da5730862cc6a1bee01539533749fc4742565e5d4427 WatchSource:0}: Error finding container cfd8e92931f78d6424d9da5730862cc6a1bee01539533749fc4742565e5d4427: Status 404 returned error can't find the container with id cfd8e92931f78d6424d9da5730862cc6a1bee01539533749fc4742565e5d4427 Jun 08 12:51:28.150248 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.150207 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda71e307_3542_4bcd_93b3_f641c706ea2e.slice/crio-eb3b31d5ae1a1e3cf5b91324aa0a3c9b694de675fdd934aba88eaa5b65062759 WatchSource:0}: Error finding container eb3b31d5ae1a1e3cf5b91324aa0a3c9b694de675fdd934aba88eaa5b65062759: Status 404 returned error can't find the container with id eb3b31d5ae1a1e3cf5b91324aa0a3c9b694de675fdd934aba88eaa5b65062759 Jun 08 12:51:28.151088 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.151069 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e10d114_23eb_4173_9b77_e36f49813b91.slice/crio-1182800a4e366233b74d1bdd657c8e94082979dc9157e080152c95a5c6a11014 WatchSource:0}: Error finding container 1182800a4e366233b74d1bdd657c8e94082979dc9157e080152c95a5c6a11014: Status 404 returned error can't find the container with id 1182800a4e366233b74d1bdd657c8e94082979dc9157e080152c95a5c6a11014 Jun 08 12:51:28.155498 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.155470 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hzdwg" event={"ID":"3e10d114-23eb-4173-9b77-e36f49813b91","Type":"ContainerStarted","Data":"1182800a4e366233b74d1bdd657c8e94082979dc9157e080152c95a5c6a11014"} Jun 08 12:51:28.157789 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.157760 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerStarted","Data":"eb3b31d5ae1a1e3cf5b91324aa0a3c9b694de675fdd934aba88eaa5b65062759"} Jun 08 12:51:28.158118 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.158028 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee330dd_8db9_4072_9175_e93505f3d5c6.slice/crio-cdc9e1411d1df09053d69a04f1c253dcce9e947389b77be4bfab98a75e770c00 WatchSource:0}: Error finding container cdc9e1411d1df09053d69a04f1c253dcce9e947389b77be4bfab98a75e770c00: Status 404 returned error can't find the container with id cdc9e1411d1df09053d69a04f1c253dcce9e947389b77be4bfab98a75e770c00 Jun 08 12:51:28.159011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.158964 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cccq2" event={"ID":"b2a3e2a3-c061-4743-b91f-ccc58ab2608f","Type":"ContainerStarted","Data":"cfd8e92931f78d6424d9da5730862cc6a1bee01539533749fc4742565e5d4427"} Jun 08 12:51:28.161187 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.161158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f9710c_0c45_40de_bdee_000cee2b3227.slice/crio-0adcf937311b1667877dcb87b0ab4fe7cfc100dfff37af507ea91be31aefa8b7 WatchSource:0}: Error finding container 0adcf937311b1667877dcb87b0ab4fe7cfc100dfff37af507ea91be31aefa8b7: Status 404 returned error can't find the container with id 0adcf937311b1667877dcb87b0ab4fe7cfc100dfff37af507ea91be31aefa8b7 Jun 08 12:51:28.161310 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.161285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" event={"ID":"d62cca45-53e9-4441-b04a-bccc6617c34d","Type":"ContainerStarted","Data":"ea40388238e310a0ca49376e4e148c924dc85d1815156dc47c700babd69c6292"} Jun 08 12:51:28.161398 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.161379 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243ed3b4_d176_4a81_b333_7ce4be76b669.slice/crio-183305b6e8fabc9fd62275c1db0bd6a51a1669e01bddd24a6ff3a85495a60920 WatchSource:0}: Error finding container 183305b6e8fabc9fd62275c1db0bd6a51a1669e01bddd24a6ff3a85495a60920: Status 404 returned error can't find the container with id 183305b6e8fabc9fd62275c1db0bd6a51a1669e01bddd24a6ff3a85495a60920 Jun 08 12:51:28.161608 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:51:28.161582 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad62f8de_2563_48fe_b828_ee5e41127b99.slice/crio-f07de95fb2e718ac460b5e1ee311995b42b4d7ea13d3ab04f64ae781217c2d5a WatchSource:0}: Error finding container f07de95fb2e718ac460b5e1ee311995b42b4d7ea13d3ab04f64ae781217c2d5a: Status 404 returned error can't find the container with id f07de95fb2e718ac460b5e1ee311995b42b4d7ea13d3ab04f64ae781217c2d5a Jun 08 12:51:28.162442 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.162413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5w26" event={"ID":"3f8b65ce-138b-4fe3-a710-3d242bab1f6d","Type":"ContainerStarted","Data":"2a229a3163c3cb254a8d7053f73f0ad8d35d4f6503a4b7d4a6e7d6de788f16a5"} Jun 08 12:51:28.698762 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.698721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:28.698948 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.698903 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:28.699007 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.698986 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:30.698964233 +0000 UTC m=+6.043388495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:28.799551 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.799228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:28.799551 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:28.799308 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:28.799551 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.799463 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:28.799551 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.799481 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:28.799551 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.799494 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:28.799910 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.799572 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:30.799551609 +0000 UTC m=+6.143975887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:28.799988 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.799969 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:28.800040 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:28.800025 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:30.800010095 +0000 UTC m=+6.144434356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:29.123667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.123556 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:46:27 +0000 UTC" deadline="2028-02-03 23:09:59.961222339 +0000 UTC" Jun 08 12:51:29.123667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.123618 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14530h18m30.837608847s" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.146115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:29.146245 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.146704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:29.146860 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.147547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:29.147677 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:29.147640 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:29.177122 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.177085 2568 generic.go:356] "Generic (PLEG): container finished" podID="cb8915ff6849d1522aea4476a1c836b6" containerID="35dc5c908e6894f0ac873f22dd618cc277b295681bb7bb2ba21778e184cc654d" exitCode=0 Jun 08 12:51:29.177293 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.177175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" event={"ID":"cb8915ff6849d1522aea4476a1c836b6","Type":"ContainerDied","Data":"35dc5c908e6894f0ac873f22dd618cc277b295681bb7bb2ba21778e184cc654d"} Jun 08 12:51:29.188402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.188054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" event={"ID":"aa196d6cc65c8689ea2b6295977c450b","Type":"ContainerStarted","Data":"81ad94a4d3a0d94729ad0ef3a31e7be31ae2938586b0af841b4db222b6ea3aac"} Jun 08 12:51:29.217272 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.216894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"f07de95fb2e718ac460b5e1ee311995b42b4d7ea13d3ab04f64ae781217c2d5a"} Jun 08 12:51:29.218885 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.218809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7d9fk" event={"ID":"243ed3b4-d176-4a81-b333-7ce4be76b669","Type":"ContainerStarted","Data":"183305b6e8fabc9fd62275c1db0bd6a51a1669e01bddd24a6ff3a85495a60920"} Jun 08 12:51:29.220700 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.220612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmlr5" event={"ID":"90f9710c-0c45-40de-bdee-000cee2b3227","Type":"ContainerStarted","Data":"0adcf937311b1667877dcb87b0ab4fe7cfc100dfff37af507ea91be31aefa8b7"} Jun 08 12:51:29.226434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.226323 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-250.ec2.internal" podStartSLOduration=3.226307075 podStartE2EDuration="3.226307075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:29.225288686 +0000 UTC m=+4.569712967" watchObservedRunningTime="2026-06-08 12:51:29.226307075 +0000 UTC m=+4.570731356" Jun 08 12:51:29.228822 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:29.228732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dckjp" event={"ID":"dee330dd-8db9-4072-9175-e93505f3d5c6","Type":"ContainerStarted","Data":"cdc9e1411d1df09053d69a04f1c253dcce9e947389b77be4bfab98a75e770c00"} Jun 08 12:51:30.259392 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:30.259354 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" event={"ID":"cb8915ff6849d1522aea4476a1c836b6","Type":"ContainerStarted","Data":"231ece90a38d5ab7a71dbeea0ba468fd19f6ec8302409abc2ad5819b9423b579"} Jun 08 12:51:30.715248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:30.715211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:30.715424 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.715402 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:30.715505 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.715463 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:34.715445501 +0000 UTC m=+10.059869771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:30.816584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:30.816665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.816804 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.816869 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:34.81685017 +0000 UTC m=+10.161274431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.817266 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.817285 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.817298 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:30.817371 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:30.817339 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:34.817325337 +0000 UTC m=+10.161749599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:31.148093 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:31.148006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:31.148093 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:31.148031 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:31.148299 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:31.148018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:31.148299 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:31.148133 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:31.148299 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:31.148234 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:31.148442 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:31.148307 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:33.146618 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:33.146533 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:33.146618 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:33.146534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:33.147122 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:33.146653 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:33.147122 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:33.146733 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:33.147122 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:33.146796 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:33.147122 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:33.146866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:34.751473 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:34.751437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:34.751966 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.751583 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:34.751966 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.751666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:42.751642559 +0000 UTC m=+18.096066836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:34.852238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:34.852314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852469 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852492 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852505 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852580 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:42.85255921 +0000 UTC m=+18.196983470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852804 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:34.852917 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:34.852874 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:42.852854598 +0000 UTC m=+18.197278864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:35.147399 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:35.147312 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:35.147575 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:35.147419 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:35.147575 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:35.147512 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:35.147697 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:35.147639 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:35.147697 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:35.147680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:35.147793 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:35.147743 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:37.146809 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:37.146590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:37.146809 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:37.146615 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:37.146809 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:37.146591 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:37.146809 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:37.146733 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:37.146809 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:37.146810 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:37.147479 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:37.146880 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:39.146477 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:39.146449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:39.146959 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:39.146585 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:39.146959 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:39.146683 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:39.146959 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:39.146704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:39.146959 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:39.146777 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:39.146959 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:39.146868 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:41.147252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:41.146674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:41.147252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:41.146711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:41.147252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:41.146680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:41.147252 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:41.146834 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:41.147252 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:41.146966 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:41.147978 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:41.147937 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:42.816303 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:42.816207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:42.816835 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.816342 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:42.816835 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.816407 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:58.816388444 +0000 UTC m=+34.160812715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:42.916872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:42.916834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:42.916918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.916955 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.917017 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.917035 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:58.917013849 +0000 UTC m=+34.261438125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.917039 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:42.917060 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.917052 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:42.917295 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:42.917089 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:58.917078686 +0000 UTC m=+34.261502947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:43.146549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:43.146451 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:43.146549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:43.146476 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:43.146549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:43.146476 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:43.146817 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:43.146602 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:43.146817 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:43.146710 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:43.146817 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:43.146788 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:45.146496 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:45.146463 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:45.146981 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:45.146666 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:45.146981 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:45.146706 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:45.146981 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:45.146732 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:45.146981 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:45.146810 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:45.148497 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:45.147615 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:47.145955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.145694 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:47.146675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.145697 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:47.146675 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:47.146171 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:47.146675 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:47.146055 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:47.146675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.145731 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:47.146675 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:47.146261 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:47.294322 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.294286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hzdwg" event={"ID":"3e10d114-23eb-4173-9b77-e36f49813b91","Type":"ContainerStarted","Data":"3a552e1d9e6ee75f5e6979a592c964375e040e6bf255bcb860a4c3acec3ed3bd"} Jun 08 12:51:47.295861 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.295835 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="27edbaadfd88cd1fcd5758e0e3ca44e6ce8e576aa00b23b7776ee5de87c38c52" exitCode=0 Jun 08 12:51:47.295973 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.295914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"27edbaadfd88cd1fcd5758e0e3ca44e6ce8e576aa00b23b7776ee5de87c38c52"} Jun 08 12:51:47.298149 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.298125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cccq2" event={"ID":"b2a3e2a3-c061-4743-b91f-ccc58ab2608f","Type":"ContainerStarted","Data":"3aeb51cd97251b16aada7c643c84b6816b6732b8d5a81b9c341e79bc6c910d40"} Jun 08 12:51:47.301268 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.301192 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" event={"ID":"d62cca45-53e9-4441-b04a-bccc6617c34d","Type":"ContainerStarted","Data":"c3adff45123be8b9c65389bb83228759c7562f59d18aa0dfbc1c396cc61fb4c8"} Jun 08 12:51:47.302875 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.302849 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5w26" event={"ID":"3f8b65ce-138b-4fe3-a710-3d242bab1f6d","Type":"ContainerStarted","Data":"e695130480aea6c9bc7d529b68329433b071b8352f51475281f7691823963b73"} Jun 08 12:51:47.305239 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.305213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"6d8c2c4029138b1555ca92987651598a8954481de20f7682252cd631388e0ec8"} Jun 08 12:51:47.305341 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.305285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"ef71de0828fbf591799d0b659aae682c7f1e6f113e05f8a34ee0a09e89c5326c"} Jun 08 12:51:47.305341 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.305335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"27f67a1a7665ee020f5092522837bbe0c812ec3d9022084ad798108175375b7b"} Jun 08 12:51:47.307252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.307216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmlr5" event={"ID":"90f9710c-0c45-40de-bdee-000cee2b3227","Type":"ContainerStarted","Data":"fb213e1ab3e78f7bb9bde87a25b0059008ff9b4d8a82edbc6e153c1f1f6a850e"} Jun 08 12:51:47.308816 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.308795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dckjp" event={"ID":"dee330dd-8db9-4072-9175-e93505f3d5c6","Type":"ContainerStarted","Data":"75fea9341f0bb011361f487770a4375dd9ad54c0ce1149fc3b506a5dcc846a9e"} Jun 08 12:51:47.327593 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.327550 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-250.ec2.internal" podStartSLOduration=21.327535178 podStartE2EDuration="21.327535178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:30.280225324 +0000 UTC m=+5.624649605" watchObservedRunningTime="2026-06-08 12:51:47.327535178 +0000 UTC m=+22.671959451" Jun 08 12:51:47.347317 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.347280 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hzdwg" podStartSLOduration=8.080908569 podStartE2EDuration="22.347263851s" totalImagesPullingTime="14.266355282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:47.327787717 +0000 UTC m=+22.672211998" watchObservedRunningTime="2026-06-08 12:51:47.347263851 +0000 UTC m=+22.691688172" Jun 08 12:51:47.372234 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.372192 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5w26" podStartSLOduration=3.707312044 podStartE2EDuration="22.372177966s" totalImagesPullingTime="18.664865922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:47.371983046 +0000 UTC m=+22.716407325" watchObservedRunningTime="2026-06-08 12:51:47.372177966 +0000 UTC m=+22.716602246" Jun 08 12:51:47.372557 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.372536 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hmlr5" podStartSLOduration=3.72204739 podStartE2EDuration="22.37250181s" totalImagesPullingTime="18.65045442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:47.347806709 +0000 UTC m=+22.692231001" watchObservedRunningTime="2026-06-08 12:51:47.37250181 +0000 UTC m=+22.716926090" Jun 08 12:51:47.459647 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:47.459604 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dckjp" podStartSLOduration=3.761594283 podStartE2EDuration="22.459589349s" totalImagesPullingTime="18.697995066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:47.459115285 +0000 UTC m=+22.803539564" watchObservedRunningTime="2026-06-08 12:51:47.459589349 +0000 UTC m=+22.804013629" Jun 08 12:51:48.281132 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.281109 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:51:48.313580 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.313405 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" event={"ID":"d62cca45-53e9-4441-b04a-bccc6617c34d","Type":"ContainerStarted","Data":"f2e2d2b442ba5a6760fd1bf6fa30d36f5ff6085b39bfef2e20e52ce967dc5767"} Jun 08 12:51:48.316655 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.316613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"e1d3ac32de13fffe392e6e3976ac347328d5a3ccb6de1e1bcf62087233ae9554"} Jun 08 12:51:48.316776 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.316704 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"4a6690d275b5ea9ad2864a380a0f7474b6512959fae02405aab81a2848d99904"} Jun 08 12:51:48.316776 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.316754 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"a8b9cf1dba1e7e474edf2cee1c267b6e3af002c9467cd14cef6521c7f1d05f4e"} Jun 08 12:51:48.821437 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.821399 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:48.821958 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.821934 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:48.837448 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:48.837389 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cccq2" podStartSLOduration=5.172349023 podStartE2EDuration="23.837371134s" totalImagesPullingTime="18.665022111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:47.493488637 +0000 UTC m=+22.837912918" watchObservedRunningTime="2026-06-08 12:51:48.837371134 +0000 UTC m=+24.181795418" Jun 08 12:51:49.136014 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.135816 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:51:48.281125424Z","UUID":"d88d24b9-40a6-47b7-a304-9f92ef27f125","Handler":null,"Name":"","Endpoint":""} Jun 08 12:51:49.137125 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.137101 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:51:49.137212 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.137138 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:51:49.146088 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.146060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:49.146088 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.146088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:49.146312 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:49.146207 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:49.146312 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:49.146262 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:49.146312 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.146291 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:49.146479 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:49.146365 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:49.321263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.321226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7d9fk" event={"ID":"243ed3b4-d176-4a81-b333-7ce4be76b669","Type":"ContainerStarted","Data":"94b1af415052b20cd00c4b759f8f4950197a0b190da5082881896fc5c2389515"} Jun 08 12:51:49.338971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:49.338917 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7d9fk" podStartSLOduration=5.692516751 podStartE2EDuration="24.338900098s" totalImagesPullingTime="18.646383347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:49.33819551 +0000 UTC m=+24.682619791" watchObservedRunningTime="2026-06-08 12:51:49.338900098 +0000 UTC m=+24.683324377" Jun 08 12:51:50.326434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:50.326381 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" event={"ID":"d62cca45-53e9-4441-b04a-bccc6617c34d","Type":"ContainerStarted","Data":"0b5d0b0787e77b0e285e7fa81d53980fc9bacc2c3ef600bec314c6790c84885c"} Jun 08 12:51:50.331545 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:50.331498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"93d313523b557d0d1f4065253ed62dd5cecbaf62b4b94803763fb2597f39e330"} Jun 08 12:51:50.331693 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:50.331594 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:51:50.346611 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:50.346557 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r446s" podStartSLOduration=4.480210437 podStartE2EDuration="25.346541908s" totalImagesPullingTime="20.866331471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:50.346083233 +0000 UTC m=+25.690507527" watchObservedRunningTime="2026-06-08 12:51:50.346541908 +0000 UTC m=+25.690966187" Jun 08 12:51:51.146613 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:51.146508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:51.146613 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:51.146559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:51.146836 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:51.146628 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:51.146836 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:51.146648 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:51.146836 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:51.146706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:51.146836 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:51.146782 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:53.146624 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.146470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:53.147360 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.146487 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:53.147360 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:53.146707 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:53.147360 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.146501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:53.147360 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:53.146816 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:53.147360 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:53.146890 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:53.343021 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.342987 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" event={"ID":"ad62f8de-2563-48fe-b828-ee5e41127b99","Type":"ContainerStarted","Data":"1e68aa114d87cd484a5660d1a253c46acbb0cae17c7dd2cbacca63343943302d"} Jun 08 12:51:53.343302 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.343279 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:53.343468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.343365 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:53.359828 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.359750 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:53.372603 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:53.372488 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" podStartSLOduration=9.640414748 podStartE2EDuration="28.372453861s" totalImagesPullingTime="18.732039113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:53.371996195 +0000 UTC m=+28.716420495" watchObservedRunningTime="2026-06-08 12:51:53.372453861 +0000 UTC m=+28.716878145" Jun 08 12:51:54.346823 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.346789 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="4019c95ff60f574585245f02017b9eb68d35b684846d57b2bdf1a8960577a9b3" exitCode=0 Jun 08 12:51:54.347284 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.346884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"4019c95ff60f574585245f02017b9eb68d35b684846d57b2bdf1a8960577a9b3"} Jun 08 12:51:54.347342 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.347321 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:54.363026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.363001 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:51:54.636796 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.636720 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:54.636939 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.636842 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:51:54.637351 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:54.637334 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hzdwg" Jun 08 12:51:55.149828 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.149792 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:55.149992 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.149955 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:55.150109 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.150086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:55.150283 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.150258 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:55.150350 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.150335 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:55.150479 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.150456 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:55.160759 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.160736 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5nlg"] Jun 08 12:51:55.164946 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.164918 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njs7d"] Jun 08 12:51:55.165551 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.165509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kj94g"] Jun 08 12:51:55.348707 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.348667 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:55.348707 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.348693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:55.349128 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:55.348693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:55.349128 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.349096 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:55.349190 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.349128 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:55.349228 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:55.349193 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:56.353151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:56.352986 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="c9913829e8c50865970dd0c477129065eec3df145bebe39007b275d20ff61124" exitCode=0 Jun 08 12:51:56.353758 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:56.353057 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"c9913829e8c50865970dd0c477129065eec3df145bebe39007b275d20ff61124"} Jun 08 12:51:57.146288 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:57.146255 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:57.146443 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:57.146255 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:57.146443 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:57.146374 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:57.146443 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:57.146263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:57.146593 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:57.146483 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:57.146593 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:57.146571 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:58.359958 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:58.359870 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="122a8d8e4e14b8b298be9f859d159ce494351eb103a4ee5c089f533a19525073" exitCode=0 Jun 08 12:51:58.359958 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:58.359924 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"122a8d8e4e14b8b298be9f859d159ce494351eb103a4ee5c089f533a19525073"} Jun 08 12:51:58.833377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:58.833333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:58.833598 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.833537 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:58.833673 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.833629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs podName:c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:30.833608696 +0000 UTC m=+66.178032961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs") pod "network-metrics-daemon-njs7d" (UID: "c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:58.933760 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:58.933727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:58.933794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.933911 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.933915 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.933943 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.933954 2568 projected.go:196] Error preparing data for projected volume kube-api-access-twg4m for pod openshift-network-diagnostics/network-check-target-kj94g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.933983 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret podName:e0c1dd8c-7311-4318-95c5-03dd64a347b6 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:30.93396565 +0000 UTC m=+66.278389927 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret") pod "global-pull-secret-syncer-r5nlg" (UID: "e0c1dd8c-7311-4318-95c5-03dd64a347b6") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:58.934020 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:58.934006 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m podName:e6d52bab-af36-4c7c-98b3-ee323ee93ac0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:30.933990728 +0000 UTC m=+66.278415003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg4m" (UniqueName: "kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m") pod "network-check-target-kj94g" (UID: "e6d52bab-af36-4c7c-98b3-ee323ee93ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:59.146571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.146470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:51:59.146571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.146470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:51:59.146571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.146531 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:51:59.146819 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:59.146623 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5nlg" podUID="e0c1dd8c-7311-4318-95c5-03dd64a347b6" Jun 08 12:51:59.146819 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:59.146752 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njs7d" podUID="c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5" Jun 08 12:51:59.146906 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:51:59.146825 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj94g" podUID="e6d52bab-af36-4c7c-98b3-ee323ee93ac0" Jun 08 12:51:59.957342 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.957314 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-250.ec2.internal" event="NodeReady" Jun 08 12:51:59.957721 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.957453 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:51:59.991722 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.991682 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cgrsh"] Jun 08 12:51:59.996308 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.996272 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g"] Jun 08 12:51:59.996491 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.996397 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:51:59.999267 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:51:59.998840 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xf8cd\"" Jun 08 12:52:00.000072 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.000042 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 12:52:00.000381 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.000362 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.000556 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.000420 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.001471 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.000697 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 12:52:00.002548 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.002260 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q"] Jun 08 12:52:00.002548 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.002453 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.004908 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.004879 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9q2vt\"" Jun 08 12:52:00.005013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.004880 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.005013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.004966 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 12:52:00.005169 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.005112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.006283 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.006252 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 12:52:00.006718 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.006695 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65f9c7f667-7skqb"] Jun 08 12:52:00.006865 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.006851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.010888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.010866 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 12:52:00.010888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.011183 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:52:00.011641 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.011557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.012217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.012195 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.012648 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.012376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 12:52:00.012648 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.012611 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.014952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.013402 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x4rv6\"" Jun 08 12:52:00.014952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.014282 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mgwdp\"" Jun 08 12:52:00.014952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.014627 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.016139 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.015784 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p"] Jun 08 12:52:00.016242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.016140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.017319 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.017294 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 12:52:00.017527 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.017490 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 12:52:00.017618 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.017543 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 12:52:00.017952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.017790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 12:52:00.018023 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.017961 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.020166 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.019874 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-fntcz"] Jun 08 12:52:00.020550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.020377 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" Jun 08 12:52:00.021282 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.020998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 12:52:00.021282 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.021116 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 12:52:00.021856 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.021651 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-znv4n\"" Jun 08 12:52:00.021856 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.021700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 12:52:00.023670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cgrsh"] Jun 08 12:52:00.023800 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023781 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.023907 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023892 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p"] Jun 08 12:52:00.024011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023990 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q"] Jun 08 12:52:00.024011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023932 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.024011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.024018 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g"] Jun 08 12:52:00.024223 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.024046 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d"] Jun 08 12:52:00.024223 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.023731 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.024355 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.024337 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7h7jp\"" Jun 08 12:52:00.027750 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.027726 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 12:52:00.028018 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.028001 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.028280 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.028262 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 12:52:00.028678 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.028658 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.029203 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.029179 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:52:00.029311 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.029217 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht"] Jun 08 12:52:00.029678 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.029660 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6xsgx\"" Jun 08 12:52:00.030932 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.030913 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.059271 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.059239 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 12:52:00.064477 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.063816 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 12:52:00.064889 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.063888 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9jx4z\"" Jun 08 12:52:00.065240 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.063968 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.065501 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.064133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.065778 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.064187 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 12:52:00.068281 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.067798 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df"] Jun 08 12:52:00.069612 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.067873 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 12:52:00.069612 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.067906 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.071771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.071746 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 12:52:00.071921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.071902 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.072013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.071793 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.072068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.072029 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gt9bl\"" Jun 08 12:52:00.072153 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.072137 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 12:52:00.072884 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.072865 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-skpfx"] Jun 08 12:52:00.073037 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.073007 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" Jun 08 12:52:00.075008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.074986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.075378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.075056 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.075378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.075065 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-78m9w\"" Jun 08 12:52:00.076784 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.076768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65f9c7f667-7skqb"] Jun 08 12:52:00.076879 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.076794 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f7k7g"] Jun 08 12:52:00.076951 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.076897 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.079040 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.079015 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:52:00.079146 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.079058 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vjkf\"" Jun 08 12:52:00.079146 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.079015 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:52:00.080254 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080231 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d"] Jun 08 12:52:00.080357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080272 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fntcz"] Jun 08 12:52:00.080357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht"] Jun 08 12:52:00.080357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080309 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df"] Jun 08 12:52:00.080357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080324 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7k7g"] Jun 08 12:52:00.080357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080347 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skpfx"] Jun 08 12:52:00.080645 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.080372 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.083013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.082994 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:52:00.083248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.083228 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54pl5\"" Jun 08 12:52:00.083325 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.083086 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:52:00.083325 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.082994 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:52:00.149107 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149072 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-service-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c696c6c-cfaa-4c31-aac6-83e4917a868a-serving-cert\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149143 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb774\" (UniqueName: \"kubernetes.io/projected/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-kube-api-access-fb774\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrn7v\" (UniqueName: \"kubernetes.io/projected/2ab00a37-8256-4ad0-8686-972333016c60-kube-api-access-vrn7v\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17ea67fe-ed7e-4d33-af00-94a0af9122d9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.149596 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab00a37-8256-4ad0-8686-972333016c60-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-config\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-snapshots\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmq7p\" (UniqueName: \"kubernetes.io/projected/7004f5a9-acc6-43bc-9505-a953c3bd6c86-kube-api-access-fmq7p\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-trusted-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-tmp\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxq8w\" (UniqueName: \"kubernetes.io/projected/10392597-91ed-4619-ac9c-4d5555902c36-kube-api-access-jxq8w\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10392597-91ed-4619-ac9c-4d5555902c36-serving-cert\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-config\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.149998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lbl\" (UniqueName: \"kubernetes.io/projected/cb726232-c2db-453d-9d8c-deb609fd01e3-kube-api-access-x9lbl\") pod \"volume-data-source-validator-78dd696465-8rh7p\" (UID: \"cb726232-c2db-453d-9d8c-deb609fd01e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-trusted-ca\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.150217 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vc7s\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-stats-auth\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2kdg\" (UniqueName: \"kubernetes.io/projected/87edf8bf-09a5-4154-8437-71cca82b574f-kube-api-access-w2kdg\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-default-certificate\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17ea67fe-ed7e-4d33-af00-94a0af9122d9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6cl\" (UniqueName: \"kubernetes.io/projected/6c696c6c-cfaa-4c31-aac6-83e4917a868a-kube-api-access-hk6cl\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.150925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.150383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7sg5\" (UniqueName: \"kubernetes.io/projected/17ea67fe-ed7e-4d33-af00-94a0af9122d9-kube-api-access-f7sg5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.251759 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxq8w\" (UniqueName: \"kubernetes.io/projected/10392597-91ed-4619-ac9c-4d5555902c36-kube-api-access-jxq8w\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.251759 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.251759 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10392597-91ed-4619-ac9c-4d5555902c36-serving-cert\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-config\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lbl\" (UniqueName: \"kubernetes.io/projected/cb726232-c2db-453d-9d8c-deb609fd01e3-kube-api-access-x9lbl\") pod \"volume-data-source-validator-78dd696465-8rh7p\" (UID: \"cb726232-c2db-453d-9d8c-deb609fd01e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsx7\" (UniqueName: \"kubernetes.io/projected/746735bf-77a6-493d-91dd-f005ff0c0304-kube-api-access-5lsx7\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.251846 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.251851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-trusted-ca\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.251919 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.751899207 +0000 UTC m=+36.096323466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:00.252026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc7s\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-stats-auth\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5cc\" (UniqueName: \"kubernetes.io/projected/80ae8e68-b603-4149-98b9-fad5280ec13d-kube-api-access-td5cc\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.252143 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746735bf-77a6-493d-91dd-f005ff0c0304-cert\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.252195 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.752181253 +0000 UTC m=+36.096605523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252326 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2kdg\" (UniqueName: \"kubernetes.io/projected/87edf8bf-09a5-4154-8437-71cca82b574f-kube-api-access-w2kdg\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.252367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-default-certificate\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.252791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17ea67fe-ed7e-4d33-af00-94a0af9122d9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.252791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-config\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.252895 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.252895 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6cl\" (UniqueName: \"kubernetes.io/projected/6c696c6c-cfaa-4c31-aac6-83e4917a868a-kube-api-access-hk6cl\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.252895 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10392597-91ed-4619-ac9c-4d5555902c36-trusted-ca\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.253042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7sg5\" (UniqueName: \"kubernetes.io/projected/17ea67fe-ed7e-4d33-af00-94a0af9122d9-kube-api-access-f7sg5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.253042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.253042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbjv\" (UniqueName: \"kubernetes.io/projected/6b62cadc-0d73-4a46-81a2-bc649c4d6b5f-kube-api-access-mbbjv\") pod \"network-check-source-dbd9cf844-zl8df\" (UID: \"6b62cadc-0d73-4a46-81a2-bc649c4d6b5f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" Jun 08 12:52:00.253042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.252994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-service-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.253042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c696c6c-cfaa-4c31-aac6-83e4917a868a-serving-cert\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.253274 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253042 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253274 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253274 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253274 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb774\" (UniqueName: \"kubernetes.io/projected/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-kube-api-access-fb774\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.253462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrn7v\" (UniqueName: \"kubernetes.io/projected/2ab00a37-8256-4ad0-8686-972333016c60-kube-api-access-vrn7v\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.253462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253632 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.253632 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253508 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17ea67fe-ed7e-4d33-af00-94a0af9122d9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.253632 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253632 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab00a37-8256-4ad0-8686-972333016c60-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-config\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-snapshots\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80ae8e68-b603-4149-98b9-fad5280ec13d-config-volume\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmq7p\" (UniqueName: \"kubernetes.io/projected/7004f5a9-acc6-43bc-9505-a953c3bd6c86-kube-api-access-fmq7p\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-trusted-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.253824 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae8e68-b603-4149-98b9-fad5280ec13d-tmp-dir\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.254129 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.254129 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.253879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-tmp\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.254129 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.254048 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-service-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.254278 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.254212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-tmp\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.255080 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.254876 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-config\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.255080 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.253388 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:00.255080 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.254923 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:00.255080 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.254980 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.754963182 +0000 UTC m=+36.099387455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:00.255080 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.255057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c696c6c-cfaa-4c31-aac6-83e4917a868a-snapshots\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.255409 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.255271 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c696c6c-cfaa-4c31-aac6-83e4917a868a-trusted-ca-bundle\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.255465 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.255408 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.755392973 +0000 UTC m=+36.099817253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:00.255465 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.255452 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:00.255594 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.255499 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.755484157 +0000 UTC m=+36.099908439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:00.256413 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.256023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17ea67fe-ed7e-4d33-af00-94a0af9122d9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.256413 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.256043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.256413 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.256324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.256886 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.256854 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab00a37-8256-4ad0-8686-972333016c60-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.258330 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.258422 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258377 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.258511 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258488 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10392597-91ed-4619-ac9c-4d5555902c36-serving-cert\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.258602 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258578 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17ea67fe-ed7e-4d33-af00-94a0af9122d9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.258685 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-stats-auth\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.258864 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.258839 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c696c6c-cfaa-4c31-aac6-83e4917a868a-serving-cert\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.259198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.259179 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-default-certificate\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.260326 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.260277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.262931 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.262874 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lbl\" (UniqueName: \"kubernetes.io/projected/cb726232-c2db-453d-9d8c-deb609fd01e3-kube-api-access-x9lbl\") pod \"volume-data-source-validator-78dd696465-8rh7p\" (UID: \"cb726232-c2db-453d-9d8c-deb609fd01e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" Jun 08 12:52:00.263307 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.263262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc7s\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.263744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.263696 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2kdg\" (UniqueName: \"kubernetes.io/projected/87edf8bf-09a5-4154-8437-71cca82b574f-kube-api-access-w2kdg\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.264086 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.264064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxq8w\" (UniqueName: \"kubernetes.io/projected/10392597-91ed-4619-ac9c-4d5555902c36-kube-api-access-jxq8w\") pod \"console-operator-668fdbf85c-cgrsh\" (UID: \"10392597-91ed-4619-ac9c-4d5555902c36\") " pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.264791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.264750 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmq7p\" (UniqueName: \"kubernetes.io/projected/7004f5a9-acc6-43bc-9505-a953c3bd6c86-kube-api-access-fmq7p\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.265666 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.265643 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.266591 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.266126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6cl\" (UniqueName: \"kubernetes.io/projected/6c696c6c-cfaa-4c31-aac6-83e4917a868a-kube-api-access-hk6cl\") pod \"insights-operator-896549976-fntcz\" (UID: \"6c696c6c-cfaa-4c31-aac6-83e4917a868a\") " pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.266858 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.266819 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrn7v\" (UniqueName: \"kubernetes.io/projected/2ab00a37-8256-4ad0-8686-972333016c60-kube-api-access-vrn7v\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.266928 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.266871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7sg5\" (UniqueName: \"kubernetes.io/projected/17ea67fe-ed7e-4d33-af00-94a0af9122d9-kube-api-access-f7sg5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fh45d\" (UID: \"17ea67fe-ed7e-4d33-af00-94a0af9122d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.267173 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.267082 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb774\" (UniqueName: \"kubernetes.io/projected/e496a7d8-9cc8-4b2c-a116-65cfc046c7d0-kube-api-access-fb774\") pod \"service-ca-operator-6bc5ff68f5-cnvht\" (UID: \"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.311656 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.311616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:00.354947 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.354903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80ae8e68-b603-4149-98b9-fad5280ec13d-config-volume\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.354962 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae8e68-b603-4149-98b9-fad5280ec13d-tmp-dir\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsx7\" (UniqueName: \"kubernetes.io/projected/746735bf-77a6-493d-91dd-f005ff0c0304-kube-api-access-5lsx7\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.355137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5cc\" (UniqueName: \"kubernetes.io/projected/80ae8e68-b603-4149-98b9-fad5280ec13d-kube-api-access-td5cc\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746735bf-77a6-493d-91dd-f005ff0c0304-cert\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.355331 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355169 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355331 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355193 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbjv\" (UniqueName: \"kubernetes.io/projected/6b62cadc-0d73-4a46-81a2-bc649c4d6b5f-kube-api-access-mbbjv\") pod \"network-check-source-dbd9cf844-zl8df\" (UID: \"6b62cadc-0d73-4a46-81a2-bc649c4d6b5f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" Jun 08 12:52:00.355434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae8e68-b603-4149-98b9-fad5280ec13d-tmp-dir\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355663 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.355642 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:00.355725 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.355664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80ae8e68-b603-4149-98b9-fad5280ec13d-config-volume\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.355725 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.355708 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:00.855689219 +0000 UTC m=+36.200113483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:00.358347 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.358320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746735bf-77a6-493d-91dd-f005ff0c0304-cert\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.364984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.364902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsx7\" (UniqueName: \"kubernetes.io/projected/746735bf-77a6-493d-91dd-f005ff0c0304-kube-api-access-5lsx7\") pod \"ingress-canary-f7k7g\" (UID: \"746735bf-77a6-493d-91dd-f005ff0c0304\") " pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.365693 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.365664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5cc\" (UniqueName: \"kubernetes.io/projected/80ae8e68-b603-4149-98b9-fad5280ec13d-kube-api-access-td5cc\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.366034 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.366009 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbjv\" (UniqueName: \"kubernetes.io/projected/6b62cadc-0d73-4a46-81a2-bc649c4d6b5f-kube-api-access-mbbjv\") pod \"network-check-source-dbd9cf844-zl8df\" (UID: \"6b62cadc-0d73-4a46-81a2-bc649c4d6b5f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" Jun 08 12:52:00.387053 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.386916 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" Jun 08 12:52:00.394626 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.394511 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fntcz" Jun 08 12:52:00.402179 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.401989 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" Jun 08 12:52:00.409643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.409616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" Jun 08 12:52:00.417905 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.417756 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" Jun 08 12:52:00.434037 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.433261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7k7g" Jun 08 12:52:00.499079 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.499016 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cgrsh"] Jun 08 12:52:00.514697 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.514664 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10392597_91ed_4619_ac9c_4d5555902c36.slice/crio-e33025e752ed85eb264294028fc0881cfe02076310f191389637f880ce37b229 WatchSource:0}: Error finding container e33025e752ed85eb264294028fc0881cfe02076310f191389637f880ce37b229: Status 404 returned error can't find the container with id e33025e752ed85eb264294028fc0881cfe02076310f191389637f880ce37b229 Jun 08 12:52:00.604706 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.604624 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p"] Jun 08 12:52:00.610727 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.610655 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb726232_c2db_453d_9d8c_deb609fd01e3.slice/crio-0ba4a9149c134c734594b76d220cb69a586e96685745b246a712fc03ff2b50ac WatchSource:0}: Error finding container 0ba4a9149c134c734594b76d220cb69a586e96685745b246a712fc03ff2b50ac: Status 404 returned error can't find the container with id 0ba4a9149c134c734594b76d220cb69a586e96685745b246a712fc03ff2b50ac Jun 08 12:52:00.647729 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.647694 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht"] Jun 08 12:52:00.652140 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.652110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fntcz"] Jun 08 12:52:00.652255 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.652187 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df"] Jun 08 12:52:00.652816 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.652792 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d"] Jun 08 12:52:00.655382 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.655248 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c696c6c_cfaa_4c31_aac6_83e4917a868a.slice/crio-d2bc195fa577401e456d3f1cb055c8db4b8f1343400a1e29b752928b886434f7 WatchSource:0}: Error finding container d2bc195fa577401e456d3f1cb055c8db4b8f1343400a1e29b752928b886434f7: Status 404 returned error can't find the container with id d2bc195fa577401e456d3f1cb055c8db4b8f1343400a1e29b752928b886434f7 Jun 08 12:52:00.656079 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.656014 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ea67fe_ed7e_4d33_af00_94a0af9122d9.slice/crio-f6beea0f8aba0ddefc2f73d9a4d1656bf8bdf94533cd124b91fe8e7372f5be20 WatchSource:0}: Error finding container f6beea0f8aba0ddefc2f73d9a4d1656bf8bdf94533cd124b91fe8e7372f5be20: Status 404 returned error can't find the container with id f6beea0f8aba0ddefc2f73d9a4d1656bf8bdf94533cd124b91fe8e7372f5be20 Jun 08 12:52:00.656968 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.656929 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b62cadc_0d73_4a46_81a2_bc649c4d6b5f.slice/crio-7c8cc10b5347895bceea9cfc9601711708cd303ee182141559fbee21a09d57de WatchSource:0}: Error finding container 7c8cc10b5347895bceea9cfc9601711708cd303ee182141559fbee21a09d57de: Status 404 returned error can't find the container with id 7c8cc10b5347895bceea9cfc9601711708cd303ee182141559fbee21a09d57de Jun 08 12:52:00.679062 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.679032 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7k7g"] Jun 08 12:52:00.682503 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:00.682473 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746735bf_77a6_493d_91dd_f005ff0c0304.slice/crio-ea0f326aecae8020887f19e318a6d3814b526e84b34fbe123cb35134d70028e3 WatchSource:0}: Error finding container ea0f326aecae8020887f19e318a6d3814b526e84b34fbe123cb35134d70028e3: Status 404 returned error can't find the container with id ea0f326aecae8020887f19e318a6d3814b526e84b34fbe123cb35134d70028e3 Jun 08 12:52:00.761670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.761581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.761670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.761623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.761678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.761742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.761778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761817 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.761794224 +0000 UTC m=+37.106218496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761852 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761863 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:00.761893 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761852 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761901 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.761890187 +0000 UTC m=+37.106314445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761918 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.761908926 +0000 UTC m=+37.106333184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761933 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.761925334 +0000 UTC m=+37.106349596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761945 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.761959 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:00.762179 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.762004 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.761992036 +0000 UTC m=+37.106416308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:00.862485 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:00.862446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:00.862688 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.862635 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:00.862768 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:00.862725 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.862702929 +0000 UTC m=+37.207127201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:01.151044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.149192 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:52:01.151044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.149710 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:52:01.151044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.150109 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:52:01.153292 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.152577 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:52:01.153292 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.152796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:52:01.153292 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.152970 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4jlgv\"" Jun 08 12:52:01.153292 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.153155 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzgqm\"" Jun 08 12:52:01.273305 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.272143 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq"] Jun 08 12:52:01.276480 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.275532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.278542 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.278248 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 12:52:01.278976 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.278736 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 12:52:01.279259 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.279100 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zpclm\"" Jun 08 12:52:01.286641 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.286575 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq"] Jun 08 12:52:01.367068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.367033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.367263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.367200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.373605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.373568 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" event={"ID":"6b62cadc-0d73-4a46-81a2-bc649c4d6b5f","Type":"ContainerStarted","Data":"7c8cc10b5347895bceea9cfc9601711708cd303ee182141559fbee21a09d57de"} Jun 08 12:52:01.376336 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.376307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" event={"ID":"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0","Type":"ContainerStarted","Data":"add6bbc7a6781d9ea885023cd25bbbdcfc130584ec211db6af198c5d82d1d572"} Jun 08 12:52:01.379199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.379169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7k7g" event={"ID":"746735bf-77a6-493d-91dd-f005ff0c0304","Type":"ContainerStarted","Data":"ea0f326aecae8020887f19e318a6d3814b526e84b34fbe123cb35134d70028e3"} Jun 08 12:52:01.382910 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.382838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" event={"ID":"10392597-91ed-4619-ac9c-4d5555902c36","Type":"ContainerStarted","Data":"e33025e752ed85eb264294028fc0881cfe02076310f191389637f880ce37b229"} Jun 08 12:52:01.387048 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.386973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" event={"ID":"cb726232-c2db-453d-9d8c-deb609fd01e3","Type":"ContainerStarted","Data":"0ba4a9149c134c734594b76d220cb69a586e96685745b246a712fc03ff2b50ac"} Jun 08 12:52:01.388814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.388746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" event={"ID":"17ea67fe-ed7e-4d33-af00-94a0af9122d9","Type":"ContainerStarted","Data":"f6beea0f8aba0ddefc2f73d9a4d1656bf8bdf94533cd124b91fe8e7372f5be20"} Jun 08 12:52:01.390404 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.390353 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fntcz" event={"ID":"6c696c6c-cfaa-4c31-aac6-83e4917a868a","Type":"ContainerStarted","Data":"d2bc195fa577401e456d3f1cb055c8db4b8f1343400a1e29b752928b886434f7"} Jun 08 12:52:01.422717 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.422579 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:01.468833 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.468150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.468833 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.468320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.468833 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.468483 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:01.468833 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.468565 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:01.968546167 +0000 UTC m=+37.312970446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:01.469257 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.469194 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.518249 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.518204 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.772318 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.772373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.772437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.772526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.772564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.772709 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.772773 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.772754712 +0000 UTC m=+39.117178975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773199 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.773183775 +0000 UTC m=+39.117608035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773266 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773300 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.773288765 +0000 UTC m=+39.117713026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773349 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773378 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.773367411 +0000 UTC m=+39.117791674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773435 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773446 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:01.773581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.773477 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.773467104 +0000 UTC m=+39.117891367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:01.874504 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.873883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:01.874504 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.874096 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:01.874504 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.874157 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:03.874139452 +0000 UTC m=+39.218563723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:01.975082 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:01.975041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:01.975247 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.975233 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:01.975323 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:01.975300 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:02.975280778 +0000 UTC m=+38.319705039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:02.987048 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:02.986984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:02.987546 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:02.987158 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:02.987546 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:02.987243 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:04.987221859 +0000 UTC m=+40.331646122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:03.793873 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.793631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:03.794057 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.793771 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:03.794057 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.793951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:03.794057 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794005 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.793981995 +0000 UTC m=+43.138406255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794077 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.794087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.794115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794130 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.794114678 +0000 UTC m=+43.138538958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794166 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794193 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.794184467 +0000 UTC m=+43.138608747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794211 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.794221 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:03.794236 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794230 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:03.794693 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794275 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.794260934 +0000 UTC m=+43.138685192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:03.794693 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.794320 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.794307961 +0000 UTC m=+43.138732243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:03.895302 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:03.895258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:03.895454 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.895436 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:03.895542 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:03.895512 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.895491217 +0000 UTC m=+43.239915475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:04.647231 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:04.647121 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:04.746769 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:04.746725 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:05.005997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:05.005964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:05.006159 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:05.006109 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:05.006199 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:05.006176 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:09.006160534 +0000 UTC m=+44.350584793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:05.110705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:05.110662 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:05.213085 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:05.213054 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:05.312335 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:05.312247 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:05.379563 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:05.379528 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:07.829453 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.829417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.829538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.829574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829611 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.829653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829682 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.829663688 +0000 UTC m=+51.174087967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829704 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829726 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.829727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829754 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.829740039 +0000 UTC m=+51.174164298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829761 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829775 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.829765284 +0000 UTC m=+51.174189553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829803 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.829789013 +0000 UTC m=+51.174213288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829814 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:07.829955 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.829848 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.829837437 +0000 UTC m=+51.174261697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:07.930258 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.930224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:07.930445 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.930398 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:07.930496 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:07.930483 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:15.930463967 +0000 UTC m=+51.274888230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:07.931401 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:07.931368 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:08.031224 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:08.031143 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:09.041557 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:09.041498 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:09.041956 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:09.041626 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:09.041956 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:09.041691 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:17.041674524 +0000 UTC m=+52.386098805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:10.291035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.290996 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:10.386987 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.386946 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:10.424321 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.424277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" event={"ID":"6b62cadc-0d73-4a46-81a2-bc649c4d6b5f","Type":"ContainerStarted","Data":"5539dd9b8d704a7fcefba8188d45469aa888eff7b806439bffa3ebe7a87a6c04"} Jun 08 12:52:10.426356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.426318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" event={"ID":"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0","Type":"ContainerStarted","Data":"30e34b62772ad5b287f854b2898d70c1ce0b3049acb08f7bbb9a9f43b380fb52"} Jun 08 12:52:10.429434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.429406 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="4c1a2cba5d35bde0c0e1d63c7aec946469090976488c152cf918f1c808b743cd" exitCode=0 Jun 08 12:52:10.429581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.429465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"4c1a2cba5d35bde0c0e1d63c7aec946469090976488c152cf918f1c808b743cd"} Jun 08 12:52:10.430966 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.430941 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7k7g" event={"ID":"746735bf-77a6-493d-91dd-f005ff0c0304","Type":"ContainerStarted","Data":"cf254908a60a72efd4a4665c8ab253d9a7bbcc26f1c4d91b9c3c08f5b1349eae"} Jun 08 12:52:10.433265 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.433244 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/0.log" Jun 08 12:52:10.433377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.433290 2568 generic.go:356] "Generic (PLEG): container finished" podID="10392597-91ed-4619-ac9c-4d5555902c36" containerID="270e8e1af52980eca6de2916de57488cf767f599e9c1c7cbaaa762a05ec55db3" exitCode=255 Jun 08 12:52:10.433377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.433357 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" event={"ID":"10392597-91ed-4619-ac9c-4d5555902c36","Type":"ContainerDied","Data":"270e8e1af52980eca6de2916de57488cf767f599e9c1c7cbaaa762a05ec55db3"} Jun 08 12:52:10.433644 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.433625 2568 scope.go:117] "RemoveContainer" containerID="270e8e1af52980eca6de2916de57488cf767f599e9c1c7cbaaa762a05ec55db3" Jun 08 12:52:10.437146 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.437122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" event={"ID":"cb726232-c2db-453d-9d8c-deb609fd01e3","Type":"ContainerStarted","Data":"b42159781d589643f1c17ce1b6bdfef9daa169dab2032fdd0c3b70ed07b7193b"} Jun 08 12:52:10.438700 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.438678 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" event={"ID":"17ea67fe-ed7e-4d33-af00-94a0af9122d9","Type":"ContainerStarted","Data":"27de866b69e9a71f8f9013f7d798748fc99462dbaa3d3989a5323605ee2a9535"} Jun 08 12:52:10.440190 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.440167 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fntcz" event={"ID":"6c696c6c-cfaa-4c31-aac6-83e4917a868a","Type":"ContainerStarted","Data":"18110a97b67e9f369178fafa7ba334650afa06e469f4cb11cec86db8fdd8a835"} Jun 08 12:52:10.445278 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.445227 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zl8df" podStartSLOduration=27.745084389 podStartE2EDuration="36.445212174s" totalImagesPullingTime="8.700127785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.44473355 +0000 UTC m=+45.789157832" watchObservedRunningTime="2026-06-08 12:52:10.445212174 +0000 UTC m=+45.789636435" Jun 08 12:52:10.473500 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.472336 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f7k7g" podStartSLOduration=2.822064685 podStartE2EDuration="11.472316725s" totalImagesPullingTime="8.65025204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.471230813 +0000 UTC m=+45.815655094" watchObservedRunningTime="2026-06-08 12:52:10.472316725 +0000 UTC m=+45.816741008" Jun 08 12:52:10.560185 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.559548 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" podStartSLOduration=25.910201806 podStartE2EDuration="34.559512792s" totalImagesPullingTime="8.649310986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.558941935 +0000 UTC m=+45.903366231" watchObservedRunningTime="2026-06-08 12:52:10.559512792 +0000 UTC m=+45.903937052" Jun 08 12:52:10.591242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.591188 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rh7p" podStartSLOduration=32.842840799 podStartE2EDuration="41.591171591s" totalImagesPullingTime="8.748330792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.590532225 +0000 UTC m=+45.934956501" watchObservedRunningTime="2026-06-08 12:52:10.591171591 +0000 UTC m=+45.935595871" Jun 08 12:52:10.622453 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.622379 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-fntcz" podStartSLOduration=32.914707533 podStartE2EDuration="41.622344015s" totalImagesPullingTime="8.707636482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.620134814 +0000 UTC m=+45.964559095" watchObservedRunningTime="2026-06-08 12:52:10.622344015 +0000 UTC m=+45.966768298" Jun 08 12:52:10.761460 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:10.761420 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:11.020760 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.020716 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:11.264160 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.264121 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:11.440099 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.440059 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:11.448009 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.447970 2568 generic.go:356] "Generic (PLEG): container finished" podID="da71e307-3542-4bcd-93b3-f641c706ea2e" containerID="89b29d7915e9d2fcc217565b933214fc1d772c8e4247574059f603763bb93169" exitCode=0 Jun 08 12:52:11.448203 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.448061 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerDied","Data":"89b29d7915e9d2fcc217565b933214fc1d772c8e4247574059f603763bb93169"} Jun 08 12:52:11.449758 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.449741 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 12:52:11.450328 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.450308 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/0.log" Jun 08 12:52:11.450403 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.450353 2568 generic.go:356] "Generic (PLEG): container finished" podID="10392597-91ed-4619-ac9c-4d5555902c36" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" exitCode=255 Jun 08 12:52:11.450490 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.450462 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" event={"ID":"10392597-91ed-4619-ac9c-4d5555902c36","Type":"ContainerDied","Data":"6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d"} Jun 08 12:52:11.450571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.450550 2568 scope.go:117] "RemoveContainer" containerID="270e8e1af52980eca6de2916de57488cf767f599e9c1c7cbaaa762a05ec55db3" Jun 08 12:52:11.450718 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.450699 2568 scope.go:117] "RemoveContainer" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" Jun 08 12:52:11.450899 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:11.450873 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cgrsh_openshift-console-operator(10392597-91ed-4619-ac9c-4d5555902c36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" podUID="10392597-91ed-4619-ac9c-4d5555902c36" Jun 08 12:52:11.477728 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.477671 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" podStartSLOduration=29.774260384 podStartE2EDuration="38.477654746s" totalImagesPullingTime="8.703394362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.655638187 +0000 UTC m=+46.000062468" watchObservedRunningTime="2026-06-08 12:52:11.477654746 +0000 UTC m=+46.822079107" Jun 08 12:52:11.570571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.570543 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:11.661923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:11.661892 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:12.456197 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.456162 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58wd4" event={"ID":"da71e307-3542-4bcd-93b3-f641c706ea2e","Type":"ContainerStarted","Data":"0bc22e85e1035ba8e3e27c3950cabe029839776343473f7a409ed0d2bf423801"} Jun 08 12:52:12.457580 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.457563 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 12:52:12.457830 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.457817 2568 scope.go:117] "RemoveContainer" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" Jun 08 12:52:12.457970 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:12.457952 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cgrsh_openshift-console-operator(10392597-91ed-4619-ac9c-4d5555902c36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" podUID="10392597-91ed-4619-ac9c-4d5555902c36" Jun 08 12:52:12.480214 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.480166 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-58wd4" podStartSLOduration=9.726588765 podStartE2EDuration="47.480153921s" totalImagesPullingTime="37.753565156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:12.478539011 +0000 UTC m=+47.822963285" watchObservedRunningTime="2026-06-08 12:52:12.480153921 +0000 UTC m=+47.824578213" Jun 08 12:52:12.612910 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.612859 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:12.687489 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.687456 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:12.756717 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:12.756634 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:13.236216 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:13.236180 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:13.304698 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:13.304667 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:13.474798 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:13.474766 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:13.575310 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:13.575223 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:14.065942 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:14.065910 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:14.360185 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:14.360113 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5w26_3f8b65ce-138b-4fe3-a710-3d242bab1f6d/dns-node-resolver/0.log" Jun 08 12:52:15.159357 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.159334 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmlr5_90f9710c-0c45-40de-bdee-000cee2b3227/node-ca/0.log" Jun 08 12:52:15.903814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.903776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:15.903814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.903817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.903859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.903878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.903917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.903926 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.903952 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5758f66ddd-dfrdq: secret "image-registry-tls" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.903999 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904029 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904037 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls podName:f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd nodeName:}" failed. No retries permitted until 2026-06-08 12:52:31.904018102 +0000 UTC m=+67.248442377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls") pod "image-registry-5758f66ddd-dfrdq" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd") : secret "image-registry-tls" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904007 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 12:52:15.904049 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904053 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:31.904047076 +0000 UTC m=+67.248471334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : configmap references non-existent config key: service-ca.crt Jun 08 12:52:15.904380 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904065 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls podName:2ab00a37-8256-4ad0-8686-972333016c60 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:31.904059635 +0000 UTC m=+67.248483893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xmt9q" (UID: "2ab00a37-8256-4ad0-8686-972333016c60") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:52:15.904380 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904075 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls podName:87edf8bf-09a5-4154-8437-71cca82b574f nodeName:}" failed. No retries permitted until 2026-06-08 12:52:31.904069852 +0000 UTC m=+67.248494110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-tg92g" (UID: "87edf8bf-09a5-4154-8437-71cca82b574f") : secret "samples-operator-tls" not found Jun 08 12:52:15.904380 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:15.904089 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs podName:7004f5a9-acc6-43bc-9505-a953c3bd6c86 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:31.904081254 +0000 UTC m=+67.248505514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs") pod "router-default-65f9c7f667-7skqb" (UID: "7004f5a9-acc6-43bc-9505-a953c3bd6c86") : secret "router-metrics-certs-default" not found Jun 08 12:52:15.934073 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.934042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:15.960929 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:15.960900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f7k7g_746735bf-77a6-493d-91dd-f005ff0c0304/serve-healthcheck-canary/0.log" Jun 08 12:52:16.004665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:16.004631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:16.004803 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:16.004782 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:16.004872 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:16.004862 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls podName:80ae8e68-b603-4149-98b9-fad5280ec13d nodeName:}" failed. No retries permitted until 2026-06-08 12:52:32.004848542 +0000 UTC m=+67.349272805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls") pod "dns-default-skpfx" (UID: "80ae8e68-b603-4149-98b9-fad5280ec13d") : secret "dns-default-metrics-tls" not found Jun 08 12:52:16.761902 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:16.761829 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fh45d_17ea67fe-ed7e-4d33-af00-94a0af9122d9/kube-storage-version-migrator-operator/0.log" Jun 08 12:52:17.112969 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.112875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:17.113231 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:17.113046 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:52:17.113231 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:17.113127 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert podName:2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:33.113105534 +0000 UTC m=+68.457529792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jxjxq" (UID: "2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0") : secret "networking-console-plugin-cert" not found Jun 08 12:52:17.189134 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.189096 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:17.429374 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.429336 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:17.529482 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.529427 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:17.630910 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.630866 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:17.717580 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.717475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:17.883861 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:17.883832 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:19.057456 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:19.057421 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:19.263059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:19.263020 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:19.463508 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:19.463476 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:19.666142 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:19.666099 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:19.871736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:19.871644 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:20.312086 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.312055 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:20.312462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.312113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:20.312462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.312429 2568 scope.go:117] "RemoveContainer" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" Jun 08 12:52:20.312618 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:20.312598 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cgrsh_openshift-console-operator(10392597-91ed-4619-ac9c-4d5555902c36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" podUID="10392597-91ed-4619-ac9c-4d5555902c36" Jun 08 12:52:20.483924 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.483902 2568 scope.go:117] "RemoveContainer" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" Jun 08 12:52:20.484100 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:52:20.484079 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cgrsh_openshift-console-operator(10392597-91ed-4619-ac9c-4d5555902c36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" podUID="10392597-91ed-4619-ac9c-4d5555902c36" Jun 08 12:52:20.813915 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.813882 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:20.914476 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:20.914443 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:21.068656 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:21.068538 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:21.472892 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:21.472850 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:21.683042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:21.683010 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:21.764879 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:21.764788 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:22.281188 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:22.281155 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:22.731175 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:22.731141 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:22.946693 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:22.946661 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:23.032790 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:23.032703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:23.182827 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:23.182776 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:23.320828 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:23.320749 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:23.628473 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:23.628396 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:23.775437 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:23.775393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:24.277842 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:24.277808 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:24.490955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:24.490923 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:24.904669 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:24.904642 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:25.681844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:25.681784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:25.806400 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:25.806364 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:25.909420 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:25.909385 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:26.083432 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:26.083356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:26.368469 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:26.368397 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr46l" Jun 08 12:52:26.477997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:26.477961 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:27.111406 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:27.111370 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:27.471403 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:27.471375 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:27.713848 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:27.713819 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:27.905433 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:27.905356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:30.928496 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:30.928457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:52:30.935345 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:30.935323 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:52:30.943036 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:30.943014 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5-metrics-certs\") pod \"network-metrics-daemon-njs7d\" (UID: \"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5\") " pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:52:31.028963 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.028921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:52:31.028963 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.028970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:52:31.031390 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.031360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twg4m\" (UniqueName: \"kubernetes.io/projected/e6d52bab-af36-4c7c-98b3-ee323ee93ac0-kube-api-access-twg4m\") pod \"network-check-target-kj94g\" (UID: \"e6d52bab-af36-4c7c-98b3-ee323ee93ac0\") " pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:52:31.032845 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.032830 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:52:31.041718 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.041693 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c1dd8c-7311-4318-95c5-03dd64a347b6-original-pull-secret\") pod \"global-pull-secret-syncer-r5nlg\" (UID: \"e0c1dd8c-7311-4318-95c5-03dd64a347b6\") " pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:52:31.171104 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.171080 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzgqm\"" Jun 08 12:52:31.178938 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.178879 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njs7d" Jun 08 12:52:31.181608 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.181593 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4jlgv\"" Jun 08 12:52:31.185879 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.185862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5nlg" Jun 08 12:52:31.190043 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.190025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:52:31.337535 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.337498 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njs7d"] Jun 08 12:52:31.340507 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:31.340482 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ea51dd_f7f3_4e15_9c75_c348aed4c1b5.slice/crio-ad2ae27a8233d386372fc596647b4e523a31e231aa2efd0bf4c0d519b55ebee8 WatchSource:0}: Error finding container ad2ae27a8233d386372fc596647b4e523a31e231aa2efd0bf4c0d519b55ebee8: Status 404 returned error can't find the container with id ad2ae27a8233d386372fc596647b4e523a31e231aa2efd0bf4c0d519b55ebee8 Jun 08 12:52:31.516566 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.516483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njs7d" event={"ID":"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5","Type":"ContainerStarted","Data":"ad2ae27a8233d386372fc596647b4e523a31e231aa2efd0bf4c0d519b55ebee8"} Jun 08 12:52:31.552923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.552891 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kj94g"] Jun 08 12:52:31.557382 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.557343 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5nlg"] Jun 08 12:52:31.558742 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:31.558721 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d52bab_af36_4c7c_98b3_ee323ee93ac0.slice/crio-c4146f41aa4400371cca75c28f4e5ab5d0fbf1c4fedd752acc08b99036b59831 WatchSource:0}: Error finding container c4146f41aa4400371cca75c28f4e5ab5d0fbf1c4fedd752acc08b99036b59831: Status 404 returned error can't find the container with id c4146f41aa4400371cca75c28f4e5ab5d0fbf1c4fedd752acc08b99036b59831 Jun 08 12:52:31.559610 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:31.559579 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c1dd8c_7311_4318_95c5_03dd64a347b6.slice/crio-3f1719faccb19e272c947018681b6cef5f104baf1b31e4c8389e37f617d2e529 WatchSource:0}: Error finding container 3f1719faccb19e272c947018681b6cef5f104baf1b31e4c8389e37f617d2e529: Status 404 returned error can't find the container with id 3f1719faccb19e272c947018681b6cef5f104baf1b31e4c8389e37f617d2e529 Jun 08 12:52:31.937392 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.937358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:31.937896 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.937402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:31.937896 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.937449 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:31.937896 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.937467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:31.937896 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.937490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:31.938384 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.938356 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7004f5a9-acc6-43bc-9505-a953c3bd6c86-service-ca-bundle\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:31.940209 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.940184 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"image-registry-5758f66ddd-dfrdq\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:31.940306 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.940236 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab00a37-8256-4ad0-8686-972333016c60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xmt9q\" (UID: \"2ab00a37-8256-4ad0-8686-972333016c60\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:31.940306 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.940250 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87edf8bf-09a5-4154-8437-71cca82b574f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-tg92g\" (UID: \"87edf8bf-09a5-4154-8437-71cca82b574f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:31.940306 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:31.940255 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7004f5a9-acc6-43bc-9505-a953c3bd6c86-metrics-certs\") pod \"router-default-65f9c7f667-7skqb\" (UID: \"7004f5a9-acc6-43bc-9505-a953c3bd6c86\") " pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:32.038688 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.038655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:32.041116 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.041089 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80ae8e68-b603-4149-98b9-fad5280ec13d-metrics-tls\") pod \"dns-default-skpfx\" (UID: \"80ae8e68-b603-4149-98b9-fad5280ec13d\") " pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:32.126117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.126085 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9q2vt\"" Jun 08 12:52:32.134002 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.133964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" Jun 08 12:52:32.139726 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.139697 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x4rv6\"" Jun 08 12:52:32.146494 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.146467 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" Jun 08 12:52:32.169601 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.169574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mgwdp\"" Jun 08 12:52:32.174614 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.174586 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:32.181352 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.181322 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-znv4n\"" Jun 08 12:52:32.189554 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.189406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:32.235207 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.231124 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vjkf\"" Jun 08 12:52:32.239548 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.236567 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:32.387809 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.387705 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g"] Jun 08 12:52:32.405239 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.405193 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q"] Jun 08 12:52:32.425951 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:32.425880 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab00a37_8256_4ad0_8686_972333016c60.slice/crio-85bd50c5c4dc06c84a85b79ad4349cf93d3d87d598a5241bfe678b750b39c579 WatchSource:0}: Error finding container 85bd50c5c4dc06c84a85b79ad4349cf93d3d87d598a5241bfe678b750b39c579: Status 404 returned error can't find the container with id 85bd50c5c4dc06c84a85b79ad4349cf93d3d87d598a5241bfe678b750b39c579 Jun 08 12:52:32.432124 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.432009 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65f9c7f667-7skqb"] Jun 08 12:52:32.440352 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:32.440258 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7004f5a9_acc6_43bc_9505_a953c3bd6c86.slice/crio-2736c1ed94c79f80f386b03d9e2db5a3754211a85ec47a1b4747242598e9520b WatchSource:0}: Error finding container 2736c1ed94c79f80f386b03d9e2db5a3754211a85ec47a1b4747242598e9520b: Status 404 returned error can't find the container with id 2736c1ed94c79f80f386b03d9e2db5a3754211a85ec47a1b4747242598e9520b Jun 08 12:52:32.464964 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.464100 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skpfx"] Jun 08 12:52:32.467936 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:32.467878 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ae8e68_b603_4149_98b9_fad5280ec13d.slice/crio-ceb44ae91d6113b1b7056be184a593c53f62774d0385bd4c71a461a8868ae309 WatchSource:0}: Error finding container ceb44ae91d6113b1b7056be184a593c53f62774d0385bd4c71a461a8868ae309: Status 404 returned error can't find the container with id ceb44ae91d6113b1b7056be184a593c53f62774d0385bd4c71a461a8868ae309 Jun 08 12:52:32.493454 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.493375 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:52:32.499830 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:32.499799 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b3cd1f_1e5d_41fc_b821_c7ab87b9c5dd.slice/crio-66af5c8a19341d2ad13bd43187d6f7cdc019ddfe17f232c6aef675e043a79d4f WatchSource:0}: Error finding container 66af5c8a19341d2ad13bd43187d6f7cdc019ddfe17f232c6aef675e043a79d4f: Status 404 returned error can't find the container with id 66af5c8a19341d2ad13bd43187d6f7cdc019ddfe17f232c6aef675e043a79d4f Jun 08 12:52:32.526748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.526246 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" event={"ID":"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd","Type":"ContainerStarted","Data":"66af5c8a19341d2ad13bd43187d6f7cdc019ddfe17f232c6aef675e043a79d4f"} Jun 08 12:52:32.528386 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.528299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" event={"ID":"2ab00a37-8256-4ad0-8686-972333016c60","Type":"ContainerStarted","Data":"85bd50c5c4dc06c84a85b79ad4349cf93d3d87d598a5241bfe678b750b39c579"} Jun 08 12:52:32.530040 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.530002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" event={"ID":"87edf8bf-09a5-4154-8437-71cca82b574f","Type":"ContainerStarted","Data":"4d5ae82b64859c1f5b22e1fa9907f6aab1b45aa8624f7400769126ac377a33b8"} Jun 08 12:52:32.533456 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.532877 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kj94g" event={"ID":"e6d52bab-af36-4c7c-98b3-ee323ee93ac0","Type":"ContainerStarted","Data":"7f3133ceea3a73718e61f5fa2f5d84a35aae6e5c135d2be2ec33d1a2a28973d2"} Jun 08 12:52:32.533456 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.532932 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kj94g" event={"ID":"e6d52bab-af36-4c7c-98b3-ee323ee93ac0","Type":"ContainerStarted","Data":"c4146f41aa4400371cca75c28f4e5ab5d0fbf1c4fedd752acc08b99036b59831"} Jun 08 12:52:32.533456 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.533388 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:52:32.535427 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.535271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5nlg" event={"ID":"e0c1dd8c-7311-4318-95c5-03dd64a347b6","Type":"ContainerStarted","Data":"3f1719faccb19e272c947018681b6cef5f104baf1b31e4c8389e37f617d2e529"} Jun 08 12:52:32.539052 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.539024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njs7d" event={"ID":"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5","Type":"ContainerStarted","Data":"ccb1960a7e98790936e4476763e5335e7d8dce761bbb54846e4179da33dd1bbc"} Jun 08 12:52:32.540791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.540766 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skpfx" event={"ID":"80ae8e68-b603-4149-98b9-fad5280ec13d","Type":"ContainerStarted","Data":"ceb44ae91d6113b1b7056be184a593c53f62774d0385bd4c71a461a8868ae309"} Jun 08 12:52:32.546113 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.545859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65f9c7f667-7skqb" event={"ID":"7004f5a9-acc6-43bc-9505-a953c3bd6c86","Type":"ContainerStarted","Data":"be68bfd9c5ac1848c788f72e1246ea15f189d61d3e9ffca3d0807bc23f3d7bec"} Jun 08 12:52:32.546113 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.545904 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65f9c7f667-7skqb" event={"ID":"7004f5a9-acc6-43bc-9505-a953c3bd6c86","Type":"ContainerStarted","Data":"2736c1ed94c79f80f386b03d9e2db5a3754211a85ec47a1b4747242598e9520b"} Jun 08 12:52:32.602354 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.602010 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65f9c7f667-7skqb" podStartSLOduration=63.601987063 podStartE2EDuration="1m3.601987063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:32.600461699 +0000 UTC m=+67.944885980" watchObservedRunningTime="2026-06-08 12:52:32.601987063 +0000 UTC m=+67.946411346" Jun 08 12:52:32.602581 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:32.602357 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kj94g" podStartSLOduration=67.602348991 podStartE2EDuration="1m7.602348991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:32.574096619 +0000 UTC m=+67.918520901" watchObservedRunningTime="2026-06-08 12:52:32.602348991 +0000 UTC m=+67.946773270" Jun 08 12:52:33.149932 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.149670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:33.157119 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.157055 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jxjxq\" (UID: \"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:33.175483 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.175458 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:33.178633 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.178429 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:33.407952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.407734 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zpclm\"" Jun 08 12:52:33.415878 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.415834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" Jun 08 12:52:33.556576 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.555804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" event={"ID":"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd","Type":"ContainerStarted","Data":"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e"} Jun 08 12:52:33.556576 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.556552 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:33.559588 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.559207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njs7d" event={"ID":"c2ea51dd-f7f3-4e15-9c75-c348aed4c1b5","Type":"ContainerStarted","Data":"8a03960e0762ec94bdeb5d63aa7abc115078f29bd21e56d8f6e6aad660012e03"} Jun 08 12:52:33.559717 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.559589 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:33.561552 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.561500 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65f9c7f667-7skqb" Jun 08 12:52:33.582230 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.582180 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" podStartSLOduration=68.582161019 podStartE2EDuration="1m8.582161019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:33.580022375 +0000 UTC m=+68.924446669" watchObservedRunningTime="2026-06-08 12:52:33.582161019 +0000 UTC m=+68.926585283" Jun 08 12:52:33.597320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.596728 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq"] Jun 08 12:52:33.600928 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:33.600900 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd4590d_4bcf_4b29_bf2f_010b7e78e5f0.slice/crio-b9d6329d696e0b7fe4a4047a9294de3ab301825714acb90505401a6f4b96ff87 WatchSource:0}: Error finding container b9d6329d696e0b7fe4a4047a9294de3ab301825714acb90505401a6f4b96ff87: Status 404 returned error can't find the container with id b9d6329d696e0b7fe4a4047a9294de3ab301825714acb90505401a6f4b96ff87 Jun 08 12:52:33.624649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:33.623543 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-njs7d" podStartSLOduration=67.72163972 podStartE2EDuration="1m8.623505542s" totalImagesPullingTime="901.865822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:33.622764861 +0000 UTC m=+68.967189143" watchObservedRunningTime="2026-06-08 12:52:33.623505542 +0000 UTC m=+68.967929823" Jun 08 12:52:34.570325 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.570206 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" event={"ID":"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0","Type":"ContainerStarted","Data":"b9d6329d696e0b7fe4a4047a9294de3ab301825714acb90505401a6f4b96ff87"} Jun 08 12:52:34.765709 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.765671 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-88fhm"] Jun 08 12:52:34.772405 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.772290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.783311 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.783287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:52:34.784503 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.784482 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:52:34.784644 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.784604 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9trt4\"" Jun 08 12:52:34.796375 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.796350 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88fhm"] Jun 08 12:52:34.823742 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.823669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:34.864082 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.864054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc566fb5-630f-42c7-98af-cfbde54e703f-crio-socket\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.864243 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.864095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc566fb5-630f-42c7-98af-cfbde54e703f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.864243 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.864124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5lf\" (UniqueName: \"kubernetes.io/projected/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-api-access-vh5lf\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.864353 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.864232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.864353 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.864294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc566fb5-630f-42c7-98af-cfbde54e703f-data-volume\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.965756 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.965717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc566fb5-630f-42c7-98af-cfbde54e703f-crio-socket\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.965929 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.965773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc566fb5-630f-42c7-98af-cfbde54e703f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.965929 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.965872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc566fb5-630f-42c7-98af-cfbde54e703f-crio-socket\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.965929 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.965905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5lf\" (UniqueName: \"kubernetes.io/projected/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-api-access-vh5lf\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.966094 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.966066 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.966150 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.966126 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc566fb5-630f-42c7-98af-cfbde54e703f-data-volume\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.966504 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.966480 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc566fb5-630f-42c7-98af-cfbde54e703f-data-volume\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.966663 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.966646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.968539 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.968470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc566fb5-630f-42c7-98af-cfbde54e703f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.979356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.979331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5lf\" (UniqueName: \"kubernetes.io/projected/fc566fb5-630f-42c7-98af-cfbde54e703f-kube-api-access-vh5lf\") pod \"insights-runtime-extractor-88fhm\" (UID: \"fc566fb5-630f-42c7-98af-cfbde54e703f\") " pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:34.988103 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:34.988076 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:35.085007 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:35.084925 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88fhm" Jun 08 12:52:35.103382 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:35.103287 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:35.148233 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:35.148202 2568 scope.go:117] "RemoveContainer" containerID="6b53751e3588473b308fc1720173a0afda5858b95f0ba22ec97bfc05440ca62d" Jun 08 12:52:35.204271 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:35.204233 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:36.333911 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:36.333875 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:36.434082 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:36.434038 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:36.982717 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:36.982681 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88fhm"] Jun 08 12:52:37.201923 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:37.201891 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc566fb5_630f_42c7_98af_cfbde54e703f.slice/crio-a870a051f4b2b71bfeb43db1e5ae7ee65de2bccb0dacc0768f5b22f886f565d5 WatchSource:0}: Error finding container a870a051f4b2b71bfeb43db1e5ae7ee65de2bccb0dacc0768f5b22f886f565d5: Status 404 returned error can't find the container with id a870a051f4b2b71bfeb43db1e5ae7ee65de2bccb0dacc0768f5b22f886f565d5 Jun 08 12:52:37.230915 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.230884 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.332165 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.332134 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.583676 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.583637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skpfx" event={"ID":"80ae8e68-b603-4149-98b9-fad5280ec13d","Type":"ContainerStarted","Data":"4a07e502d831b657ebff5981ffd098ff8d9881dd731e317070121fcb201e552b"} Jun 08 12:52:37.584029 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.583704 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skpfx" event={"ID":"80ae8e68-b603-4149-98b9-fad5280ec13d","Type":"ContainerStarted","Data":"091a94dad9e22b5ec1bbbe90d3d13595bd110443e68e9b3b833615e3e35c9747"} Jun 08 12:52:37.584512 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.584492 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:37.586179 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.586145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" event={"ID":"2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0","Type":"ContainerStarted","Data":"3ef330ddac3a3ea32555c1df14d611d42d47dcf41575dc376bfbf9bdb0cde837"} Jun 08 12:52:37.589876 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.589856 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 12:52:37.589968 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.589931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" event={"ID":"10392597-91ed-4619-ac9c-4d5555902c36","Type":"ContainerStarted","Data":"6d47e00d49c14eebf70bd08775958a7c24dfa7f145ff7ac662ab9b8739bd0356"} Jun 08 12:52:37.590667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.590650 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:37.592180 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.592154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" event={"ID":"2ab00a37-8256-4ad0-8686-972333016c60","Type":"ContainerStarted","Data":"b2ca2f5d8d31a6648cf1be5d1dc3896900a505f1483de9dea060c339e42dc0a7"} Jun 08 12:52:37.594601 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.594576 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" event={"ID":"87edf8bf-09a5-4154-8437-71cca82b574f","Type":"ContainerStarted","Data":"3d3246c41892cefe867b00e6664cf9162c78b08dc3745bf10204f7e61bc310a4"} Jun 08 12:52:37.594704 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.594626 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" event={"ID":"87edf8bf-09a5-4154-8437-71cca82b574f","Type":"ContainerStarted","Data":"fd4cc4f3f73570761c3b6604cdba51a125bc29030e8898baddd149f89e9928fb"} Jun 08 12:52:37.597779 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.597417 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5nlg" event={"ID":"e0c1dd8c-7311-4318-95c5-03dd64a347b6","Type":"ContainerStarted","Data":"48d238b59783b7fb99f85cf5caceb7b3f6cc784da915b9842fbbd2e92bc1ec33"} Jun 08 12:52:37.599054 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.599019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88fhm" event={"ID":"fc566fb5-630f-42c7-98af-cfbde54e703f","Type":"ContainerStarted","Data":"7d63677aabe97750302260146b7f84f0b8480c910dcfca6d1bd965241d66cc0a"} Jun 08 12:52:37.599126 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.599075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88fhm" event={"ID":"fc566fb5-630f-42c7-98af-cfbde54e703f","Type":"ContainerStarted","Data":"a870a051f4b2b71bfeb43db1e5ae7ee65de2bccb0dacc0768f5b22f886f565d5"} Jun 08 12:52:37.602241 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.602196 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-skpfx" podStartSLOduration=34.241393195 podStartE2EDuration="38.60218087s" totalImagesPullingTime="4.360787675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.602025587 +0000 UTC m=+72.946449905" watchObservedRunningTime="2026-06-08 12:52:37.60218087 +0000 UTC m=+72.946605149" Jun 08 12:52:37.609826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.609785 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.622421 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.622051 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r5nlg" podStartSLOduration=66.959012008 podStartE2EDuration="1m12.621997534s" totalImagesPullingTime="5.662985526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.621424887 +0000 UTC m=+72.965849168" watchObservedRunningTime="2026-06-08 12:52:37.621997534 +0000 UTC m=+72.966421814" Jun 08 12:52:37.641193 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.641155 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" podStartSLOduration=59.800672291 podStartE2EDuration="1m8.641145938s" totalImagesPullingTime="8.840473647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.640269183 +0000 UTC m=+72.984693463" watchObservedRunningTime="2026-06-08 12:52:37.641145938 +0000 UTC m=+72.985570438" Jun 08 12:52:37.659391 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.659355 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xmt9q" podStartSLOduration=64.248450937 podStartE2EDuration="1m8.659342472s" totalImagesPullingTime="4.410891535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.658354387 +0000 UTC m=+73.002778668" watchObservedRunningTime="2026-06-08 12:52:37.659342472 +0000 UTC m=+73.003766787" Jun 08 12:52:37.691192 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.691170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.697984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.697942 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jxjxq" podStartSLOduration=33.028881316 podStartE2EDuration="36.697924378s" totalImagesPullingTime="3.669043062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.679155326 +0000 UTC m=+73.023579607" watchObservedRunningTime="2026-06-08 12:52:37.697924378 +0000 UTC m=+73.042348658" Jun 08 12:52:37.698461 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.698395 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-tg92g" podStartSLOduration=64.30893248 podStartE2EDuration="1m8.698385734s" totalImagesPullingTime="4.389453254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:37.696315948 +0000 UTC m=+73.040740229" watchObservedRunningTime="2026-06-08 12:52:37.698385734 +0000 UTC m=+73.042810016" Jun 08 12:52:37.799632 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.799547 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.803174 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.803141 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294"] Jun 08 12:52:37.809241 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.809220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:37.812359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.812334 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 12:52:37.812480 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.812336 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fg4tj\"" Jun 08 12:52:37.821187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.821161 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294"] Jun 08 12:52:37.895455 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.895426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7357f39f-d7ca-425e-85dc-302447abd1f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-nk294\" (UID: \"7357f39f-d7ca-425e-85dc-302447abd1f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:37.905059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.905033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.967904 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.967860 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:37.996826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.996801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7357f39f-d7ca-425e-85dc-302447abd1f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-nk294\" (UID: \"7357f39f-d7ca-425e-85dc-302447abd1f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:37.999079 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:37.999056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7357f39f-d7ca-425e-85dc-302447abd1f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-nk294\" (UID: \"7357f39f-d7ca-425e-85dc-302447abd1f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:38.040865 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.040841 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-cgrsh" Jun 08 12:52:38.122470 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.122392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:38.224780 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.224753 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-f8478"] Jun 08 12:52:38.242034 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.242000 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:38.259169 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.259139 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-f8478"] Jun 08 12:52:38.259309 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.259235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:38.261737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.261717 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-95654\"" Jun 08 12:52:38.261857 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.261757 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 12:52:38.261857 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.261798 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 12:52:38.346451 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.346423 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:38.400560 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.400534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndcs\" (UniqueName: \"kubernetes.io/projected/9009226e-8a2d-4553-8f7d-011ffeb385d6-kube-api-access-6ndcs\") pod \"downloads-6657875f97-f8478\" (UID: \"9009226e-8a2d-4553-8f7d-011ffeb385d6\") " pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:38.410343 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.410313 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294"] Jun 08 12:52:38.413906 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:38.413886 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7357f39f_d7ca_425e_85dc_302447abd1f1.slice/crio-ad2be3628144505b0dbedb18173385b85a38e4f9ea380b050d84e697a1e56d1e WatchSource:0}: Error finding container ad2be3628144505b0dbedb18173385b85a38e4f9ea380b050d84e697a1e56d1e: Status 404 returned error can't find the container with id ad2be3628144505b0dbedb18173385b85a38e4f9ea380b050d84e697a1e56d1e Jun 08 12:52:38.417044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.417017 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:38.501617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.501583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndcs\" (UniqueName: \"kubernetes.io/projected/9009226e-8a2d-4553-8f7d-011ffeb385d6-kube-api-access-6ndcs\") pod \"downloads-6657875f97-f8478\" (UID: \"9009226e-8a2d-4553-8f7d-011ffeb385d6\") " pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:38.510797 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.510779 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndcs\" (UniqueName: \"kubernetes.io/projected/9009226e-8a2d-4553-8f7d-011ffeb385d6-kube-api-access-6ndcs\") pod \"downloads-6657875f97-f8478\" (UID: \"9009226e-8a2d-4553-8f7d-011ffeb385d6\") " pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:38.566397 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.566367 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:38.569110 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.569094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:38.604844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.604818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88fhm" event={"ID":"fc566fb5-630f-42c7-98af-cfbde54e703f","Type":"ContainerStarted","Data":"2476e1209e1b758f6fee0376165cfee6bfe1a0dd24857e704b56d97fa94a3760"} Jun 08 12:52:38.606040 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.606020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" event={"ID":"7357f39f-d7ca-425e-85dc-302447abd1f1","Type":"ContainerStarted","Data":"ad2be3628144505b0dbedb18173385b85a38e4f9ea380b050d84e697a1e56d1e"} Jun 08 12:52:38.720103 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.720081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-f8478"] Jun 08 12:52:38.722455 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:38.722430 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9009226e_8a2d_4553_8f7d_011ffeb385d6.slice/crio-850fb10ed7c9cc145794ea38985a978486fc9d3b6be59b900dd07dcdd37dfe21 WatchSource:0}: Error finding container 850fb10ed7c9cc145794ea38985a978486fc9d3b6be59b900dd07dcdd37dfe21: Status 404 returned error can't find the container with id 850fb10ed7c9cc145794ea38985a978486fc9d3b6be59b900dd07dcdd37dfe21 Jun 08 12:52:38.928294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:38.928242 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:39.027912 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.027869 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:39.131493 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.131455 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:39.227751 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.227638 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:39.328843 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.328754 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:39.612085 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.611953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-f8478" event={"ID":"9009226e-8a2d-4553-8f7d-011ffeb385d6","Type":"ContainerStarted","Data":"850fb10ed7c9cc145794ea38985a978486fc9d3b6be59b900dd07dcdd37dfe21"} Jun 08 12:52:39.930637 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:39.930601 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:40.038917 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:40.038872 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:40.155977 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:40.155817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:40.360465 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:40.360395 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:40.789846 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:40.789812 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:40.893500 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:40.893466 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:41.623126 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.623087 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" event={"ID":"7357f39f-d7ca-425e-85dc-302447abd1f1","Type":"ContainerStarted","Data":"1685ce4259ecb481742d1ffb89614accbfd4930ed39554471ec7d26e2337cc7a"} Jun 08 12:52:41.623323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.623267 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:41.625814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.625781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88fhm" event={"ID":"fc566fb5-630f-42c7-98af-cfbde54e703f","Type":"ContainerStarted","Data":"8b9363fd659225145de42b13853cbd4623e82903c660ac8033ef0c5de8f47ea0"} Jun 08 12:52:41.629043 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.629019 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" Jun 08 12:52:41.640982 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.640918 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-nk294" podStartSLOduration=2.344433939 podStartE2EDuration="4.640897526s" totalImagesPullingTime="2.296463587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:41.639214188 +0000 UTC m=+76.983638468" watchObservedRunningTime="2026-06-08 12:52:41.640897526 +0000 UTC m=+76.985321825" Jun 08 12:52:41.681059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.680997 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-88fhm" podStartSLOduration=4.35264967 podStartE2EDuration="7.680972652s" totalImagesPullingTime="3.328322982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:52:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:41.679227997 +0000 UTC m=+77.023652280" watchObservedRunningTime="2026-06-08 12:52:41.680972652 +0000 UTC m=+77.025396926" Jun 08 12:52:41.844170 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.844129 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:41.921719 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:41.921683 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:42.003986 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:42.003940 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:43.397946 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:43.397908 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:43.504883 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:43.504831 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:43.896148 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:43.896108 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:44.559095 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:44.558958 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:44.660481 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:44.660361 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:45.014813 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:45.014777 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:45.143712 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:45.143665 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:45.245050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:45.245013 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.018157 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.018118 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.205123 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.205090 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.406298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.406260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.483435 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.483398 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8qkws"] Jun 08 12:52:46.487819 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.487797 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.493799 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.492291 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:52:46.493799 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.492595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:52:46.493799 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.492626 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:52:46.498088 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.498065 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:52:46.505859 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.505839 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mpbnz\"" Jun 08 12:52:46.592359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.592319 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.667321 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-tls\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667321 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-sys\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667321 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-metrics-client-ca\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-root\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-wtmp\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-textfile\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667477 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.667619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.667594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdks\" (UniqueName: \"kubernetes.io/projected/33821acd-699b-4432-afd3-548b4fc362c5-kube-api-access-cwdks\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.701458 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.701422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.768407 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdks\" (UniqueName: \"kubernetes.io/projected/33821acd-699b-4432-afd3-548b4fc362c5-kube-api-access-cwdks\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-tls\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-sys\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-metrics-client-ca\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-root\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-wtmp\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.768826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.768753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-textfile\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769139 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-sys\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769139 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769085 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-root\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769139 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769078 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-textfile\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769187 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-wtmp\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769193 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.769390 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.769361 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33821acd-699b-4432-afd3-548b4fc362c5-metrics-client-ca\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.771141 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.771118 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-tls\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.771326 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.771302 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33821acd-699b-4432-afd3-548b4fc362c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.785779 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.785742 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdks\" (UniqueName: \"kubernetes.io/projected/33821acd-699b-4432-afd3-548b4fc362c5-kube-api-access-cwdks\") pod \"node-exporter-8qkws\" (UID: \"33821acd-699b-4432-afd3-548b4fc362c5\") " pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.799146 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.799085 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:46.804584 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.804558 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qkws" Jun 08 12:52:46.817129 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:46.817082 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33821acd_699b_4432_afd3_548b4fc362c5.slice/crio-cfbeb2f0b84b2b8b4a202b6b354917677216f600a45f51a639dc87cc48e7cb23 WatchSource:0}: Error finding container cfbeb2f0b84b2b8b4a202b6b354917677216f600a45f51a639dc87cc48e7cb23: Status 404 returned error can't find the container with id cfbeb2f0b84b2b8b4a202b6b354917677216f600a45f51a639dc87cc48e7cb23 Jun 08 12:52:46.953892 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:46.953793 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:47.104141 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.104094 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:47.286167 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.286055 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:52:47.289551 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.289503 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.292595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.292568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 12:52:47.292595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.292581 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 12:52:47.292786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.292641 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 12:52:47.293047 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.293029 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 12:52:47.293552 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.293482 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 12:52:47.293652 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.293642 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2sdql\"" Jun 08 12:52:47.321736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.321702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:52:47.341182 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.341144 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:47.375643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.375817 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.375817 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.375817 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.375817 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq2gb\" (UniqueName: \"kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.376052 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.375835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477239 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq2gb\" (UniqueName: \"kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.477495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.477464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.478614 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.478236 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.478761 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.478625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.479088 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.479064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.480990 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.480963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.481424 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.481382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.507625 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.507587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq2gb\" (UniqueName: \"kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb\") pod \"console-66f967b45c-hvgj7\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.601620 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.601531 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:52:47.604058 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.604026 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:47.657898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.657821 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qkws" event={"ID":"33821acd-699b-4432-afd3-548b4fc362c5","Type":"ContainerStarted","Data":"cfbeb2f0b84b2b8b4a202b6b354917677216f600a45f51a639dc87cc48e7cb23"} Jun 08 12:52:47.777738 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.777701 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:47.803763 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.803600 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:52:47.807933 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.807834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.813366 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.812886 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:52:47.813366 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.813157 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:52:47.813586 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.813374 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:52:47.814335 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.814231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jwmh6\"" Jun 08 12:52:47.816567 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.815146 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:52:47.816567 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.815387 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:52:47.816567 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.815614 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:52:47.816567 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.815874 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:52:47.816829 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.816573 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:52:47.818441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.818409 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:52:47.846288 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.846149 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:52:47.942339 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.942246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:52:47.948146 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:47.947293 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b84fc6_276b_4612_a220_fe765e030ed5.slice/crio-4ea232318e94f167221da06cddd8d8ca0fbeb17daae6cf6c0d0b93b40996b341 WatchSource:0}: Error finding container 4ea232318e94f167221da06cddd8d8ca0fbeb17daae6cf6c0d0b93b40996b341: Status 404 returned error can't find the container with id 4ea232318e94f167221da06cddd8d8ca0fbeb17daae6cf6c0d0b93b40996b341 Jun 08 12:52:47.982212 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982178 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982212 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982367 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982468 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7g2\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:47.982887 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:47.982763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083210 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7g2\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083402 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083491 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.083736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.083616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.087338 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.084952 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.087338 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.085071 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.087338 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.085285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.089840 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.089715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.090225 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.090200 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.090666 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.090646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.098665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.098609 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.098813 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.098679 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.098813 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.098714 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.099325 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.099297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.100926 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.100832 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.100926 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.100900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7g2\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.101165 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.101124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.118831 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.118729 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:48.126065 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.126038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:52:48.353660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.353581 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:52:48.358926 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:48.358897 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06e3759_b7dc_4d69_8085_003633c3a845.slice/crio-a6e0685863c1eb121372d99a59dc62c36cd9e820b32caf952d07ec7effd697a5 WatchSource:0}: Error finding container a6e0685863c1eb121372d99a59dc62c36cd9e820b32caf952d07ec7effd697a5: Status 404 returned error can't find the container with id a6e0685863c1eb121372d99a59dc62c36cd9e820b32caf952d07ec7effd697a5 Jun 08 12:52:48.615041 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.614805 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-skpfx" Jun 08 12:52:48.664336 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.664294 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f967b45c-hvgj7" event={"ID":"c6b84fc6-276b-4612-a220-fe765e030ed5","Type":"ContainerStarted","Data":"4ea232318e94f167221da06cddd8d8ca0fbeb17daae6cf6c0d0b93b40996b341"} Jun 08 12:52:48.667249 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.666550 2568 generic.go:356] "Generic (PLEG): container finished" podID="33821acd-699b-4432-afd3-548b4fc362c5" containerID="afb5bd4e59f043614a8240eab011bcb598d50d45177e6026427d9b5804e7daa8" exitCode=0 Jun 08 12:52:48.667611 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.667459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qkws" event={"ID":"33821acd-699b-4432-afd3-548b4fc362c5","Type":"ContainerDied","Data":"afb5bd4e59f043614a8240eab011bcb598d50d45177e6026427d9b5804e7daa8"} Jun 08 12:52:48.672347 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:48.672152 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"a6e0685863c1eb121372d99a59dc62c36cd9e820b32caf952d07ec7effd697a5"} Jun 08 12:52:49.211119 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.210929 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:52:49.214697 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.214672 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.226414 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.226059 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 12:52:49.238677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.238636 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:52:49.288780 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.288727 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:49.396868 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.396828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.396877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlgr\" (UniqueName: \"kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.396927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.396963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.396987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397256 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.397082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.397256 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.397113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlgr\" (UniqueName: \"kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.498643 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.498599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.499434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.499374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.500582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.499955 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.500821 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.500797 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.509164 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.504930 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:49.510091 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.509758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.510356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.510331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.513466 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.513369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.517557 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.517237 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlgr\" (UniqueName: \"kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr\") pod \"console-579ccd7768-k6jc7\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.528008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.527954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:52:49.688046 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.688015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qkws" event={"ID":"33821acd-699b-4432-afd3-548b4fc362c5","Type":"ContainerStarted","Data":"114b2cdfb1041ca5e435e4275fb06ed13ff274be1da9aa50ee506c46bcc27327"} Jun 08 12:52:49.688167 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.688077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qkws" event={"ID":"33821acd-699b-4432-afd3-548b4fc362c5","Type":"ContainerStarted","Data":"53ebc849a22a225ee586f688c96a7dde39e040410c6a3ad2711294254917ba4d"} Jun 08 12:52:49.724735 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.724626 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8qkws" podStartSLOduration=2.665447019 podStartE2EDuration="3.724605107s" totalImagesPullingTime="976.547465ms" totalInitContainerRuntime="82.610623ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:49.723618469 +0000 UTC m=+85.068042750" watchObservedRunningTime="2026-06-08 12:52:49.724605107 +0000 UTC m=+85.069029400" Jun 08 12:52:49.728011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.727861 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:49.791355 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.791323 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:52:49.794059 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:49.794025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb72920_d080_4a9b_a7ef_2d26f6272760.slice/crio-da3dd4c5162b8616b356471e509b49a1e44e8413656cc184a69c867d91878932 WatchSource:0}: Error finding container da3dd4c5162b8616b356471e509b49a1e44e8413656cc184a69c867d91878932: Status 404 returned error can't find the container with id da3dd4c5162b8616b356471e509b49a1e44e8413656cc184a69c867d91878932 Jun 08 12:52:49.798656 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.798597 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:49.903680 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:49.903643 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:50.088092 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.087992 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:50.159594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.159548 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:50.456832 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.456711 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:50.699240 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.696169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579ccd7768-k6jc7" event={"ID":"beb72920-d080-4a9b-a7ef-2d26f6272760","Type":"ContainerStarted","Data":"da3dd4c5162b8616b356471e509b49a1e44e8413656cc184a69c867d91878932"} Jun 08 12:52:50.700949 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.700917 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651" exitCode=0 Jun 08 12:52:50.701107 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:50.701042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651"} Jun 08 12:52:51.145815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.145748 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:51.230703 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.230580 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:51.451270 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.451236 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:51.720365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.720271 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84968755c7-vtqs7"] Jun 08 12:52:51.724532 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.724486 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.727184 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727155 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 12:52:51.727334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727184 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 12:52:51.727334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727198 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 12:52:51.727449 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727384 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-72h69\"" Jun 08 12:52:51.727602 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727581 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 12:52:51.727701 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.727674 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 12:52:51.732510 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.732482 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 12:52:51.737984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.737955 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84968755c7-vtqs7"] Jun 08 12:52:51.823039 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.822998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823226 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823226 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823226 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-federate-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-metrics-client-ca\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823473 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rlpl\" (UniqueName: \"kubernetes.io/projected/aabeb1d9-8939-44d3-8cc0-f2394f863721-kube-api-access-9rlpl\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.823554 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.823492 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-serving-certs-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.924607 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.924794 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.924794 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.924794 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.924794 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-federate-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.925022 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924805 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-metrics-client-ca\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.925022 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rlpl\" (UniqueName: \"kubernetes.io/projected/aabeb1d9-8939-44d3-8cc0-f2394f863721-kube-api-access-9rlpl\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.925022 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.924877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-serving-certs-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.925726 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.925667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-serving-certs-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.925874 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.925837 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.926214 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.926192 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabeb1d9-8939-44d3-8cc0-f2394f863721-metrics-client-ca\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.927851 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.927805 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-telemeter-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.927960 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.927909 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.927960 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.927919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.928219 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.928200 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aabeb1d9-8939-44d3-8cc0-f2394f863721-federate-client-tls\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:51.934923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:51.934890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rlpl\" (UniqueName: \"kubernetes.io/projected/aabeb1d9-8939-44d3-8cc0-f2394f863721-kube-api-access-9rlpl\") pod \"telemeter-client-84968755c7-vtqs7\" (UID: \"aabeb1d9-8939-44d3-8cc0-f2394f863721\") " pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:52.036870 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:52.036784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" Jun 08 12:52:53.012229 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:53.012187 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:53.106477 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:53.106418 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:55.559992 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:55.559952 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:52:55.578320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:55.578287 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:52:55.932032 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:55.931983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:56.034708 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:56.034669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:57.271583 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.271535 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:52:57.351051 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.351013 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:57.408341 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.408302 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:57.745968 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.745915 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:57.875038 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.875002 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:57.964152 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:57.964110 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:58.065284 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:58.065197 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:52:59.172268 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.171715 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84968755c7-vtqs7"] Jun 08 12:52:59.176416 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:52:59.176380 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabeb1d9_8939_44d3_8cc0_f2394f863721.slice/crio-2a717133db9bb038433973c35c3515ac172602f7debf0cedc100baaaddb5da57 WatchSource:0}: Error finding container 2a717133db9bb038433973c35c3515ac172602f7debf0cedc100baaaddb5da57: Status 404 returned error can't find the container with id 2a717133db9bb038433973c35c3515ac172602f7debf0cedc100baaaddb5da57 Jun 08 12:52:59.744091 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.743983 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" event={"ID":"aabeb1d9-8939-44d3-8cc0-f2394f863721","Type":"ContainerStarted","Data":"2a717133db9bb038433973c35c3515ac172602f7debf0cedc100baaaddb5da57"} Jun 08 12:52:59.746471 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.746412 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-f8478" event={"ID":"9009226e-8a2d-4553-8f7d-011ffeb385d6","Type":"ContainerStarted","Data":"845c92be068ec59d93bfe68de7a019af40f9a9aa2d9bcd71a7e53c186f8159e0"} Jun 08 12:52:59.746935 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.746914 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:59.749121 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.749072 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579ccd7768-k6jc7" event={"ID":"beb72920-d080-4a9b-a7ef-2d26f6272760","Type":"ContainerStarted","Data":"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711"} Jun 08 12:52:59.750948 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.750917 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f967b45c-hvgj7" event={"ID":"c6b84fc6-276b-4612-a220-fe765e030ed5","Type":"ContainerStarted","Data":"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831"} Jun 08 12:52:59.762099 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.762044 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-f8478" Jun 08 12:52:59.802107 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.802046 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-f8478" podStartSLOduration=1.475242655 podStartE2EDuration="21.802022963s" totalImagesPullingTime="20.326780308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:59.771236796 +0000 UTC m=+95.115661078" watchObservedRunningTime="2026-06-08 12:52:59.802022963 +0000 UTC m=+95.146447244" Jun 08 12:52:59.853198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.851119 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f967b45c-hvgj7" podStartSLOduration=1.802287754 podStartE2EDuration="12.851099759s" totalImagesPullingTime="11.048812005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:59.851079947 +0000 UTC m=+95.195504228" watchObservedRunningTime="2026-06-08 12:52:59.851099759 +0000 UTC m=+95.195524038" Jun 08 12:52:59.853198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:52:59.851890 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-579ccd7768-k6jc7" podStartSLOduration=1.639744568 podStartE2EDuration="10.851873826s" totalImagesPullingTime="9.212129258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:59.827081906 +0000 UTC m=+95.171506186" watchObservedRunningTime="2026-06-08 12:52:59.851873826 +0000 UTC m=+95.196298108" Jun 08 12:53:01.766002 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:01.765422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9"} Jun 08 12:53:02.774615 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.774565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" event={"ID":"aabeb1d9-8939-44d3-8cc0-f2394f863721","Type":"ContainerStarted","Data":"6edaa299b59e93faece9af18f490d8cda9aad3350f631de234b9fb45f0632373"} Jun 08 12:53:02.775283 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.774655 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" event={"ID":"aabeb1d9-8939-44d3-8cc0-f2394f863721","Type":"ContainerStarted","Data":"8e6ec1151266ab529bff0e3da35e327e7dae1508d4b147e4ddb8f118c2109220"} Jun 08 12:53:02.775283 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.774757 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" event={"ID":"aabeb1d9-8939-44d3-8cc0-f2394f863721","Type":"ContainerStarted","Data":"5fb9f703ee1cb2a1d516bafe4015994e89d4daf24bf664767d0d260cac15fc69"} Jun 08 12:53:02.778535 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.778486 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f"} Jun 08 12:53:02.778670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.778574 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23"} Jun 08 12:53:02.778670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.778615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548"} Jun 08 12:53:02.778670 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.778649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb"} Jun 08 12:53:02.814572 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:02.814494 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84968755c7-vtqs7" podStartSLOduration=9.293483359 podStartE2EDuration="11.814462422s" totalImagesPullingTime="2.520979063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:53:02.812500444 +0000 UTC m=+98.156924724" watchObservedRunningTime="2026-06-08 12:53:02.814462422 +0000 UTC m=+98.158886703" Jun 08 12:53:03.248290 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.248252 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:03.349971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.349929 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:03.565314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.565281 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:53:03.566420 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.566288 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kj94g" Jun 08 12:53:03.637859 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.637815 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:53:03.647634 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.647607 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.678425 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.678384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:53:03.742588 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742770 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742619 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742770 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742770 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742903 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742903 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.742903 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.742868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59g2\" (UniqueName: \"kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.788747 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.788650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerStarted","Data":"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f"} Jun 08 12:53:03.833793 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.833723 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5135330099999997 podStartE2EDuration="16.833698656s" totalImagesPullingTime="13.303104251s" totalInitContainerRuntime="17.061395ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:53:03.830988572 +0000 UTC m=+99.175412851" watchObservedRunningTime="2026-06-08 12:53:03.833698656 +0000 UTC m=+99.178122937" Jun 08 12:53:03.843915 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.843878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59g2\" (UniqueName: \"kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.844509 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.844480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.844756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.844809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.844914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.844986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.845028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.845665 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.845531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.846089 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.845737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.846089 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.846049 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.846191 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.846089 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.852566 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.847989 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.852566 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.848934 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.864754 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.864685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59g2\" (UniqueName: \"kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2\") pod \"console-5f74d86748-6mh4m\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:03.959957 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:03.959912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:04.170432 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:04.170155 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:53:04.795492 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:04.795454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74d86748-6mh4m" event={"ID":"57c92833-7007-453b-a49d-e58c7f3c18a3","Type":"ContainerStarted","Data":"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f"} Jun 08 12:53:04.795960 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:04.795534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74d86748-6mh4m" event={"ID":"57c92833-7007-453b-a49d-e58c7f3c18a3","Type":"ContainerStarted","Data":"04a6e6c4774c25fb85e20c8cf8211517944b5b37cc94e66db1580c32784ffe61"} Jun 08 12:53:04.815537 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:04.815440 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f74d86748-6mh4m" podStartSLOduration=1.815416541 podStartE2EDuration="1.815416541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:53:04.813439282 +0000 UTC m=+100.157863585" watchObservedRunningTime="2026-06-08 12:53:04.815416541 +0000 UTC m=+100.159840820" Jun 08 12:53:06.194821 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:06.194771 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:06.275352 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:06.275312 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:06.817716 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:06.817680 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:07.006974 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:07.006938 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:07.602485 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:07.602443 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:53:07.965097 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:07.965049 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:08.064375 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:08.064310 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:09.082290 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:09.082255 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:09.528361 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:09.528328 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:53:10.546143 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:10.546106 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:10.642629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:10.642590 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:13.960073 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:13.960031 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:13.960505 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:13.960106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:13.967790 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:13.967741 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:14.847044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:14.847017 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:53:15.021996 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:15.021960 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:15.122252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:15.122163 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:15.224814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:15.224781 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:16.888459 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:16.888421 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:22.294941 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.294902 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" podUID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" containerName="registry" containerID="cri-o://6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e" gracePeriod=30 Jun 08 12:53:22.568691 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.568631 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:53:22.715223 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715194 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715266 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715289 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715309 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715331 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715347 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715373 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.715696 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715589 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vc7s\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s\") pod \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\" (UID: \"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd\") " Jun 08 12:53:22.716033 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.715978 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:22.716156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.716100 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:22.717984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.717954 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:22.718106 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.718016 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:22.718106 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.718048 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:22.718106 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.718083 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:22.718254 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.718193 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s" (OuterVolumeSpecName: "kube-api-access-5vc7s") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "kube-api-access-5vc7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:22.723609 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.723585 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" (UID: "f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:53:22.816495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816473 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-ca-trust-extracted\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816494 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-bound-sa-token\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816503 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-image-registry-private-configuration\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816511 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-trusted-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816541 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-installation-pull-secrets\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816554 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-certificates\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816565 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vc7s\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-kube-api-access-5vc7s\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.816667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.816575 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd-registry-tls\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:22.881117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.881047 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" containerID="6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e" exitCode=0 Jun 08 12:53:22.881117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.881101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" event={"ID":"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd","Type":"ContainerDied","Data":"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e"} Jun 08 12:53:22.881290 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.881114 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" Jun 08 12:53:22.881290 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.881177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5758f66ddd-dfrdq" event={"ID":"f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd","Type":"ContainerDied","Data":"66af5c8a19341d2ad13bd43187d6f7cdc019ddfe17f232c6aef675e043a79d4f"} Jun 08 12:53:22.881290 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.881206 2568 scope.go:117] "RemoveContainer" containerID="6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e" Jun 08 12:53:22.890117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.890102 2568 scope.go:117] "RemoveContainer" containerID="6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e" Jun 08 12:53:22.890332 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:53:22.890312 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e\": container with ID starting with 6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e not found: ID does not exist" containerID="6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e" Jun 08 12:53:22.890400 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.890342 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e"} err="failed to get container status \"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e\": rpc error: code = NotFound desc = could not find container \"6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e\": container with ID starting with 6065e01a5e4023d1c53cd6023299675f5cb94b267be0619fd15c164b8f11548e not found: ID does not exist" Jun 08 12:53:22.905344 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.905323 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:53:22.908722 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.908703 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5758f66ddd-dfrdq"] Jun 08 12:53:22.951714 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:22.951692 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:23.014733 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:23.014704 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:53:23.151574 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:23.151499 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" path="/var/lib/kubelet/pods/f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd/volumes" Jun 08 12:53:24.780910 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:24.780870 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66f967b45c-hvgj7" podUID="c6b84fc6-276b-4612-a220-fe765e030ed5" containerName="console" containerID="cri-o://816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831" gracePeriod=15 Jun 08 12:53:25.011684 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.011657 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:53:25.134889 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.134867 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135023 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.134905 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135102 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135036 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135102 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135089 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq2gb\" (UniqueName: \"kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135202 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135149 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135202 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135177 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert\") pod \"c6b84fc6-276b-4612-a220-fe765e030ed5\" (UID: \"c6b84fc6-276b-4612-a220-fe765e030ed5\") " Jun 08 12:53:25.135351 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135326 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:25.135410 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135333 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config" (OuterVolumeSpecName: "console-config") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:25.135410 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135357 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:25.135500 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135418 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-service-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.135500 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135438 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-console-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.135500 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.135451 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6b84fc6-276b-4612-a220-fe765e030ed5-oauth-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.137266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.137241 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb" (OuterVolumeSpecName: "kube-api-access-mq2gb") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "kube-api-access-mq2gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:25.137550 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.137511 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:25.137627 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.137533 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6b84fc6-276b-4612-a220-fe765e030ed5" (UID: "c6b84fc6-276b-4612-a220-fe765e030ed5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:25.236010 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.235990 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq2gb\" (UniqueName: \"kubernetes.io/projected/c6b84fc6-276b-4612-a220-fe765e030ed5-kube-api-access-mq2gb\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.236010 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.236012 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-oauth-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.236144 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.236021 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6b84fc6-276b-4612-a220-fe765e030ed5-console-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:25.895056 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.895019 2568 generic.go:356] "Generic (PLEG): container finished" podID="c6b84fc6-276b-4612-a220-fe765e030ed5" containerID="816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831" exitCode=0 Jun 08 12:53:25.895549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.895079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f967b45c-hvgj7" event={"ID":"c6b84fc6-276b-4612-a220-fe765e030ed5","Type":"ContainerDied","Data":"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831"} Jun 08 12:53:25.895549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.895088 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f967b45c-hvgj7" Jun 08 12:53:25.895549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.895116 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f967b45c-hvgj7" event={"ID":"c6b84fc6-276b-4612-a220-fe765e030ed5","Type":"ContainerDied","Data":"4ea232318e94f167221da06cddd8d8ca0fbeb17daae6cf6c0d0b93b40996b341"} Jun 08 12:53:25.895549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.895136 2568 scope.go:117] "RemoveContainer" containerID="816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831" Jun 08 12:53:25.902638 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.902621 2568 scope.go:117] "RemoveContainer" containerID="816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831" Jun 08 12:53:25.902873 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:53:25.902856 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831\": container with ID starting with 816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831 not found: ID does not exist" containerID="816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831" Jun 08 12:53:25.902928 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.902880 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831"} err="failed to get container status \"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831\": rpc error: code = NotFound desc = could not find container \"816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831\": container with ID starting with 816375718f06cd74c11add033fc58967ef2a3d2dffb08c31c2d099e12e798831 not found: ID does not exist" Jun 08 12:53:25.914898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.914868 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:53:25.919120 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:25.919097 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f967b45c-hvgj7"] Jun 08 12:53:27.151183 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:27.151152 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b84fc6-276b-4612-a220-fe765e030ed5" path="/var/lib/kubelet/pods/c6b84fc6-276b-4612-a220-fe765e030ed5/volumes" Jun 08 12:53:28.589772 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.589710 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-579ccd7768-k6jc7" podUID="beb72920-d080-4a9b-a7ef-2d26f6272760" containerName="console" containerID="cri-o://e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711" gracePeriod=15 Jun 08 12:53:28.852908 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.852845 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:53:28.908022 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.907988 2568 generic.go:356] "Generic (PLEG): container finished" podID="beb72920-d080-4a9b-a7ef-2d26f6272760" containerID="e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711" exitCode=0 Jun 08 12:53:28.908151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.908036 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579ccd7768-k6jc7" Jun 08 12:53:28.908151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.908075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579ccd7768-k6jc7" event={"ID":"beb72920-d080-4a9b-a7ef-2d26f6272760","Type":"ContainerDied","Data":"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711"} Jun 08 12:53:28.908151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.908125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579ccd7768-k6jc7" event={"ID":"beb72920-d080-4a9b-a7ef-2d26f6272760","Type":"ContainerDied","Data":"da3dd4c5162b8616b356471e509b49a1e44e8413656cc184a69c867d91878932"} Jun 08 12:53:28.908151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.908147 2568 scope.go:117] "RemoveContainer" containerID="e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711" Jun 08 12:53:28.915572 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.915549 2568 scope.go:117] "RemoveContainer" containerID="e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711" Jun 08 12:53:28.915825 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:53:28.915806 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711\": container with ID starting with e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711 not found: ID does not exist" containerID="e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711" Jun 08 12:53:28.915892 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.915835 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711"} err="failed to get container status \"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711\": rpc error: code = NotFound desc = could not find container \"e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711\": container with ID starting with e6c69b5914e4ff93ff13a210addd6a3ed26fc566f95af68928befe23299bc711 not found: ID does not exist" Jun 08 12:53:28.965126 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965108 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqlgr\" (UniqueName: \"kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965231 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965144 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965231 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965175 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965231 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965215 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965440 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965249 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965440 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965275 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965440 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965307 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config\") pod \"beb72920-d080-4a9b-a7ef-2d26f6272760\" (UID: \"beb72920-d080-4a9b-a7ef-2d26f6272760\") " Jun 08 12:53:28.965688 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965660 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:28.965898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965874 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:28.965986 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965875 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca" (OuterVolumeSpecName: "service-ca") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:28.965986 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.965915 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config" (OuterVolumeSpecName: "console-config") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:28.967279 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.967258 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr" (OuterVolumeSpecName: "kube-api-access-lqlgr") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "kube-api-access-lqlgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:28.967359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.967285 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:28.967403 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:28.967389 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "beb72920-d080-4a9b-a7ef-2d26f6272760" (UID: "beb72920-d080-4a9b-a7ef-2d26f6272760"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:29.066191 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066161 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqlgr\" (UniqueName: \"kubernetes.io/projected/beb72920-d080-4a9b-a7ef-2d26f6272760-kube-api-access-lqlgr\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066191 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066186 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-oauth-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066199 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-trusted-ca-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066211 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-oauth-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066222 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beb72920-d080-4a9b-a7ef-2d26f6272760-console-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066234 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-service-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.066323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.066245 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beb72920-d080-4a9b-a7ef-2d26f6272760-console-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:53:29.237062 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.236459 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:53:29.241266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:29.241242 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-579ccd7768-k6jc7"] Jun 08 12:53:30.917738 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.917706 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c696c6c-cfaa-4c31-aac6-83e4917a868a" containerID="18110a97b67e9f369178fafa7ba334650afa06e469f4cb11cec86db8fdd8a835" exitCode=0 Jun 08 12:53:30.918189 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.917785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fntcz" event={"ID":"6c696c6c-cfaa-4c31-aac6-83e4917a868a","Type":"ContainerDied","Data":"18110a97b67e9f369178fafa7ba334650afa06e469f4cb11cec86db8fdd8a835"} Jun 08 12:53:30.918252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.918205 2568 scope.go:117] "RemoveContainer" containerID="18110a97b67e9f369178fafa7ba334650afa06e469f4cb11cec86db8fdd8a835" Jun 08 12:53:30.919311 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.919278 2568 generic.go:356] "Generic (PLEG): container finished" podID="e496a7d8-9cc8-4b2c-a116-65cfc046c7d0" containerID="30e34b62772ad5b287f854b2898d70c1ce0b3049acb08f7bbb9a9f43b380fb52" exitCode=0 Jun 08 12:53:30.919311 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.919305 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" event={"ID":"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0","Type":"ContainerDied","Data":"30e34b62772ad5b287f854b2898d70c1ce0b3049acb08f7bbb9a9f43b380fb52"} Jun 08 12:53:30.919589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:30.919576 2568 scope.go:117] "RemoveContainer" containerID="30e34b62772ad5b287f854b2898d70c1ce0b3049acb08f7bbb9a9f43b380fb52" Jun 08 12:53:31.151805 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:31.151768 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb72920-d080-4a9b-a7ef-2d26f6272760" path="/var/lib/kubelet/pods/beb72920-d080-4a9b-a7ef-2d26f6272760/volumes" Jun 08 12:53:31.924710 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:31.924672 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fntcz" event={"ID":"6c696c6c-cfaa-4c31-aac6-83e4917a868a","Type":"ContainerStarted","Data":"cbcc575e5c5281cfa3eac9c718f78a3154c2254c77c1d2374abecdd95fc28a17"} Jun 08 12:53:31.926281 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:31.926257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cnvht" event={"ID":"e496a7d8-9cc8-4b2c-a116-65cfc046c7d0","Type":"ContainerStarted","Data":"500b2f3862de174c186b26cf53fce19b2a60abcfa987c6b4dae31c658676037f"} Jun 08 12:53:40.962285 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:40.962251 2568 generic.go:356] "Generic (PLEG): container finished" podID="17ea67fe-ed7e-4d33-af00-94a0af9122d9" containerID="27de866b69e9a71f8f9013f7d798748fc99462dbaa3d3989a5323605ee2a9535" exitCode=0 Jun 08 12:53:40.962698 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:40.962324 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" event={"ID":"17ea67fe-ed7e-4d33-af00-94a0af9122d9","Type":"ContainerDied","Data":"27de866b69e9a71f8f9013f7d798748fc99462dbaa3d3989a5323605ee2a9535"} Jun 08 12:53:40.962698 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:40.962663 2568 scope.go:117] "RemoveContainer" containerID="27de866b69e9a71f8f9013f7d798748fc99462dbaa3d3989a5323605ee2a9535" Jun 08 12:53:41.968533 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:53:41.968491 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fh45d" event={"ID":"17ea67fe-ed7e-4d33-af00-94a0af9122d9","Type":"ContainerStarted","Data":"2bb8473cd121e1029dee29114ab58b57b714267d691c2a7c547c5d90389ff0f5"} Jun 08 12:54:02.927819 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:02.927774 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:02.989859 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:02.989823 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:07.187786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.187751 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:07.188199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188076 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="alertmanager" containerID="cri-o://8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9" gracePeriod=120 Jun 08 12:54:07.188199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188150 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="prom-label-proxy" containerID="cri-o://01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f" gracePeriod=120 Jun 08 12:54:07.188199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188182 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy" containerID="cri-o://87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23" gracePeriod=120 Jun 08 12:54:07.188376 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188189 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-web" containerID="cri-o://e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548" gracePeriod=120 Jun 08 12:54:07.188376 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188128 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-metric" containerID="cri-o://0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f" gracePeriod=120 Jun 08 12:54:07.188376 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:07.188189 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="config-reloader" containerID="cri-o://5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb" gracePeriod=120 Jun 08 12:54:08.076348 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076316 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f" exitCode=0 Jun 08 12:54:08.076348 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076343 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f" exitCode=0 Jun 08 12:54:08.076348 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076350 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23" exitCode=0 Jun 08 12:54:08.076348 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076355 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb" exitCode=0 Jun 08 12:54:08.076348 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076362 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9" exitCode=0 Jun 08 12:54:08.076660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f"} Jun 08 12:54:08.076660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076448 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f"} Jun 08 12:54:08.076660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23"} Jun 08 12:54:08.076660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076503 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb"} Jun 08 12:54:08.076660 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.076545 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9"} Jun 08 12:54:08.432528 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.432488 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:08.480338 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480307 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b7g2\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480499 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480355 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480499 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480392 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480565 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480613 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480639 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480671 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480707 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480729 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480749 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:54:08.480775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480766 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.481106 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.480896 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:08.481804 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.481496 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.481804 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.481554 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls\") pod \"a06e3759-b7dc-4d69-8085-003633c3a845\" (UID: \"a06e3759-b7dc-4d69-8085-003633c3a845\") " Jun 08 12:54:08.481977 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.481960 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:08.482213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.482149 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-main-db\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.482213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.482177 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.482213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.482193 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a06e3759-b7dc-4d69-8085-003633c3a845-metrics-client-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.485030 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.484968 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.485141 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.485033 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.485141 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.485106 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2" (OuterVolumeSpecName: "kube-api-access-4b7g2") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "kube-api-access-4b7g2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:54:08.485841 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.485813 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.486226 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.486193 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out" (OuterVolumeSpecName: "config-out") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:54:08.486296 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.486246 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.486334 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.486284 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume" (OuterVolumeSpecName: "config-volume") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.486879 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.486856 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:54:08.490165 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.490076 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.498825 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.498803 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config" (OuterVolumeSpecName: "web-config") pod "a06e3759-b7dc-4d69-8085-003633c3a845" (UID: "a06e3759-b7dc-4d69-8085-003633c3a845"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:08.582589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582548 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582586 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582589 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582597 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-cluster-tls-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582606 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582615 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-web-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582624 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-config-volume\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582634 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a06e3759-b7dc-4d69-8085-003633c3a845-config-out\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582641 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a06e3759-b7dc-4d69-8085-003633c3a845-secret-alertmanager-main-tls\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582650 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b7g2\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-kube-api-access-4b7g2\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:08.582815 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:08.582657 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a06e3759-b7dc-4d69-8085-003633c3a845-tls-assets\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:09.083492 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.083454 2568 generic.go:356] "Generic (PLEG): container finished" podID="a06e3759-b7dc-4d69-8085-003633c3a845" containerID="e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548" exitCode=0 Jun 08 12:54:09.083675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.083500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548"} Jun 08 12:54:09.083675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.083545 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.083675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.083581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a06e3759-b7dc-4d69-8085-003633c3a845","Type":"ContainerDied","Data":"a6e0685863c1eb121372d99a59dc62c36cd9e820b32caf952d07ec7effd697a5"} Jun 08 12:54:09.083675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.083614 2568 scope.go:117] "RemoveContainer" containerID="01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f" Jun 08 12:54:09.091827 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.091808 2568 scope.go:117] "RemoveContainer" containerID="0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f" Jun 08 12:54:09.098601 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.098574 2568 scope.go:117] "RemoveContainer" containerID="87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23" Jun 08 12:54:09.105623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.105578 2568 scope.go:117] "RemoveContainer" containerID="e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548" Jun 08 12:54:09.108804 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.108784 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:09.113081 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.113056 2568 scope.go:117] "RemoveContainer" containerID="5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb" Jun 08 12:54:09.117324 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.117305 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:09.120720 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.120704 2568 scope.go:117] "RemoveContainer" containerID="8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9" Jun 08 12:54:09.129376 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.128724 2568 scope.go:117] "RemoveContainer" containerID="90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651" Jun 08 12:54:09.136771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.136755 2568 scope.go:117] "RemoveContainer" containerID="01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f" Jun 08 12:54:09.137030 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.137012 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f\": container with ID starting with 01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f not found: ID does not exist" containerID="01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f" Jun 08 12:54:09.137070 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137039 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f"} err="failed to get container status \"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f\": rpc error: code = NotFound desc = could not find container \"01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f\": container with ID starting with 01c04467cbd2b7e640bc24717540f759f84d13ad344a6fb0ecda1bad259e618f not found: ID does not exist" Jun 08 12:54:09.137070 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137057 2568 scope.go:117] "RemoveContainer" containerID="0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f" Jun 08 12:54:09.137291 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.137276 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f\": container with ID starting with 0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f not found: ID does not exist" containerID="0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f" Jun 08 12:54:09.137347 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137296 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f"} err="failed to get container status \"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f\": rpc error: code = NotFound desc = could not find container \"0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f\": container with ID starting with 0d1ffca7e2e2e112e4beecefcbbe1ec13138009d322876cfe41d0f23bdab549f not found: ID does not exist" Jun 08 12:54:09.137347 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137310 2568 scope.go:117] "RemoveContainer" containerID="87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23" Jun 08 12:54:09.137479 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.137466 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23\": container with ID starting with 87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23 not found: ID does not exist" containerID="87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23" Jun 08 12:54:09.137534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137480 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23"} err="failed to get container status \"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23\": rpc error: code = NotFound desc = could not find container \"87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23\": container with ID starting with 87c8a7408752352defd85e68c67b4d9754c7e36c2b0bd0dd85f6a4756b2f5c23 not found: ID does not exist" Jun 08 12:54:09.137534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137491 2568 scope.go:117] "RemoveContainer" containerID="e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548" Jun 08 12:54:09.137706 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.137692 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548\": container with ID starting with e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548 not found: ID does not exist" containerID="e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548" Jun 08 12:54:09.137750 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137709 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548"} err="failed to get container status \"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548\": rpc error: code = NotFound desc = could not find container \"e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548\": container with ID starting with e3fb8286be2cf7de77df479a9176057886abaf14c1b2b15844e13bccae944548 not found: ID does not exist" Jun 08 12:54:09.137750 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137722 2568 scope.go:117] "RemoveContainer" containerID="5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb" Jun 08 12:54:09.137910 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.137892 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb\": container with ID starting with 5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb not found: ID does not exist" containerID="5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb" Jun 08 12:54:09.137969 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137913 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb"} err="failed to get container status \"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb\": rpc error: code = NotFound desc = could not find container \"5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb\": container with ID starting with 5b4031fc8f5cd5db89d40c92349614d88a5401de9234b21a54404840c97e09cb not found: ID does not exist" Jun 08 12:54:09.137969 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.137928 2568 scope.go:117] "RemoveContainer" containerID="8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9" Jun 08 12:54:09.138142 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.138127 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9\": container with ID starting with 8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9 not found: ID does not exist" containerID="8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9" Jun 08 12:54:09.138198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.138144 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9"} err="failed to get container status \"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9\": rpc error: code = NotFound desc = could not find container \"8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9\": container with ID starting with 8636d26b8f2e84c2c2d64ebbd4c7865d521fa69e7d48c26047d5b010c2b881c9 not found: ID does not exist" Jun 08 12:54:09.138198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.138157 2568 scope.go:117] "RemoveContainer" containerID="90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651" Jun 08 12:54:09.138335 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:09.138320 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651\": container with ID starting with 90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651 not found: ID does not exist" containerID="90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651" Jun 08 12:54:09.138370 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.138338 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651"} err="failed to get container status \"90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651\": rpc error: code = NotFound desc = could not find container \"90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651\": container with ID starting with 90e9ed68c8c9350bf1e6a46a31a7c65672b1be8a6268b3da17b782640c811651 not found: ID does not exist" Jun 08 12:54:09.155449 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.155423 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" path="/var/lib/kubelet/pods/a06e3759-b7dc-4d69-8085-003633c3a845/volumes" Jun 08 12:54:09.155918 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.155904 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:09.156158 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156147 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-metric" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156161 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-metric" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156170 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" containerName="registry" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156176 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" containerName="registry" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156184 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b84fc6-276b-4612-a220-fe765e030ed5" containerName="console" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156189 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b84fc6-276b-4612-a220-fe765e030ed5" containerName="console" Jun 08 12:54:09.156198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156198 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="config-reloader" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156203 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="config-reloader" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156212 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="init-config-reloader" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156217 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="init-config-reloader" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156223 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-web" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156228 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-web" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156235 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="alertmanager" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156239 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="alertmanager" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156247 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="prom-label-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156251 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="prom-label-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156262 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb72920-d080-4a9b-a7ef-2d26f6272760" containerName="console" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156266 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb72920-d080-4a9b-a7ef-2d26f6272760" containerName="console" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156272 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156276 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156316 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="prom-label-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156325 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b84fc6-276b-4612-a220-fe765e030ed5" containerName="console" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156332 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb72920-d080-4a9b-a7ef-2d26f6272760" containerName="console" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156336 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-web" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156342 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156346 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="kube-rbac-proxy-metric" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156353 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b3cd1f-1e5d-41fc-b821-c7ab87b9c5dd" containerName="registry" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156359 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="config-reloader" Jun 08 12:54:09.156365 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.156364 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06e3759-b7dc-4d69-8085-003633c3a845" containerName="alertmanager" Jun 08 12:54:09.161213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.161198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.167252 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167102 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:54:09.167687 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:54:09.167786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167770 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:54:09.167856 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167775 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:54:09.167921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:54:09.168011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.167998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:54:09.168085 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.168048 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:54:09.168085 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.168062 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jwmh6\"" Jun 08 12:54:09.168298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.168285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:54:09.176823 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.176805 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:54:09.182159 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.182138 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:09.288894 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.288848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-out\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.288894 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.288896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.288931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.288956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.288996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-web-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-volume\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tllt9\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-kube-api-access-tllt9\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.289623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.289349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.389937 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-volume\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.389937 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tllt9\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-kube-api-access-tllt9\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.389992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390039 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-out\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.390595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.390234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-web-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.391208 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.391178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.391416 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.391397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.391623 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.391575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956b2550-92e9-4250-a75b-7a3cbfdf2389-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.392971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.392929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-volume\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393130 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393085 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393410 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393508 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393694 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956b2550-92e9-4250-a75b-7a3cbfdf2389-config-out\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393928 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393910 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.393988 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.393933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-web-config\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.394202 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.394188 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.394492 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.394476 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956b2550-92e9-4250-a75b-7a3cbfdf2389-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.399622 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.399600 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tllt9\" (UniqueName: \"kubernetes.io/projected/956b2550-92e9-4250-a75b-7a3cbfdf2389-kube-api-access-tllt9\") pod \"alertmanager-main-0\" (UID: \"956b2550-92e9-4250-a75b-7a3cbfdf2389\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.470440 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.470402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:54:09.611187 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:09.611158 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:54:09.614844 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:54:09.614818 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956b2550_92e9_4250_a75b_7a3cbfdf2389.slice/crio-0443034e57bc8511c84638c68bcbcd83731d00a09984b9ab399e4318712f71e4 WatchSource:0}: Error finding container 0443034e57bc8511c84638c68bcbcd83731d00a09984b9ab399e4318712f71e4: Status 404 returned error can't find the container with id 0443034e57bc8511c84638c68bcbcd83731d00a09984b9ab399e4318712f71e4 Jun 08 12:54:10.089624 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:10.089494 2568 generic.go:356] "Generic (PLEG): container finished" podID="956b2550-92e9-4250-a75b-7a3cbfdf2389" containerID="34c4cf66a5df5fe5d6ce760e9e1f5924343ef313fde335da778b533fb70353be" exitCode=0 Jun 08 12:54:10.089624 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:10.089575 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerDied","Data":"34c4cf66a5df5fe5d6ce760e9e1f5924343ef313fde335da778b533fb70353be"} Jun 08 12:54:10.089854 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:10.089639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"0443034e57bc8511c84638c68bcbcd83731d00a09984b9ab399e4318712f71e4"} Jun 08 12:54:11.097871 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.097836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"f547788cef501e2e1f3d25ec936b77abf6d44400468460f157b0a3d8486051c8"} Jun 08 12:54:11.098235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.097907 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"e81c0e90b74a71f5148eda52ca75727d610c967693750ae730a64e5916b32aa2"} Jun 08 12:54:11.098235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.097934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"6804b01b13cf5092e11a7930377b4bb6a29d6a7f799dee9d02d19847a0d5b8de"} Jun 08 12:54:11.098235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.097956 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"7cb139457fadd3a354c13a6792df8f72cb6a82f9a88c7aca68f145e8c33d7a19"} Jun 08 12:54:11.098235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.097982 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"6e85f503637b2af60b1dd788b86ffab2e4a4580990dd6b26b263d8e8a309b2ad"} Jun 08 12:54:11.098235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.098005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956b2550-92e9-4250-a75b-7a3cbfdf2389","Type":"ContainerStarted","Data":"8c8b271b1038c306fce01e3954cccc4bdb2a42e60e950cf30a9279304b123ee3"} Jun 08 12:54:11.133640 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:11.133563 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.118337831 podStartE2EDuration="2.133540582s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.202751ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:54:11.131120822 +0000 UTC m=+166.475545111" watchObservedRunningTime="2026-06-08 12:54:11.133540582 +0000 UTC m=+166.477964863" Jun 08 12:54:14.832351 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:14.832266 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:15.029383 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:15.029348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:17.794874 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.794839 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 12:54:17.798501 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.798472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.809606 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.809585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 12:54:17.842411 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.842369 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:17.864971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.864928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.864971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.864980 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.865220 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.865000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.865220 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.865107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.865220 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.865167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.865220 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.865208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dsth\" (UniqueName: \"kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.865427 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.865245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.896447 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.896377 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:17.966145 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966151 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsth\" (UniqueName: \"kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966445 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966445 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966633 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.966976 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.966953 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.967051 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.967008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.967051 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.967039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.967291 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.967267 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.968619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.968602 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.968922 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.968903 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.976010 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.975980 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsth\" (UniqueName: \"kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth\") pod \"console-79955f8ff6-5fsvw\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:17.986782 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:17.986751 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:18.047559 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:18.047457 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:18.108425 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:18.108389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:18.247767 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:18.247705 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 12:54:18.250676 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:54:18.250650 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38291e55_62b6_4c5e_a6a2_5248c01e9e32.slice/crio-a29fc9e5b0fa867955c006645d2f64cab7614d40fc4df8ec9793b8a1bcf78c30 WatchSource:0}: Error finding container a29fc9e5b0fa867955c006645d2f64cab7614d40fc4df8ec9793b8a1bcf78c30: Status 404 returned error can't find the container with id a29fc9e5b0fa867955c006645d2f64cab7614d40fc4df8ec9793b8a1bcf78c30 Jun 08 12:54:18.608692 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:18.608608 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:18.687737 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:18.687703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:19.135495 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:19.135456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955f8ff6-5fsvw" event={"ID":"38291e55-62b6-4c5e-a6a2-5248c01e9e32","Type":"ContainerStarted","Data":"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0"} Jun 08 12:54:19.135890 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:19.135512 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955f8ff6-5fsvw" event={"ID":"38291e55-62b6-4c5e-a6a2-5248c01e9e32","Type":"ContainerStarted","Data":"a29fc9e5b0fa867955c006645d2f64cab7614d40fc4df8ec9793b8a1bcf78c30"} Jun 08 12:54:19.153001 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:19.152950 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79955f8ff6-5fsvw" podStartSLOduration=2.152935552 podStartE2EDuration="2.152935552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:54:19.152228478 +0000 UTC m=+174.496652841" watchObservedRunningTime="2026-06-08 12:54:19.152935552 +0000 UTC m=+174.497359831" Jun 08 12:54:22.962159 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:22.962123 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:23.060360 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:23.060320 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:26.751118 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:26.751087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:28.109354 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.109301 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:28.109892 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.109417 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:28.114936 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.114909 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:28.175352 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.175324 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 12:54:28.311855 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.311822 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:54:28.422635 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.422602 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:28.476509 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:28.476474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:48.784513 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:48.784474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:48.883228 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:48.883191 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:49.442913 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.442882 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z"] Jun 08 12:54:49.446269 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.446252 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.448809 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.448784 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:54:49.448935 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.448815 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:54:49.448935 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.448927 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:54:49.454855 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.454829 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z"] Jun 08 12:54:49.542705 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.542667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.542888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.542728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.542888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.542791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285rw\" (UniqueName: \"kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.643840 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.643798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-285rw\" (UniqueName: \"kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.644059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.643889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.644059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.643946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.644320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.644298 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.644444 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.644377 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.652207 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.652184 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-285rw\" (UniqueName: \"kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.756677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.756600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:54:49.887541 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:49.887423 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z"] Jun 08 12:54:49.890231 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:54:49.890202 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908363fe_a8e4_4bb8_a27b_0a24941b3913.slice/crio-53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b WatchSource:0}: Error finding container 53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b: Status 404 returned error can't find the container with id 53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b Jun 08 12:54:50.255748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:50.255711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerStarted","Data":"53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b"} Jun 08 12:54:53.335562 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.335469 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f74d86748-6mh4m" podUID="57c92833-7007-453b-a49d-e58c7f3c18a3" containerName="console" containerID="cri-o://2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f" gracePeriod=15 Jun 08 12:54:53.603812 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.603789 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:54:53.679008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.678968 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679027 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679071 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m59g2\" (UniqueName: \"kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679100 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679137 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679168 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679451 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679224 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert\") pod \"57c92833-7007-453b-a49d-e58c7f3c18a3\" (UID: \"57c92833-7007-453b-a49d-e58c7f3c18a3\") " Jun 08 12:54:53.679559 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679512 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config" (OuterVolumeSpecName: "console-config") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:53.679625 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679539 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:53.679625 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679598 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:53.679841 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679814 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-service-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.679909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679841 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-console-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.679909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679856 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-oauth-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.679909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.679838 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:54:53.681906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.681865 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:53.682008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.681974 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:54:53.682063 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.682036 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2" (OuterVolumeSpecName: "kube-api-access-m59g2") pod "57c92833-7007-453b-a49d-e58c7f3c18a3" (UID: "57c92833-7007-453b-a49d-e58c7f3c18a3"). InnerVolumeSpecName "kube-api-access-m59g2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:54:53.781008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.780969 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m59g2\" (UniqueName: \"kubernetes.io/projected/57c92833-7007-453b-a49d-e58c7f3c18a3-kube-api-access-m59g2\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.781008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.781001 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.781008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.781011 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57c92833-7007-453b-a49d-e58c7f3c18a3-console-oauth-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:53.781008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:53.781019 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57c92833-7007-453b-a49d-e58c7f3c18a3-trusted-ca-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:54:54.275052 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.275012 2568 generic.go:356] "Generic (PLEG): container finished" podID="57c92833-7007-453b-a49d-e58c7f3c18a3" containerID="2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f" exitCode=0 Jun 08 12:54:54.275266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.275078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74d86748-6mh4m" event={"ID":"57c92833-7007-453b-a49d-e58c7f3c18a3","Type":"ContainerDied","Data":"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f"} Jun 08 12:54:54.275266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.275082 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74d86748-6mh4m" Jun 08 12:54:54.275266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.275139 2568 scope.go:117] "RemoveContainer" containerID="2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f" Jun 08 12:54:54.275266 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.275125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74d86748-6mh4m" event={"ID":"57c92833-7007-453b-a49d-e58c7f3c18a3","Type":"ContainerDied","Data":"04a6e6c4774c25fb85e20c8cf8211517944b5b37cc94e66db1580c32784ffe61"} Jun 08 12:54:54.285479 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.285461 2568 scope.go:117] "RemoveContainer" containerID="2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f" Jun 08 12:54:54.285821 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:54:54.285802 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f\": container with ID starting with 2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f not found: ID does not exist" containerID="2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f" Jun 08 12:54:54.285882 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.285830 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f"} err="failed to get container status \"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f\": rpc error: code = NotFound desc = could not find container \"2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f\": container with ID starting with 2578c8ef6b7544d2a4ac52bbcab4f02e34d64a2663ca426b622a7497a42b515f not found: ID does not exist" Jun 08 12:54:54.297757 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.297724 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:54:54.301736 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:54.301705 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f74d86748-6mh4m"] Jun 08 12:54:55.151891 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:55.151857 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c92833-7007-453b-a49d-e58c7f3c18a3" path="/var/lib/kubelet/pods/57c92833-7007-453b-a49d-e58c7f3c18a3/volumes" Jun 08 12:54:56.285888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:56.285852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerStarted","Data":"9bc46d4660e36a8af387071cf38a109a8aaa9c6146153a8688c40e3d73f6b63e"} Jun 08 12:54:56.660611 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:56.660566 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:54:57.291588 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:57.291557 2568 generic.go:356] "Generic (PLEG): container finished" podID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerID="9bc46d4660e36a8af387071cf38a109a8aaa9c6146153a8688c40e3d73f6b63e" exitCode=0 Jun 08 12:54:57.292009 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:54:57.291645 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerDied","Data":"9bc46d4660e36a8af387071cf38a109a8aaa9c6146153a8688c40e3d73f6b63e"} Jun 08 12:55:00.307611 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:00.307571 2568 generic.go:356] "Generic (PLEG): container finished" podID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerID="fe8e6a683829f949f51e6b5456f683a88844c353f382df12798e67669774d9fd" exitCode=0 Jun 08 12:55:00.307972 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:00.307621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerDied","Data":"fe8e6a683829f949f51e6b5456f683a88844c353f382df12798e67669774d9fd"} Jun 08 12:55:01.788074 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:01.788036 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:01.936279 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:01.936248 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:07.339273 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:07.339183 2568 generic.go:356] "Generic (PLEG): container finished" podID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerID="412d6cc35f68bbfd2edb1f64396b793e90dd92024554ced4241e4bab8737aa40" exitCode=0 Jun 08 12:55:07.339698 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:07.339265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerDied","Data":"412d6cc35f68bbfd2edb1f64396b793e90dd92024554ced4241e4bab8737aa40"} Jun 08 12:55:08.471076 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.471050 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:55:08.616391 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.616299 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util\") pod \"908363fe-a8e4-4bb8-a27b-0a24941b3913\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " Jun 08 12:55:08.616591 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.616393 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle\") pod \"908363fe-a8e4-4bb8-a27b-0a24941b3913\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " Jun 08 12:55:08.616591 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.616422 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-285rw\" (UniqueName: \"kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw\") pod \"908363fe-a8e4-4bb8-a27b-0a24941b3913\" (UID: \"908363fe-a8e4-4bb8-a27b-0a24941b3913\") " Jun 08 12:55:08.617090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.617061 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle" (OuterVolumeSpecName: "bundle") pod "908363fe-a8e4-4bb8-a27b-0a24941b3913" (UID: "908363fe-a8e4-4bb8-a27b-0a24941b3913"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:08.618556 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.618510 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw" (OuterVolumeSpecName: "kube-api-access-285rw") pod "908363fe-a8e4-4bb8-a27b-0a24941b3913" (UID: "908363fe-a8e4-4bb8-a27b-0a24941b3913"). InnerVolumeSpecName "kube-api-access-285rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:55:08.620027 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.620007 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util" (OuterVolumeSpecName: "util") pod "908363fe-a8e4-4bb8-a27b-0a24941b3913" (UID: "908363fe-a8e4-4bb8-a27b-0a24941b3913"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:08.717068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.717027 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:08.717068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.717061 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908363fe-a8e4-4bb8-a27b-0a24941b3913-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:08.717068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:08.717070 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-285rw\" (UniqueName: \"kubernetes.io/projected/908363fe-a8e4-4bb8-a27b-0a24941b3913-kube-api-access-285rw\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:09.348931 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:09.348902 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" Jun 08 12:55:09.348931 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:09.348914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d97f2z" event={"ID":"908363fe-a8e4-4bb8-a27b-0a24941b3913","Type":"ContainerDied","Data":"53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b"} Jun 08 12:55:09.349125 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:09.348984 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f93484882e9a9fc2c2d3d98400771230b7d4ebdfb94044c6b7f8a773cfeb1b" Jun 08 12:55:10.453972 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:10.453938 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:11.247821 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:11.247784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:12.668899 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.668862 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48"] Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669161 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="pull" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669172 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="pull" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669186 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="extract" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669192 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="extract" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669200 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="util" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669205 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="util" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669220 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c92833-7007-453b-a49d-e58c7f3c18a3" containerName="console" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669225 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c92833-7007-453b-a49d-e58c7f3c18a3" containerName="console" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669280 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="908363fe-a8e4-4bb8-a27b-0a24941b3913" containerName="extract" Jun 08 12:55:12.669294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.669289 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c92833-7007-453b-a49d-e58c7f3c18a3" containerName="console" Jun 08 12:55:12.673909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.673889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.681073 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.681054 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 12:55:12.681354 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.681338 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-c7n28\"" Jun 08 12:55:12.681543 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.681525 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:55:12.705038 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.705016 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48"] Jun 08 12:55:12.750181 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.750144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6w45\" (UniqueName: \"kubernetes.io/projected/74209ff7-da53-4a20-9726-b2482649cbe3-kube-api-access-z6w45\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.750181 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.750183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74209ff7-da53-4a20-9726-b2482649cbe3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.850667 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.850632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74209ff7-da53-4a20-9726-b2482649cbe3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.850790 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.850753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6w45\" (UniqueName: \"kubernetes.io/projected/74209ff7-da53-4a20-9726-b2482649cbe3-kube-api-access-z6w45\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.851083 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.851062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74209ff7-da53-4a20-9726-b2482649cbe3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.860826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.860800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6w45\" (UniqueName: \"kubernetes.io/projected/74209ff7-da53-4a20-9726-b2482649cbe3-kube-api-access-z6w45\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wxk48\" (UID: \"74209ff7-da53-4a20-9726-b2482649cbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:12.983048 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:12.982968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" Jun 08 12:55:13.120077 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:13.120044 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48"] Jun 08 12:55:13.124843 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:13.124815 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74209ff7_da53_4a20_9726_b2482649cbe3.slice/crio-c119731d6a20e68a0029bf614be8d5760d54e195d90fca7966f48aac7f50de0d WatchSource:0}: Error finding container c119731d6a20e68a0029bf614be8d5760d54e195d90fca7966f48aac7f50de0d: Status 404 returned error can't find the container with id c119731d6a20e68a0029bf614be8d5760d54e195d90fca7966f48aac7f50de0d Jun 08 12:55:13.365994 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:13.365896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" event={"ID":"74209ff7-da53-4a20-9726-b2482649cbe3","Type":"ContainerStarted","Data":"c119731d6a20e68a0029bf614be8d5760d54e195d90fca7966f48aac7f50de0d"} Jun 08 12:55:14.433305 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:14.433264 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:14.534412 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:14.534351 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:15.379314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:15.378326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" event={"ID":"74209ff7-da53-4a20-9726-b2482649cbe3","Type":"ContainerStarted","Data":"f7b9a34fc71ec63108b98c5fc2e573f0c065fc57e22f0ed0151fee29ff4d7d06"} Jun 08 12:55:15.462235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:15.462183 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wxk48" podStartSLOduration=1.902515041 podStartE2EDuration="3.462167004s" totalImagesPullingTime="1.559651963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:15.460810259 +0000 UTC m=+230.805234566" watchObservedRunningTime="2026-06-08 12:55:15.462167004 +0000 UTC m=+230.806591339" Jun 08 12:55:15.801127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:15.801095 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:15.966651 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:15.966616 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:16.154633 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.154537 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:16.350629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.350594 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:16.895582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.895546 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb"] Jun 08 12:55:16.899211 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.899189 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:16.904049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.904032 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:55:16.904496 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.904481 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:55:16.905627 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.905355 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:55:16.924236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.924214 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb"] Jun 08 12:55:16.938636 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.938616 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv"] Jun 08 12:55:16.941755 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.941739 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:16.948959 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.948945 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 12:55:16.949030 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.948975 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v66nw\"" Jun 08 12:55:16.949169 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.949157 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 12:55:16.963026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.963000 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv"] Jun 08 12:55:16.989759 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.989729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:16.989898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.989766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:16.989898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:16.989798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzg9s\" (UniqueName: \"kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.090636 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.090599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.090811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.090660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.090811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.090684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.090811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.090709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzg9s\" (UniqueName: \"kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.090811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.090748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w586\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-kube-api-access-2w586\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.091107 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.091085 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.091144 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.091095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.130695 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.130663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzg9s\" (UniqueName: \"kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.192459 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.192419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.192812 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.192780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w586\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-kube-api-access-2w586\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.204909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.204876 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w586\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-kube-api-access-2w586\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.207638 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.207621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:17.209853 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.209829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d551d249-aeb8-4b5b-9306-3ffd7cf121d9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2qpv\" (UID: \"d551d249-aeb8-4b5b-9306-3ffd7cf121d9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.263738 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.263673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:17.376773 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.376748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb"] Jun 08 12:55:17.378318 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:17.378283 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4cf6bfb_56d5_4ad3_be44_e20ebd310026.slice/crio-16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd WatchSource:0}: Error finding container 16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd: Status 404 returned error can't find the container with id 16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd Jun 08 12:55:17.391093 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.391062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" event={"ID":"e4cf6bfb-56d5-4ad3-be44-e20ebd310026","Type":"ContainerStarted","Data":"16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd"} Jun 08 12:55:17.419068 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:17.419042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv"] Jun 08 12:55:17.421123 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:17.421100 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd551d249_aeb8_4b5b_9306_3ffd7cf121d9.slice/crio-42fa79fde401851e77c99360c421d4f9a861e34e2cd3797ff1d0927c249d8a65 WatchSource:0}: Error finding container 42fa79fde401851e77c99360c421d4f9a861e34e2cd3797ff1d0927c249d8a65: Status 404 returned error can't find the container with id 42fa79fde401851e77c99360c421d4f9a861e34e2cd3797ff1d0927c249d8a65 Jun 08 12:55:18.398035 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:18.397998 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerID="a93f032bf30dd6df862790b3027e9f8352a3f9a9af36b052294fb8dc9337f786" exitCode=0 Jun 08 12:55:18.398505 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:18.398045 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" event={"ID":"e4cf6bfb-56d5-4ad3-be44-e20ebd310026","Type":"ContainerDied","Data":"a93f032bf30dd6df862790b3027e9f8352a3f9a9af36b052294fb8dc9337f786"} Jun 08 12:55:18.400041 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:18.400016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" event={"ID":"d551d249-aeb8-4b5b-9306-3ffd7cf121d9","Type":"ContainerStarted","Data":"42fa79fde401851e77c99360c421d4f9a861e34e2cd3797ff1d0927c249d8a65"} Jun 08 12:55:19.046005 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:19.045960 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:19.320582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:19.320451 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:20.415444 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:20.415407 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" event={"ID":"d551d249-aeb8-4b5b-9306-3ffd7cf121d9","Type":"ContainerStarted","Data":"19049233af3204c5e05861aff9fc2bff125e90b231b85c76d318a9e9be2a375e"} Jun 08 12:55:20.415954 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:20.415478 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:20.431407 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:20.431349 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" podStartSLOduration=2.192257135 podStartE2EDuration="4.431327652s" totalImagesPullingTime="2.239070517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:20.430665257 +0000 UTC m=+235.775089537" watchObservedRunningTime="2026-06-08 12:55:20.431327652 +0000 UTC m=+235.775751931" Jun 08 12:55:21.030935 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:21.030903 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:21.129599 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:21.129553 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:21.421778 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:21.421742 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerID="c8f181d49954db33494a60fcee4e2843cc7c273e5f1454259844d111c503285c" exitCode=0 Jun 08 12:55:21.422151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:21.421824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" event={"ID":"e4cf6bfb-56d5-4ad3-be44-e20ebd310026","Type":"ContainerDied","Data":"c8f181d49954db33494a60fcee4e2843cc7c273e5f1454259844d111c503285c"} Jun 08 12:55:22.428043 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:22.428010 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerID="e36541f37533f3575b51d8692d635f520adcbff066b24e6413a5d38b006e45a5" exitCode=0 Jun 08 12:55:22.428436 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:22.428065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" event={"ID":"e4cf6bfb-56d5-4ad3-be44-e20ebd310026","Type":"ContainerDied","Data":"e36541f37533f3575b51d8692d635f520adcbff066b24e6413a5d38b006e45a5"} Jun 08 12:55:23.561287 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.561256 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:23.753952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.753854 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util\") pod \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " Jun 08 12:55:23.753952 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.753937 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzg9s\" (UniqueName: \"kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s\") pod \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " Jun 08 12:55:23.754176 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.753972 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle\") pod \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\" (UID: \"e4cf6bfb-56d5-4ad3-be44-e20ebd310026\") " Jun 08 12:55:23.754376 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.754353 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle" (OuterVolumeSpecName: "bundle") pod "e4cf6bfb-56d5-4ad3-be44-e20ebd310026" (UID: "e4cf6bfb-56d5-4ad3-be44-e20ebd310026"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:23.756025 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.756001 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s" (OuterVolumeSpecName: "kube-api-access-rzg9s") pod "e4cf6bfb-56d5-4ad3-be44-e20ebd310026" (UID: "e4cf6bfb-56d5-4ad3-be44-e20ebd310026"). InnerVolumeSpecName "kube-api-access-rzg9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:55:23.758569 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.758543 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util" (OuterVolumeSpecName: "util") pod "e4cf6bfb-56d5-4ad3-be44-e20ebd310026" (UID: "e4cf6bfb-56d5-4ad3-be44-e20ebd310026"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:23.855084 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.855054 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:23.855084 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.855080 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:23.855084 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:23.855090 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzg9s\" (UniqueName: \"kubernetes.io/projected/e4cf6bfb-56d5-4ad3-be44-e20ebd310026-kube-api-access-rzg9s\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:24.438391 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:24.438349 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" event={"ID":"e4cf6bfb-56d5-4ad3-be44-e20ebd310026","Type":"ContainerDied","Data":"16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd"} Jun 08 12:55:24.438594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:24.438406 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16045b7c35d583441aec44a6d606198cae53e999dac1bcba6b58612b796f66bd" Jun 08 12:55:24.438594 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:24.438359 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2bsxb" Jun 08 12:55:26.424216 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:26.424186 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2qpv" Jun 08 12:55:26.452310 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:26.452283 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:27.303472 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:27.303439 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:27.362482 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:27.362448 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:28.104653 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:28.104616 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:28.203853 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:28.203815 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:29.487534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487494 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx"] Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487844 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="pull" Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487857 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="pull" Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487878 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="util" Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487883 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="util" Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487897 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="extract" Jun 08 12:55:29.487906 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487905 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="extract" Jun 08 12:55:29.488086 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.487959 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4cf6bfb-56d5-4ad3-be44-e20ebd310026" containerName="extract" Jun 08 12:55:29.493275 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.493257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.494166 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.494142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5cm\" (UniqueName: \"kubernetes.io/projected/df42a2b5-57d8-4881-9dbe-1c9968520d62-kube-api-access-8k5cm\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.494263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.494199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df42a2b5-57d8-4881-9dbe-1c9968520d62-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.495618 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.495597 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:55:29.496356 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.496338 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 12:55:29.496454 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.496356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-spn4f\"" Jun 08 12:55:29.499359 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.499335 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx"] Jun 08 12:55:29.594708 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.594674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df42a2b5-57d8-4881-9dbe-1c9968520d62-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.594860 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.594761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5cm\" (UniqueName: \"kubernetes.io/projected/df42a2b5-57d8-4881-9dbe-1c9968520d62-kube-api-access-8k5cm\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.595030 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.595011 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df42a2b5-57d8-4881-9dbe-1c9968520d62-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.604814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.604786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5cm\" (UniqueName: \"kubernetes.io/projected/df42a2b5-57d8-4881-9dbe-1c9968520d62-kube-api-access-8k5cm\") pod \"openshift-lws-operator-fd8ccff4c-4p4sx\" (UID: \"df42a2b5-57d8-4881-9dbe-1c9968520d62\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.803937 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.803869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" Jun 08 12:55:29.938259 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:29.938235 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx"] Jun 08 12:55:29.940574 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:29.940511 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf42a2b5_57d8_4881_9dbe_1c9968520d62.slice/crio-878b68513f1198458655f7acba8a65290ba8b174d0330080df282a0409ed159f WatchSource:0}: Error finding container 878b68513f1198458655f7acba8a65290ba8b174d0330080df282a0409ed159f: Status 404 returned error can't find the container with id 878b68513f1198458655f7acba8a65290ba8b174d0330080df282a0409ed159f Jun 08 12:55:30.467463 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:30.467429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" event={"ID":"df42a2b5-57d8-4881-9dbe-1c9968520d62","Type":"ContainerStarted","Data":"878b68513f1198458655f7acba8a65290ba8b174d0330080df282a0409ed159f"} Jun 08 12:55:33.485314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:33.485279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" event={"ID":"df42a2b5-57d8-4881-9dbe-1c9968520d62","Type":"ContainerStarted","Data":"2abfac42fd16a13d93804959498426560e09f3bbef327b3f195d5f9598390606"} Jun 08 12:55:34.204458 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:34.204426 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:34.304914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:34.304878 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:36.092447 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.092411 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:36.170671 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.170621 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4p4sx" podStartSLOduration=4.223324532 podStartE2EDuration="7.17060415s" totalImagesPullingTime="2.947279618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:33.502377594 +0000 UTC m=+248.846801874" watchObservedRunningTime="2026-06-08 12:55:36.17060415 +0000 UTC m=+251.515028411" Jun 08 12:55:36.172128 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.172107 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8"] Jun 08 12:55:36.193510 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.193487 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8"] Jun 08 12:55:36.193636 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.193609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.196534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.196498 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:55:36.196702 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.196687 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:55:36.197562 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.197543 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:55:36.251250 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.251219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.251392 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.251276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rkl\" (UniqueName: \"kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.251392 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.251334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.351774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.351712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.351774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.351756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rkl\" (UniqueName: \"kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.351941 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.351779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.352127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.352106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.352194 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.352128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.360230 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.360209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rkl\" (UniqueName: \"kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.503112 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.503084 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:36.545342 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.545313 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-wm4q2"] Jun 08 12:55:36.578088 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.578050 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wm4q2"] Jun 08 12:55:36.578259 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.578170 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.580481 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.580455 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lnt56\"" Jun 08 12:55:36.649193 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.649170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8"] Jun 08 12:55:36.651510 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:36.651479 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a65897d_fbd2_42cb_a829_1790672bef00.slice/crio-4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1 WatchSource:0}: Error finding container 4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1: Status 404 returned error can't find the container with id 4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1 Jun 08 12:55:36.653473 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.653451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7sb\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-kube-api-access-ln7sb\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.653585 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.653506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-bound-sa-token\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.754369 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.754345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-bound-sa-token\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.754476 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.754420 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7sb\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-kube-api-access-ln7sb\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.762473 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.762450 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-bound-sa-token\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.762633 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.762615 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7sb\" (UniqueName: \"kubernetes.io/projected/aa65d665-1a2d-4d7c-8795-96e2eb32094b-kube-api-access-ln7sb\") pod \"cert-manager-59c77684cc-wm4q2\" (UID: \"aa65d665-1a2d-4d7c-8795-96e2eb32094b\") " pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:36.889933 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:36.889907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wm4q2" Jun 08 12:55:37.024934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.024910 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wm4q2"] Jun 08 12:55:37.026999 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:37.026970 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa65d665_1a2d_4d7c_8795_96e2eb32094b.slice/crio-fb2f544c327458fb89c80fa151c122a8a5f43c9d3ccb22a35eac7ac711754b6b WatchSource:0}: Error finding container fb2f544c327458fb89c80fa151c122a8a5f43c9d3ccb22a35eac7ac711754b6b: Status 404 returned error can't find the container with id fb2f544c327458fb89c80fa151c122a8a5f43c9d3ccb22a35eac7ac711754b6b Jun 08 12:55:37.504103 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.504050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wm4q2" event={"ID":"aa65d665-1a2d-4d7c-8795-96e2eb32094b","Type":"ContainerStarted","Data":"ad9d3f8395c5161e405f92cf7ac039f5f73daf10413a9ba56edf69c03f222aff"} Jun 08 12:55:37.504103 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.504105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wm4q2" event={"ID":"aa65d665-1a2d-4d7c-8795-96e2eb32094b","Type":"ContainerStarted","Data":"fb2f544c327458fb89c80fa151c122a8a5f43c9d3ccb22a35eac7ac711754b6b"} Jun 08 12:55:37.505454 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.505429 2568 generic.go:356] "Generic (PLEG): container finished" podID="2a65897d-fbd2-42cb-a829-1790672bef00" containerID="d770a829a1dad5fc3ed7e492410a811198f33075a8a79b1130de0dac77197cc8" exitCode=0 Jun 08 12:55:37.505582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.505504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" event={"ID":"2a65897d-fbd2-42cb-a829-1790672bef00","Type":"ContainerDied","Data":"d770a829a1dad5fc3ed7e492410a811198f33075a8a79b1130de0dac77197cc8"} Jun 08 12:55:37.505582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.505563 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" event={"ID":"2a65897d-fbd2-42cb-a829-1790672bef00","Type":"ContainerStarted","Data":"4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1"} Jun 08 12:55:37.520612 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:37.520568 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-wm4q2" podStartSLOduration=1.52055382 podStartE2EDuration="1.52055382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:37.5194676 +0000 UTC m=+252.863891878" watchObservedRunningTime="2026-06-08 12:55:37.52055382 +0000 UTC m=+252.864978096" Jun 08 12:55:38.511789 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:38.511756 2568 generic.go:356] "Generic (PLEG): container finished" podID="2a65897d-fbd2-42cb-a829-1790672bef00" containerID="c98cb207086cad9ae9dc81fbd418ca58e32d8f8d8b885ef5b20b15d1e6501432" exitCode=0 Jun 08 12:55:38.512228 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:38.511846 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" event={"ID":"2a65897d-fbd2-42cb-a829-1790672bef00","Type":"ContainerDied","Data":"c98cb207086cad9ae9dc81fbd418ca58e32d8f8d8b885ef5b20b15d1e6501432"} Jun 08 12:55:39.518014 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:39.517981 2568 generic.go:356] "Generic (PLEG): container finished" podID="2a65897d-fbd2-42cb-a829-1790672bef00" containerID="52bd28f61a7ad241de8f55877c21bc9309b1d63c547f54e27cc025e228db8231" exitCode=0 Jun 08 12:55:39.518460 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:39.518056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" event={"ID":"2a65897d-fbd2-42cb-a829-1790672bef00","Type":"ContainerDied","Data":"52bd28f61a7ad241de8f55877c21bc9309b1d63c547f54e27cc025e228db8231"} Jun 08 12:55:40.652525 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.652490 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:40.684607 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.684581 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle\") pod \"2a65897d-fbd2-42cb-a829-1790672bef00\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " Jun 08 12:55:40.684744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.684618 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89rkl\" (UniqueName: \"kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl\") pod \"2a65897d-fbd2-42cb-a829-1790672bef00\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " Jun 08 12:55:40.684744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.684675 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util\") pod \"2a65897d-fbd2-42cb-a829-1790672bef00\" (UID: \"2a65897d-fbd2-42cb-a829-1790672bef00\") " Jun 08 12:55:40.685344 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.685313 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle" (OuterVolumeSpecName: "bundle") pod "2a65897d-fbd2-42cb-a829-1790672bef00" (UID: "2a65897d-fbd2-42cb-a829-1790672bef00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:40.686683 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.686655 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl" (OuterVolumeSpecName: "kube-api-access-89rkl") pod "2a65897d-fbd2-42cb-a829-1790672bef00" (UID: "2a65897d-fbd2-42cb-a829-1790672bef00"). InnerVolumeSpecName "kube-api-access-89rkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:55:40.689955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.689932 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util" (OuterVolumeSpecName: "util") pod "2a65897d-fbd2-42cb-a829-1790672bef00" (UID: "2a65897d-fbd2-42cb-a829-1790672bef00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:55:40.785651 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.785594 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:40.785651 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.785614 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89rkl\" (UniqueName: \"kubernetes.io/projected/2a65897d-fbd2-42cb-a829-1790672bef00-kube-api-access-89rkl\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:40.785651 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:40.785625 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a65897d-fbd2-42cb-a829-1790672bef00-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:55:41.528703 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:41.528615 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" Jun 08 12:55:41.528703 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:41.528628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdd98f8" event={"ID":"2a65897d-fbd2-42cb-a829-1790672bef00","Type":"ContainerDied","Data":"4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1"} Jun 08 12:55:41.528703 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:41.528677 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e92d609b8eaa5717cb8e420840b9e39ef1989a0332df5dfe2fd67224f3a71a1" Jun 08 12:55:51.866572 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:51.866475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:52.016753 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.016717 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:52.497756 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.497719 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:52.780992 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.780903 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:52.879092 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.879056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:52.958721 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.958693 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644"] Jun 08 12:55:52.959048 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959035 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="extract" Jun 08 12:55:52.959090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959049 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="extract" Jun 08 12:55:52.959090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959062 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="util" Jun 08 12:55:52.959090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959068 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="util" Jun 08 12:55:52.959090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959074 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="pull" Jun 08 12:55:52.959090 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959080 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="pull" Jun 08 12:55:52.959243 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.959129 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a65897d-fbd2-42cb-a829-1790672bef00" containerName="extract" Jun 08 12:55:52.962208 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.962168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:52.966169 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.966149 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:55:52.966301 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.966267 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:55:52.966360 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.966295 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:55:52.968478 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.968460 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k5jxm\"" Jun 08 12:55:52.974636 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.974620 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:55:52.985028 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:52.985006 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644"] Jun 08 12:55:53.088095 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.088020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvlv\" (UniqueName: \"kubernetes.io/projected/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-kube-api-access-spvlv\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.088095 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.088053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.088095 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.088075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.088295 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.088159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.088295 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.088268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.105595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.105564 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:53.188911 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.188876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.189063 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.188922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvlv\" (UniqueName: \"kubernetes.io/projected/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-kube-api-access-spvlv\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.189118 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.189050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.189118 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.189093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.189221 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.189140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.189437 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.189418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.191213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.191193 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.191367 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.191347 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.191409 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.191399 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.198312 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.198258 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvlv\" (UniqueName: \"kubernetes.io/projected/6c75ab85-01ff-4b33-b23e-b8c40eb1f632-kube-api-access-spvlv\") pod \"opendatahub-operator-controller-manager-85bcc7b555-rp644\" (UID: \"6c75ab85-01ff-4b33-b23e-b8c40eb1f632\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.205784 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.205743 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:53.272789 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.272740 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:53.303893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.303832 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:53.418275 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.418247 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644"] Jun 08 12:55:53.420803 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:55:53.420777 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c75ab85_01ff_4b33_b23e_b8c40eb1f632.slice/crio-05ead770c376ac3a8d0a1976abf3e435e039b79e0c9fb55e686ffd82fd914c2c WatchSource:0}: Error finding container 05ead770c376ac3a8d0a1976abf3e435e039b79e0c9fb55e686ffd82fd914c2c: Status 404 returned error can't find the container with id 05ead770c376ac3a8d0a1976abf3e435e039b79e0c9fb55e686ffd82fd914c2c Jun 08 12:55:53.429488 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.429459 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:53.494105 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.494073 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:53.590452 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.590416 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" event={"ID":"6c75ab85-01ff-4b33-b23e-b8c40eb1f632","Type":"ContainerStarted","Data":"05ead770c376ac3a8d0a1976abf3e435e039b79e0c9fb55e686ffd82fd914c2c"} Jun 08 12:55:53.594156 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:53.594129 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:55:56.608154 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:56.608065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" event={"ID":"6c75ab85-01ff-4b33-b23e-b8c40eb1f632","Type":"ContainerStarted","Data":"e651fff869fa8e7e7d904b99fdfcc2a38503689ccb54b03f8474ed3f586e317a"} Jun 08 12:55:57.614248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:57.614157 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c75ab85-01ff-4b33-b23e-b8c40eb1f632" containerID="e651fff869fa8e7e7d904b99fdfcc2a38503689ccb54b03f8474ed3f586e317a" exitCode=0 Jun 08 12:55:57.614248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:57.614230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" event={"ID":"6c75ab85-01ff-4b33-b23e-b8c40eb1f632","Type":"ContainerDied","Data":"e651fff869fa8e7e7d904b99fdfcc2a38503689ccb54b03f8474ed3f586e317a"} Jun 08 12:55:58.622955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:58.622914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" event={"ID":"6c75ab85-01ff-4b33-b23e-b8c40eb1f632","Type":"ContainerStarted","Data":"1265132601f7758e6acd28424a326afdac701cc2239591ec23492fd0aba60c1d"} Jun 08 12:55:58.623354 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:58.623001 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:55:58.679023 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:55:58.678973 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" podStartSLOduration=2.633790703 podStartE2EDuration="6.678959228s" totalImagesPullingTime="3.091433392s" totalInitContainerRuntime="953.735133ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:58.675358869 +0000 UTC m=+274.019783185" watchObservedRunningTime="2026-06-08 12:55:58.678959228 +0000 UTC m=+274.023383507" Jun 08 12:56:00.312676 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:00.312618 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:00.420609 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:00.420575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:09.629955 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:09.629922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-rp644" Jun 08 12:56:11.777008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:11.776972 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:12.539016 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.538987 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fpn2r"] Jun 08 12:56:12.547434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.547410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.549767 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.549743 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 12:56:12.549997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.549963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lzdsj\"" Jun 08 12:56:12.558983 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.558960 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fpn2r"] Jun 08 12:56:12.662767 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.662733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.662921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.662847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twrms\" (UniqueName: \"kubernetes.io/projected/722eb6f8-4a39-4cf9-a106-c7dbab16f176-kube-api-access-twrms\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.763885 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.763848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twrms\" (UniqueName: \"kubernetes.io/projected/722eb6f8-4a39-4cf9-a106-c7dbab16f176-kube-api-access-twrms\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.763885 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.763903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.764161 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:56:12.764016 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 12:56:12.764161 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:56:12.764076 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert podName:722eb6f8-4a39-4cf9-a106-c7dbab16f176 nodeName:}" failed. No retries permitted until 2026-06-08 12:56:13.26405992 +0000 UTC m=+288.608484178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert") pod "odh-model-controller-6dc94f689f-fpn2r" (UID: "722eb6f8-4a39-4cf9-a106-c7dbab16f176") : secret "odh-model-controller-webhook-cert" not found Jun 08 12:56:12.775175 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.775150 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twrms\" (UniqueName: \"kubernetes.io/projected/722eb6f8-4a39-4cf9-a106-c7dbab16f176-kube-api-access-twrms\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:12.935059 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:12.935018 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:13.038400 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.038361 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:13.150419 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.150385 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:13.268263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.268168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:13.270585 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.270560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/722eb6f8-4a39-4cf9-a106-c7dbab16f176-cert\") pod \"odh-model-controller-6dc94f689f-fpn2r\" (UID: \"722eb6f8-4a39-4cf9-a106-c7dbab16f176\") " pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:13.355416 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.355373 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:13.461028 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.460991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:13.609880 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.609852 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fpn2r"] Jun 08 12:56:13.612275 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:56:13.612248 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722eb6f8_4a39_4cf9_a106_c7dbab16f176.slice/crio-b24a96af193d9a8d4bc27afedee2ab4574ae3db5f849e259cfca662e8c813d27 WatchSource:0}: Error finding container b24a96af193d9a8d4bc27afedee2ab4574ae3db5f849e259cfca662e8c813d27: Status 404 returned error can't find the container with id b24a96af193d9a8d4bc27afedee2ab4574ae3db5f849e259cfca662e8c813d27 Jun 08 12:56:13.696320 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:13.696286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" event={"ID":"722eb6f8-4a39-4cf9-a106-c7dbab16f176","Type":"ContainerStarted","Data":"b24a96af193d9a8d4bc27afedee2ab4574ae3db5f849e259cfca662e8c813d27"} Jun 08 12:56:14.267379 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.267291 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq"] Jun 08 12:56:14.271331 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.271305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.273621 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.273599 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:56:14.273744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.273664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:56:14.273808 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.273672 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:56:14.278873 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.278848 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq"] Jun 08 12:56:14.380446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.380402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr92v\" (UniqueName: \"kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.380641 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.380472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.380641 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.380559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.481298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.481171 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr92v\" (UniqueName: \"kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.481298 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.481230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.481661 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.481387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.481723 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.481672 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.481852 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.481789 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.491234 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.491183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr92v\" (UniqueName: \"kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.585681 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.585583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:14.767346 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:14.767208 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq"] Jun 08 12:56:14.767750 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:56:14.767714 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd3d086_160c_48bf_9395_12353c5bd411.slice/crio-311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727 WatchSource:0}: Error finding container 311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727: Status 404 returned error can't find the container with id 311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727 Jun 08 12:56:15.712506 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:15.712204 2568 generic.go:356] "Generic (PLEG): container finished" podID="3cd3d086-160c-48bf-9395-12353c5bd411" containerID="37427e5af8b1f45c562645ba7a17c63b2062bffd49d36a0bdfce2ac0f07c5847" exitCode=0 Jun 08 12:56:15.712506 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:15.712251 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" event={"ID":"3cd3d086-160c-48bf-9395-12353c5bd411","Type":"ContainerDied","Data":"37427e5af8b1f45c562645ba7a17c63b2062bffd49d36a0bdfce2ac0f07c5847"} Jun 08 12:56:15.712506 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:15.712296 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" event={"ID":"3cd3d086-160c-48bf-9395-12353c5bd411","Type":"ContainerStarted","Data":"311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727"} Jun 08 12:56:16.719625 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:16.719584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" event={"ID":"722eb6f8-4a39-4cf9-a106-c7dbab16f176","Type":"ContainerStarted","Data":"d3c17d5c526f4d6673818014fce00a12460cb3f54d321d7971903b5b6e515c0d"} Jun 08 12:56:16.720152 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:16.719803 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:16.722066 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:16.722035 2568 generic.go:356] "Generic (PLEG): container finished" podID="3cd3d086-160c-48bf-9395-12353c5bd411" containerID="efe3e109bbbc30d187bdc3a0d738a9b7d48d55ca0544552577f45ab30c9362ac" exitCode=0 Jun 08 12:56:16.722194 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:16.722078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" event={"ID":"3cd3d086-160c-48bf-9395-12353c5bd411","Type":"ContainerDied","Data":"efe3e109bbbc30d187bdc3a0d738a9b7d48d55ca0544552577f45ab30c9362ac"} Jun 08 12:56:16.735747 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:16.735423 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" podStartSLOduration=2.115565678 podStartE2EDuration="4.735404512s" totalImagesPullingTime="2.619838834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:16.734803509 +0000 UTC m=+292.079227792" watchObservedRunningTime="2026-06-08 12:56:16.735404512 +0000 UTC m=+292.079828794" Jun 08 12:56:17.730015 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:17.729977 2568 generic.go:356] "Generic (PLEG): container finished" podID="3cd3d086-160c-48bf-9395-12353c5bd411" containerID="b91e4a9db8c783e92b4d763481186a9a229e8e5cf864dab1a7d37c01010a25c2" exitCode=0 Jun 08 12:56:17.730431 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:17.730051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" event={"ID":"3cd3d086-160c-48bf-9395-12353c5bd411","Type":"ContainerDied","Data":"b91e4a9db8c783e92b4d763481186a9a229e8e5cf864dab1a7d37c01010a25c2"} Jun 08 12:56:18.880950 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:18.880921 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:19.026599 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.026486 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr92v\" (UniqueName: \"kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v\") pod \"3cd3d086-160c-48bf-9395-12353c5bd411\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " Jun 08 12:56:19.026599 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.026564 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle\") pod \"3cd3d086-160c-48bf-9395-12353c5bd411\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " Jun 08 12:56:19.026825 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.026636 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util\") pod \"3cd3d086-160c-48bf-9395-12353c5bd411\" (UID: \"3cd3d086-160c-48bf-9395-12353c5bd411\") " Jun 08 12:56:19.027392 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.027367 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle" (OuterVolumeSpecName: "bundle") pod "3cd3d086-160c-48bf-9395-12353c5bd411" (UID: "3cd3d086-160c-48bf-9395-12353c5bd411"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:56:19.028685 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.028658 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v" (OuterVolumeSpecName: "kube-api-access-rr92v") pod "3cd3d086-160c-48bf-9395-12353c5bd411" (UID: "3cd3d086-160c-48bf-9395-12353c5bd411"). InnerVolumeSpecName "kube-api-access-rr92v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:56:19.034198 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.034168 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util" (OuterVolumeSpecName: "util") pod "3cd3d086-160c-48bf-9395-12353c5bd411" (UID: "3cd3d086-160c-48bf-9395-12353c5bd411"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:56:19.127774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.127738 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr92v\" (UniqueName: \"kubernetes.io/projected/3cd3d086-160c-48bf-9395-12353c5bd411-kube-api-access-rr92v\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:19.127774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.127766 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:19.127774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.127775 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd3d086-160c-48bf-9395-12353c5bd411-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:19.742713 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.742676 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" event={"ID":"3cd3d086-160c-48bf-9395-12353c5bd411","Type":"ContainerDied","Data":"311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727"} Jun 08 12:56:19.743026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.743004 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311da671c41d5fc336ae6bae86a3e25bea090cb1da2167b31e5de1e1f8252727" Jun 08 12:56:19.743133 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.742695 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bd6rq" Jun 08 12:56:19.998898 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.998816 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h"] Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="extract" Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999151 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="extract" Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999164 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="pull" Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999170 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="pull" Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999185 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="util" Jun 08 12:56:19.999242 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999191 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="util" Jun 08 12:56:19.999441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:19.999250 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd3d086-160c-48bf-9395-12353c5bd411" containerName="extract" Jun 08 12:56:20.002291 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.002271 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.005013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.004977 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 12:56:20.005138 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.005016 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 12:56:20.005138 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.005037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-757jz\"" Jun 08 12:56:20.005138 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.005065 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 12:56:20.011050 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.011027 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h"] Jun 08 12:56:20.033872 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.033841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/134c2152-f336-4bfa-afa6-695bbbe3ea56-manager-config\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.034044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.033894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-metrics-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.034044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.034002 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.034044 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.034033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xkz\" (UniqueName: \"kubernetes.io/projected/134c2152-f336-4bfa-afa6-695bbbe3ea56-kube-api-access-x2xkz\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.134683 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.134644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.134683 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.134683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xkz\" (UniqueName: \"kubernetes.io/projected/134c2152-f336-4bfa-afa6-695bbbe3ea56-kube-api-access-x2xkz\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.135012 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.134721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/134c2152-f336-4bfa-afa6-695bbbe3ea56-manager-config\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.135012 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.134751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-metrics-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.135461 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.135438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/134c2152-f336-4bfa-afa6-695bbbe3ea56-manager-config\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.137182 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.137161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-metrics-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.137311 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.137291 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134c2152-f336-4bfa-afa6-695bbbe3ea56-cert\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.147812 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.147785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xkz\" (UniqueName: \"kubernetes.io/projected/134c2152-f336-4bfa-afa6-695bbbe3ea56-kube-api-access-x2xkz\") pod \"lws-controller-manager-7f48cfb98d-6dr6h\" (UID: \"134c2152-f336-4bfa-afa6-695bbbe3ea56\") " pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.312413 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.312309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:20.453183 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.453155 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h"] Jun 08 12:56:20.455495 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:56:20.455462 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134c2152_f336_4bfa_afa6_695bbbe3ea56.slice/crio-9c37114942625b1a6ca2413facc992c434b7df8fa7d6f3087251e1bf7e6f832e WatchSource:0}: Error finding container 9c37114942625b1a6ca2413facc992c434b7df8fa7d6f3087251e1bf7e6f832e: Status 404 returned error can't find the container with id 9c37114942625b1a6ca2413facc992c434b7df8fa7d6f3087251e1bf7e6f832e Jun 08 12:56:20.749433 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:20.749396 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" event={"ID":"134c2152-f336-4bfa-afa6-695bbbe3ea56","Type":"ContainerStarted","Data":"9c37114942625b1a6ca2413facc992c434b7df8fa7d6f3087251e1bf7e6f832e"} Jun 08 12:56:22.762555 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:22.762497 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" event={"ID":"134c2152-f336-4bfa-afa6-695bbbe3ea56","Type":"ContainerStarted","Data":"a8cb4f9e56d5b140da0a142ae45872b4a6c554883ec05462599be6d0c442531b"} Jun 08 12:56:22.763008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:22.762576 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:22.816005 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:22.815948 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" podStartSLOduration=2.218913253 podStartE2EDuration="3.81593008s" totalImagesPullingTime="1.597016827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:22.815859433 +0000 UTC m=+298.160283713" watchObservedRunningTime="2026-06-08 12:56:22.81593008 +0000 UTC m=+298.160354360" Jun 08 12:56:23.269881 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:23.269847 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:23.400229 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:23.400192 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:23.772426 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:23.772120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:24.011120 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:24.011078 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:24.557426 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:24.557386 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:24.658638 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:24.658582 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:25.103614 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:25.103589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 12:56:25.104021 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:25.103589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 12:56:25.115100 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:25.115075 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:56:27.337601 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:27.337566 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:27.473281 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:27.473246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:27.732409 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:27.732382 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-fpn2r" Jun 08 12:56:28.920177 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:28.920134 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:29.210099 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:29.210011 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:29.519404 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:29.519316 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:30.052943 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.052907 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:30.199549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.199493 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd"] Jun 08 12:56:30.207937 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.207911 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.210753 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.210732 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:56:30.210873 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.210736 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:56:30.211331 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.211315 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:56:30.216717 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.216696 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd"] Jun 08 12:56:30.222375 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.222352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj65r\" (UniqueName: \"kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.222490 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.222402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.222490 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.222422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.323729 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.323642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj65r\" (UniqueName: \"kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.323921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.323786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.323921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.323833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.324280 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.324261 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.324323 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.324258 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.335190 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.335167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj65r\" (UniqueName: \"kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.519095 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.519060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:30.657015 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.656987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd"] Jun 08 12:56:30.658919 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:56:30.658890 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfde2d8b_92b4_4498_9269_b13d79979337.slice/crio-26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d WatchSource:0}: Error finding container 26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d: Status 404 returned error can't find the container with id 26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d Jun 08 12:56:30.812213 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.812179 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfde2d8b-92b4-4498-9269-b13d79979337" containerID="e3e333c5af6bd2683b55206aaeac5f2e3c426011e44e387402c3b1d170b657eb" exitCode=0 Jun 08 12:56:30.812378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.812267 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" event={"ID":"bfde2d8b-92b4-4498-9269-b13d79979337","Type":"ContainerDied","Data":"e3e333c5af6bd2683b55206aaeac5f2e3c426011e44e387402c3b1d170b657eb"} Jun 08 12:56:30.812378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.812325 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" event={"ID":"bfde2d8b-92b4-4498-9269-b13d79979337","Type":"ContainerStarted","Data":"26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d"} Jun 08 12:56:30.813271 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:30.813255 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:56:31.311196 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:31.311160 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:32.825045 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:32.825004 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfde2d8b-92b4-4498-9269-b13d79979337" containerID="25f956da698ca4f47100a5cf7a3243ecec96555cc8ce23f638b8eaff572c35eb" exitCode=0 Jun 08 12:56:32.825445 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:32.825091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" event={"ID":"bfde2d8b-92b4-4498-9269-b13d79979337","Type":"ContainerDied","Data":"25f956da698ca4f47100a5cf7a3243ecec96555cc8ce23f638b8eaff572c35eb"} Jun 08 12:56:33.770396 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:33.770366 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f48cfb98d-6dr6h" Jun 08 12:56:33.832916 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:33.832879 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfde2d8b-92b4-4498-9269-b13d79979337" containerID="67e9e6a95775ce3e5cc946d51509fc3124765b8aec3e385d2152feffa6c206f8" exitCode=0 Jun 08 12:56:33.833387 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:33.832977 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" event={"ID":"bfde2d8b-92b4-4498-9269-b13d79979337","Type":"ContainerDied","Data":"67e9e6a95775ce3e5cc946d51509fc3124765b8aec3e385d2152feffa6c206f8"} Jun 08 12:56:34.974944 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:34.974912 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:35.069029 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.068995 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle\") pod \"bfde2d8b-92b4-4498-9269-b13d79979337\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " Jun 08 12:56:35.069209 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.069089 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj65r\" (UniqueName: \"kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r\") pod \"bfde2d8b-92b4-4498-9269-b13d79979337\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " Jun 08 12:56:35.069209 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.069115 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util\") pod \"bfde2d8b-92b4-4498-9269-b13d79979337\" (UID: \"bfde2d8b-92b4-4498-9269-b13d79979337\") " Jun 08 12:56:35.070251 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.070212 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle" (OuterVolumeSpecName: "bundle") pod "bfde2d8b-92b4-4498-9269-b13d79979337" (UID: "bfde2d8b-92b4-4498-9269-b13d79979337"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:56:35.071274 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.071252 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r" (OuterVolumeSpecName: "kube-api-access-rj65r") pod "bfde2d8b-92b4-4498-9269-b13d79979337" (UID: "bfde2d8b-92b4-4498-9269-b13d79979337"). InnerVolumeSpecName "kube-api-access-rj65r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:56:35.074800 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.074779 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util" (OuterVolumeSpecName: "util") pod "bfde2d8b-92b4-4498-9269-b13d79979337" (UID: "bfde2d8b-92b4-4498-9269-b13d79979337"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:56:35.169844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.169803 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:35.169844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.169844 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj65r\" (UniqueName: \"kubernetes.io/projected/bfde2d8b-92b4-4498-9269-b13d79979337-kube-api-access-rj65r\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:35.170041 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.169859 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfde2d8b-92b4-4498-9269-b13d79979337-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:56:35.845806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.845779 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" Jun 08 12:56:35.845806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.845792 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adqrjd" event={"ID":"bfde2d8b-92b4-4498-9269-b13d79979337","Type":"ContainerDied","Data":"26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d"} Jun 08 12:56:35.846031 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:35.845879 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26fe4d7503ccd4924536d9356f9871e035196de83c0619eeaf0607cff140941d" Jun 08 12:56:40.200450 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:40.200410 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:41.639604 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:41.639562 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:41.739543 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:41.739466 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:42.740076 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740038 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg"] Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740397 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="util" Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740408 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="util" Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740423 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="extract" Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740429 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="extract" Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740438 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="pull" Jun 08 12:56:42.740474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740444 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="pull" Jun 08 12:56:42.740722 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.740532 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfde2d8b-92b4-4498-9269-b13d79979337" containerName="extract" Jun 08 12:56:42.744997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.744979 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.747757 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.747732 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 12:56:42.747896 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.747815 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5ppng\"" Jun 08 12:56:42.754300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.754270 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg"] Jun 08 12:56:42.773642 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.773602 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:42.841472 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.841440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8cfd04d3-e751-453f-bd34-cbd91a4918f1-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.841472 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.841474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ngn\" (UniqueName: \"kubernetes.io/projected/8cfd04d3-e751-453f-bd34-cbd91a4918f1-kube-api-access-c8ngn\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.942613 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.942573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8cfd04d3-e751-453f-bd34-cbd91a4918f1-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.942792 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.942621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ngn\" (UniqueName: \"kubernetes.io/projected/8cfd04d3-e751-453f-bd34-cbd91a4918f1-kube-api-access-c8ngn\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.943278 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.943247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8cfd04d3-e751-453f-bd34-cbd91a4918f1-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:42.950739 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:42.950715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ngn\" (UniqueName: \"kubernetes.io/projected/8cfd04d3-e751-453f-bd34-cbd91a4918f1-kube-api-access-c8ngn\") pod \"dashboard-redirect-9d8bf5dcd-jc2rg\" (UID: \"8cfd04d3-e751-453f-bd34-cbd91a4918f1\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:43.057184 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:43.057099 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" Jun 08 12:56:43.190880 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:43.190853 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg"] Jun 08 12:56:43.192310 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:56:43.192281 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cfd04d3_e751_453f_bd34_cbd91a4918f1.slice/crio-960df4c6eedb217517beb6e07f6dc393f69d2e0972af383d44b078393608459b WatchSource:0}: Error finding container 960df4c6eedb217517beb6e07f6dc393f69d2e0972af383d44b078393608459b: Status 404 returned error can't find the container with id 960df4c6eedb217517beb6e07f6dc393f69d2e0972af383d44b078393608459b Jun 08 12:56:43.894748 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:43.894712 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" event={"ID":"8cfd04d3-e751-453f-bd34-cbd91a4918f1","Type":"ContainerStarted","Data":"960df4c6eedb217517beb6e07f6dc393f69d2e0972af383d44b078393608459b"} Jun 08 12:56:45.907925 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:45.907889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" event={"ID":"8cfd04d3-e751-453f-bd34-cbd91a4918f1","Type":"ContainerStarted","Data":"d9a2da49dd08969662bc7d66a9689b85aa49a04cf0ee431cf40e7ebed92c9775"} Jun 08 12:56:45.923051 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:45.922994 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-9d8bf5dcd-jc2rg" podStartSLOduration=1.78097364 podStartE2EDuration="3.92297886s" totalImagesPullingTime="2.14200522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:45.92244208 +0000 UTC m=+321.266866359" watchObservedRunningTime="2026-06-08 12:56:45.92297886 +0000 UTC m=+321.267403139" Jun 08 12:56:59.855641 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:59.855603 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:56:59.963703 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:56:59.963657 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:00.536011 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:00.535967 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:03.762886 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:03.762848 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:03.819647 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:03.819607 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:04.029814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.029739 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69"] Jun 08 12:57:04.037530 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.037491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.039830 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.039805 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 12:57:04.039942 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.039831 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vngsk\"" Jun 08 12:57:04.046574 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.046547 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69"] Jun 08 12:57:04.063317 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.063279 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:04.132403 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132403 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjnbz\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-kube-api-access-pjnbz\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.132806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.132725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234012 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.233968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjnbz\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-kube-api-access-pjnbz\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234119 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234222 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234587 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234587 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234587 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234559 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234565 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.234874 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.234785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.235053 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.235034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.236529 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.236503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.236967 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.236943 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.243286 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.243256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.243438 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.243420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjnbz\" (UniqueName: \"kubernetes.io/projected/209296d6-d9bc-4b1a-af9a-3e877b83dc90-kube-api-access-pjnbz\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc47z69\" (UID: \"209296d6-d9bc-4b1a-af9a-3e877b83dc90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.280931 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.280851 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:04.348683 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.348648 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:04.382423 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.382383 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:04.512079 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:04.512038 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69"] Jun 08 12:57:04.514415 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:04.514387 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209296d6_d9bc_4b1a_af9a_3e877b83dc90.slice/crio-f6a2a20e38c13fa02d52244893510b5c538cddeef96a9071b5da0e9882a31463 WatchSource:0}: Error finding container f6a2a20e38c13fa02d52244893510b5c538cddeef96a9071b5da0e9882a31463: Status 404 returned error can't find the container with id f6a2a20e38c13fa02d52244893510b5c538cddeef96a9071b5da0e9882a31463 Jun 08 12:57:05.011063 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:05.010966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" event={"ID":"209296d6-d9bc-4b1a-af9a-3e877b83dc90","Type":"ContainerStarted","Data":"f6a2a20e38c13fa02d52244893510b5c538cddeef96a9071b5da0e9882a31463"} Jun 08 12:57:05.946360 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:05.946325 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:08.110695 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:08.110650 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 12:57:08.110984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:08.110727 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 12:57:08.110984 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:08.110756 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 12:57:09.034765 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:09.034726 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" event={"ID":"209296d6-d9bc-4b1a-af9a-3e877b83dc90","Type":"ContainerStarted","Data":"54f3522e328a013f59290582a26a04278ea4f15c9ae86215e386816695b372f9"} Jun 08 12:57:09.059970 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:09.059920 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" podStartSLOduration=1.466165744 podStartE2EDuration="5.059903896s" totalImagesPullingTime="3.593738152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:09.057985281 +0000 UTC m=+344.402409562" watchObservedRunningTime="2026-06-08 12:57:09.059903896 +0000 UTC m=+344.404328255" Jun 08 12:57:09.349154 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:09.349059 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:09.353756 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:09.353731 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:10.039777 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:10.039748 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:10.040848 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:10.040828 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc47z69" Jun 08 12:57:13.443533 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.443474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:13.557502 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.557470 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:13.559056 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.559035 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:13.562486 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.562465 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:13.565924 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.565789 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:57:13.565924 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.565921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ctdz4\"" Jun 08 12:57:13.566131 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.565965 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:57:13.591585 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.591553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:13.621943 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.621913 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nd24\" (UniqueName: \"kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24\") pod \"kuadrant-operator-catalog-pfpz8\" (UID: \"4361f184-dd72-4624-b287-40fcad6afe63\") " pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:13.649041 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.649006 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:13.723378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.723286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nd24\" (UniqueName: \"kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24\") pod \"kuadrant-operator-catalog-pfpz8\" (UID: \"4361f184-dd72-4624-b287-40fcad6afe63\") " pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:13.737277 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.737253 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nd24\" (UniqueName: \"kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24\") pod \"kuadrant-operator-catalog-pfpz8\" (UID: \"4361f184-dd72-4624-b287-40fcad6afe63\") " pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:13.873180 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.873146 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:13.894712 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:13.894681 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:14.011099 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.011073 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:14.013307 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:14.013280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4361f184_dd72_4624_b287_40fcad6afe63.slice/crio-8202bd78dea817b801d4eba8e6b04bd3db9772812ad849fc8e2f4d469d3bcd54 WatchSource:0}: Error finding container 8202bd78dea817b801d4eba8e6b04bd3db9772812ad849fc8e2f4d469d3bcd54: Status 404 returned error can't find the container with id 8202bd78dea817b801d4eba8e6b04bd3db9772812ad849fc8e2f4d469d3bcd54 Jun 08 12:57:14.061378 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.061346 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" event={"ID":"4361f184-dd72-4624-b287-40fcad6afe63","Type":"ContainerStarted","Data":"8202bd78dea817b801d4eba8e6b04bd3db9772812ad849fc8e2f4d469d3bcd54"} Jun 08 12:57:14.103395 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.103361 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvtnt"] Jun 08 12:57:14.108036 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.108020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:14.114823 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.114801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvtnt"] Jun 08 12:57:14.127170 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.127136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmt8s\" (UniqueName: \"kubernetes.io/projected/afda5961-59e0-4d8e-833e-6dc095291c3a-kube-api-access-fmt8s\") pod \"kuadrant-operator-catalog-hvtnt\" (UID: \"afda5961-59e0-4d8e-833e-6dc095291c3a\") " pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:14.228483 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.228447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmt8s\" (UniqueName: \"kubernetes.io/projected/afda5961-59e0-4d8e-833e-6dc095291c3a-kube-api-access-fmt8s\") pod \"kuadrant-operator-catalog-hvtnt\" (UID: \"afda5961-59e0-4d8e-833e-6dc095291c3a\") " pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:14.237341 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.237304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmt8s\" (UniqueName: \"kubernetes.io/projected/afda5961-59e0-4d8e-833e-6dc095291c3a-kube-api-access-fmt8s\") pod \"kuadrant-operator-catalog-hvtnt\" (UID: \"afda5961-59e0-4d8e-833e-6dc095291c3a\") " pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:14.418723 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.418694 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:14.554650 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:14.554619 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvtnt"] Jun 08 12:57:14.556530 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:14.556489 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafda5961_59e0_4d8e_833e_6dc095291c3a.slice/crio-ad3575ab700c8557b7472aee1d6d36a5a6c4ea3c5f621c29ffd14d3d81566e3d WatchSource:0}: Error finding container ad3575ab700c8557b7472aee1d6d36a5a6c4ea3c5f621c29ffd14d3d81566e3d: Status 404 returned error can't find the container with id ad3575ab700c8557b7472aee1d6d36a5a6c4ea3c5f621c29ffd14d3d81566e3d Jun 08 12:57:15.068799 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:15.068752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" event={"ID":"afda5961-59e0-4d8e-833e-6dc095291c3a","Type":"ContainerStarted","Data":"ad3575ab700c8557b7472aee1d6d36a5a6c4ea3c5f621c29ffd14d3d81566e3d"} Jun 08 12:57:17.080683 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.080649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" event={"ID":"afda5961-59e0-4d8e-833e-6dc095291c3a","Type":"ContainerStarted","Data":"7c379a2d890f29f7c640c63e947cad63ecc8fa45a1b9afcbc9727ae48c97c2db"} Jun 08 12:57:17.082221 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.082188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" event={"ID":"4361f184-dd72-4624-b287-40fcad6afe63","Type":"ContainerStarted","Data":"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd"} Jun 08 12:57:17.082369 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.082193 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" podUID="4361f184-dd72-4624-b287-40fcad6afe63" containerName="registry-server" containerID="cri-o://8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd" gracePeriod=2 Jun 08 12:57:17.099933 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.099891 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" podStartSLOduration=1.5409357670000001 podStartE2EDuration="3.099876792s" totalImagesPullingTime="1.558941025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:17.098412819 +0000 UTC m=+352.442837113" watchObservedRunningTime="2026-06-08 12:57:17.099876792 +0000 UTC m=+352.444301082" Jun 08 12:57:17.116351 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.116305 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" podStartSLOduration=2.015314743 podStartE2EDuration="4.116291099s" totalImagesPullingTime="2.100976356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:17.114626591 +0000 UTC m=+352.459050856" watchObservedRunningTime="2026-06-08 12:57:17.116291099 +0000 UTC m=+352.460715378" Jun 08 12:57:17.330021 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.329997 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:17.360864 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.360790 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nd24\" (UniqueName: \"kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24\") pod \"4361f184-dd72-4624-b287-40fcad6afe63\" (UID: \"4361f184-dd72-4624-b287-40fcad6afe63\") " Jun 08 12:57:17.362888 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.362860 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24" (OuterVolumeSpecName: "kube-api-access-9nd24") pod "4361f184-dd72-4624-b287-40fcad6afe63" (UID: "4361f184-dd72-4624-b287-40fcad6afe63"). InnerVolumeSpecName "kube-api-access-9nd24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:57:17.461560 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:17.461505 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nd24\" (UniqueName: \"kubernetes.io/projected/4361f184-dd72-4624-b287-40fcad6afe63-kube-api-access-9nd24\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:18.088827 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.088792 2568 generic.go:356] "Generic (PLEG): container finished" podID="4361f184-dd72-4624-b287-40fcad6afe63" containerID="8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd" exitCode=0 Jun 08 12:57:18.089319 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.088860 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" Jun 08 12:57:18.089319 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.088885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" event={"ID":"4361f184-dd72-4624-b287-40fcad6afe63","Type":"ContainerDied","Data":"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd"} Jun 08 12:57:18.089319 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.088965 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pfpz8" event={"ID":"4361f184-dd72-4624-b287-40fcad6afe63","Type":"ContainerDied","Data":"8202bd78dea817b801d4eba8e6b04bd3db9772812ad849fc8e2f4d469d3bcd54"} Jun 08 12:57:18.089319 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.088992 2568 scope.go:117] "RemoveContainer" containerID="8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd" Jun 08 12:57:18.098307 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.098289 2568 scope.go:117] "RemoveContainer" containerID="8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd" Jun 08 12:57:18.098581 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:57:18.098563 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd\": container with ID starting with 8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd not found: ID does not exist" containerID="8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd" Jun 08 12:57:18.098661 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.098589 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd"} err="failed to get container status \"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd\": rpc error: code = NotFound desc = could not find container \"8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd\": container with ID starting with 8851e914ca38ff535b8a7d83239192bcaeb609486d98695f6df2482b673f1abd not found: ID does not exist" Jun 08 12:57:18.109970 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.109950 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:18.114418 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:18.114396 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pfpz8"] Jun 08 12:57:19.152110 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:19.152082 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4361f184-dd72-4624-b287-40fcad6afe63" path="/var/lib/kubelet/pods/4361f184-dd72-4624-b287-40fcad6afe63/volumes" Jun 08 12:57:24.419058 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:24.419023 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:24.419446 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:24.419108 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:24.441167 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:24.441141 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:25.152017 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:25.151996 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hvtnt" Jun 08 12:57:29.487060 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.487023 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555"] Jun 08 12:57:29.487428 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.487393 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4361f184-dd72-4624-b287-40fcad6afe63" containerName="registry-server" Jun 08 12:57:29.487428 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.487408 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4361f184-dd72-4624-b287-40fcad6afe63" containerName="registry-server" Jun 08 12:57:29.487504 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.487470 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4361f184-dd72-4624-b287-40fcad6afe63" containerName="registry-server" Jun 08 12:57:29.499100 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.499074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.499417 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.499395 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555"] Jun 08 12:57:29.501622 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.501602 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f7kbg\"" Jun 08 12:57:29.570294 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.570265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.570443 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.570315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.570443 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.570344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzp6\" (UniqueName: \"kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.670827 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.670801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.670997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.670848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.670997 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.670875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzp6\" (UniqueName: \"kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.671235 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.671212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.671299 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.671266 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.679199 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.679176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzp6\" (UniqueName: \"kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.809239 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.809175 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:29.941863 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:29.941831 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555"] Jun 08 12:57:29.943294 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:29.943265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c89b326_31bc_47f4_8851_7409d26779c0.slice/crio-4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5 WatchSource:0}: Error finding container 4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5: Status 404 returned error can't find the container with id 4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5 Jun 08 12:57:30.064611 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.064552 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr"] Jun 08 12:57:30.068313 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.068296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.075756 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.075735 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr"] Jun 08 12:57:30.152811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.152779 2568 generic.go:356] "Generic (PLEG): container finished" podID="8c89b326-31bc-47f4-8851-7409d26779c0" containerID="470a0fe7cf02f4e90d797fd52a83a4f9c4f71cc9ee27ab381479e3e5f37d453a" exitCode=0 Jun 08 12:57:30.152966 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.152869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" event={"ID":"8c89b326-31bc-47f4-8851-7409d26779c0","Type":"ContainerDied","Data":"470a0fe7cf02f4e90d797fd52a83a4f9c4f71cc9ee27ab381479e3e5f37d453a"} Jun 08 12:57:30.152966 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.152924 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" event={"ID":"8c89b326-31bc-47f4-8851-7409d26779c0","Type":"ContainerStarted","Data":"4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5"} Jun 08 12:57:30.175690 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.175667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.175806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.175715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpkw\" (UniqueName: \"kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.175806 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.175760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.276425 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.276397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.276564 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.276467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htpkw\" (UniqueName: \"kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.276564 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.276498 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.276880 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.276860 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.276941 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.276927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.284789 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.284761 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpkw\" (UniqueName: \"kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.405823 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.405804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:30.469135 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.469111 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k"] Jun 08 12:57:30.473923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.473905 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.478956 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.478933 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k"] Jun 08 12:57:30.543848 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.543824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr"] Jun 08 12:57:30.545871 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:30.545842 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519c3adb_d2a3_4282_920e_c1eedd260621.slice/crio-fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08 WatchSource:0}: Error finding container fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08: Status 404 returned error can't find the container with id fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08 Jun 08 12:57:30.580026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.579994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5x5\" (UniqueName: \"kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.580192 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.580046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.580192 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.580103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.681036 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.680963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5x5\" (UniqueName: \"kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.681036 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.681029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.681204 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.681059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.681369 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.681350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.681408 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.681383 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.689347 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.689319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5x5\" (UniqueName: \"kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.785746 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.785718 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:30.876537 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.872919 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z"] Jun 08 12:57:30.883996 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.883975 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:30.888605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.888556 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z"] Jun 08 12:57:30.968595 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.968572 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k"] Jun 08 12:57:30.984593 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.984570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:30.984686 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.984600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtx95\" (UniqueName: \"kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:30.984686 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:30.984623 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.012317 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:31.012287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d99dd0_6921_4f99_a1f9_152d352cc441.slice/crio-32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d WatchSource:0}: Error finding container 32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d: Status 404 returned error can't find the container with id 32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d Jun 08 12:57:31.085739 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.085708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.085909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.085750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtx95\" (UniqueName: \"kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.085909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.085782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.086130 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.086106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.086219 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.086176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.094486 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.094463 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtx95\" (UniqueName: \"kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.159710 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.159676 2568 generic.go:356] "Generic (PLEG): container finished" podID="519c3adb-d2a3-4282-920e-c1eedd260621" containerID="13c0b4cfd8802a1e965c63bc2521b3f31162db09ebe5f3f11f3fcf002b64227a" exitCode=0 Jun 08 12:57:31.159862 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.159724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" event={"ID":"519c3adb-d2a3-4282-920e-c1eedd260621","Type":"ContainerDied","Data":"13c0b4cfd8802a1e965c63bc2521b3f31162db09ebe5f3f11f3fcf002b64227a"} Jun 08 12:57:31.159862 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.159776 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" event={"ID":"519c3adb-d2a3-4282-920e-c1eedd260621","Type":"ContainerStarted","Data":"fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08"} Jun 08 12:57:31.161816 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.161782 2568 generic.go:356] "Generic (PLEG): container finished" podID="8c89b326-31bc-47f4-8851-7409d26779c0" containerID="0154e8b9138636ab7bede1b84d4c6f12c3bea97a10bd4391f0bbe115f0e1843d" exitCode=0 Jun 08 12:57:31.161918 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.161836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" event={"ID":"8c89b326-31bc-47f4-8851-7409d26779c0","Type":"ContainerDied","Data":"0154e8b9138636ab7bede1b84d4c6f12c3bea97a10bd4391f0bbe115f0e1843d"} Jun 08 12:57:31.163607 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.163581 2568 generic.go:356] "Generic (PLEG): container finished" podID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerID="bd0ae3ac094b2515b3455326e8379acdf732888fbaf5ce23a0f135dd92c600a1" exitCode=0 Jun 08 12:57:31.163719 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.163659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" event={"ID":"09d99dd0-6921-4f99-a1f9-152d352cc441","Type":"ContainerDied","Data":"bd0ae3ac094b2515b3455326e8379acdf732888fbaf5ce23a0f135dd92c600a1"} Jun 08 12:57:31.163719 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.163706 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" event={"ID":"09d99dd0-6921-4f99-a1f9-152d352cc441","Type":"ContainerStarted","Data":"32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d"} Jun 08 12:57:31.205785 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.205735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:31.358455 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:31.358429 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z"] Jun 08 12:57:31.359056 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:31.359025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c023ee_34a6_4b50_984e_c94cca4ae13e.slice/crio-23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5 WatchSource:0}: Error finding container 23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5: Status 404 returned error can't find the container with id 23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5 Jun 08 12:57:32.177358 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.177326 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerID="c1d993ee41a48414446823faf2356214f9db5beff7f15305afff7a8f404d862f" exitCode=0 Jun 08 12:57:32.177768 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.177401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" event={"ID":"e4c023ee-34a6-4b50-984e-c94cca4ae13e","Type":"ContainerDied","Data":"c1d993ee41a48414446823faf2356214f9db5beff7f15305afff7a8f404d862f"} Jun 08 12:57:32.177768 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.177477 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" event={"ID":"e4c023ee-34a6-4b50-984e-c94cca4ae13e","Type":"ContainerStarted","Data":"23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5"} Jun 08 12:57:32.179441 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.179415 2568 generic.go:356] "Generic (PLEG): container finished" podID="519c3adb-d2a3-4282-920e-c1eedd260621" containerID="a821b8addefb140212e54f63573ab433805447dae60bb97aad3e403a27eb8dcb" exitCode=0 Jun 08 12:57:32.179568 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.179502 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" event={"ID":"519c3adb-d2a3-4282-920e-c1eedd260621","Type":"ContainerDied","Data":"a821b8addefb140212e54f63573ab433805447dae60bb97aad3e403a27eb8dcb"} Jun 08 12:57:32.181923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.181892 2568 generic.go:356] "Generic (PLEG): container finished" podID="8c89b326-31bc-47f4-8851-7409d26779c0" containerID="3c8ce4fc53a9ea5e5d9b0cc591b79a1f945ad1d5a6b03a4281df6cc5cc733da6" exitCode=0 Jun 08 12:57:32.182026 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.181940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" event={"ID":"8c89b326-31bc-47f4-8851-7409d26779c0","Type":"ContainerDied","Data":"3c8ce4fc53a9ea5e5d9b0cc591b79a1f945ad1d5a6b03a4281df6cc5cc733da6"} Jun 08 12:57:32.184089 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.184065 2568 generic.go:356] "Generic (PLEG): container finished" podID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerID="4458bbc984a1949ddab491d9a9a2754ddf0b955ab2701bcc478bee2d2fb41675" exitCode=0 Jun 08 12:57:32.184195 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:32.184126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" event={"ID":"09d99dd0-6921-4f99-a1f9-152d352cc441","Type":"ContainerDied","Data":"4458bbc984a1949ddab491d9a9a2754ddf0b955ab2701bcc478bee2d2fb41675"} Jun 08 12:57:33.191421 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.191387 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerID="15b90bd2657117d582a3aedf35d7a5c933207b4c50da05f7c9f41435cc38c14a" exitCode=0 Jun 08 12:57:33.191833 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.191477 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" event={"ID":"e4c023ee-34a6-4b50-984e-c94cca4ae13e","Type":"ContainerDied","Data":"15b90bd2657117d582a3aedf35d7a5c933207b4c50da05f7c9f41435cc38c14a"} Jun 08 12:57:33.193701 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.193679 2568 generic.go:356] "Generic (PLEG): container finished" podID="519c3adb-d2a3-4282-920e-c1eedd260621" containerID="c7f4a493672c0d5b7de5ac90b55cecab5fb15d4a66e33eb0861b1c6f6e25772c" exitCode=0 Jun 08 12:57:33.193807 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.193768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" event={"ID":"519c3adb-d2a3-4282-920e-c1eedd260621","Type":"ContainerDied","Data":"c7f4a493672c0d5b7de5ac90b55cecab5fb15d4a66e33eb0861b1c6f6e25772c"} Jun 08 12:57:33.195880 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.195860 2568 generic.go:356] "Generic (PLEG): container finished" podID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerID="ba839e78e882ec9411b219d62449bdc807ca64cc26facc8291ebf2ba9136e623" exitCode=0 Jun 08 12:57:33.195977 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.195886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" event={"ID":"09d99dd0-6921-4f99-a1f9-152d352cc441","Type":"ContainerDied","Data":"ba839e78e882ec9411b219d62449bdc807ca64cc26facc8291ebf2ba9136e623"} Jun 08 12:57:33.336534 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.336493 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:33.409340 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.409314 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle\") pod \"8c89b326-31bc-47f4-8851-7409d26779c0\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " Jun 08 12:57:33.409498 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.409378 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzzp6\" (UniqueName: \"kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6\") pod \"8c89b326-31bc-47f4-8851-7409d26779c0\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " Jun 08 12:57:33.409498 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.409409 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util\") pod \"8c89b326-31bc-47f4-8851-7409d26779c0\" (UID: \"8c89b326-31bc-47f4-8851-7409d26779c0\") " Jun 08 12:57:33.409838 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.409811 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle" (OuterVolumeSpecName: "bundle") pod "8c89b326-31bc-47f4-8851-7409d26779c0" (UID: "8c89b326-31bc-47f4-8851-7409d26779c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:33.411429 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.411409 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6" (OuterVolumeSpecName: "kube-api-access-lzzp6") pod "8c89b326-31bc-47f4-8851-7409d26779c0" (UID: "8c89b326-31bc-47f4-8851-7409d26779c0"). InnerVolumeSpecName "kube-api-access-lzzp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:57:33.415014 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.414992 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util" (OuterVolumeSpecName: "util") pod "8c89b326-31bc-47f4-8851-7409d26779c0" (UID: "8c89b326-31bc-47f4-8851-7409d26779c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:33.510479 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.510399 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:33.510479 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.510426 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzzp6\" (UniqueName: \"kubernetes.io/projected/8c89b326-31bc-47f4-8851-7409d26779c0-kube-api-access-lzzp6\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:33.510479 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:33.510436 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c89b326-31bc-47f4-8851-7409d26779c0-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.203431 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.203393 2568 generic.go:356] "Generic (PLEG): container finished" podID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerID="7ce351a679f124c6bce98868802455d2e18e506b2332c73ac614fde8c752abba" exitCode=0 Jun 08 12:57:34.203840 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.203485 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" event={"ID":"e4c023ee-34a6-4b50-984e-c94cca4ae13e","Type":"ContainerDied","Data":"7ce351a679f124c6bce98868802455d2e18e506b2332c73ac614fde8c752abba"} Jun 08 12:57:34.205285 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.205260 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" event={"ID":"8c89b326-31bc-47f4-8851-7409d26779c0","Type":"ContainerDied","Data":"4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5"} Jun 08 12:57:34.205285 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.205285 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555" Jun 08 12:57:34.205454 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.205306 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4261a22844ff0c60a14db5bf18d6970e7d02258a4724b9a604f2a5412965f4d5" Jun 08 12:57:34.348604 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.348579 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:34.367086 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.367063 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:34.419754 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.419720 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt5x5\" (UniqueName: \"kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5\") pod \"09d99dd0-6921-4f99-a1f9-152d352cc441\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " Jun 08 12:57:34.419954 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.419841 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util\") pod \"09d99dd0-6921-4f99-a1f9-152d352cc441\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " Jun 08 12:57:34.419954 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.419933 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle\") pod \"09d99dd0-6921-4f99-a1f9-152d352cc441\" (UID: \"09d99dd0-6921-4f99-a1f9-152d352cc441\") " Jun 08 12:57:34.420489 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.420459 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle" (OuterVolumeSpecName: "bundle") pod "09d99dd0-6921-4f99-a1f9-152d352cc441" (UID: "09d99dd0-6921-4f99-a1f9-152d352cc441"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:34.422000 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.421980 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5" (OuterVolumeSpecName: "kube-api-access-qt5x5") pod "09d99dd0-6921-4f99-a1f9-152d352cc441" (UID: "09d99dd0-6921-4f99-a1f9-152d352cc441"). InnerVolumeSpecName "kube-api-access-qt5x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:57:34.426042 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.426018 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util" (OuterVolumeSpecName: "util") pod "09d99dd0-6921-4f99-a1f9-152d352cc441" (UID: "09d99dd0-6921-4f99-a1f9-152d352cc441"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:34.521248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521160 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle\") pod \"519c3adb-d2a3-4282-920e-c1eedd260621\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " Jun 08 12:57:34.521248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521214 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htpkw\" (UniqueName: \"kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw\") pod \"519c3adb-d2a3-4282-920e-c1eedd260621\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " Jun 08 12:57:34.521452 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521249 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util\") pod \"519c3adb-d2a3-4282-920e-c1eedd260621\" (UID: \"519c3adb-d2a3-4282-920e-c1eedd260621\") " Jun 08 12:57:34.521571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521549 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.521629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521573 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d99dd0-6921-4f99-a1f9-152d352cc441-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.521629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521588 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt5x5\" (UniqueName: \"kubernetes.io/projected/09d99dd0-6921-4f99-a1f9-152d352cc441-kube-api-access-qt5x5\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.521735 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.521708 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle" (OuterVolumeSpecName: "bundle") pod "519c3adb-d2a3-4282-920e-c1eedd260621" (UID: "519c3adb-d2a3-4282-920e-c1eedd260621"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:34.523371 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.523342 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw" (OuterVolumeSpecName: "kube-api-access-htpkw") pod "519c3adb-d2a3-4282-920e-c1eedd260621" (UID: "519c3adb-d2a3-4282-920e-c1eedd260621"). InnerVolumeSpecName "kube-api-access-htpkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:57:34.526933 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.526900 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util" (OuterVolumeSpecName: "util") pod "519c3adb-d2a3-4282-920e-c1eedd260621" (UID: "519c3adb-d2a3-4282-920e-c1eedd260621"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:34.622649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.622603 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.622649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.622643 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htpkw\" (UniqueName: \"kubernetes.io/projected/519c3adb-d2a3-4282-920e-c1eedd260621-kube-api-access-htpkw\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:34.622649 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:34.622656 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519c3adb-d2a3-4282-920e-c1eedd260621-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:35.211871 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.211843 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" Jun 08 12:57:35.212281 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.211866 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr" event={"ID":"519c3adb-d2a3-4282-920e-c1eedd260621","Type":"ContainerDied","Data":"fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08"} Jun 08 12:57:35.212281 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.211945 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe2e4268477d688d50bcec1f66c1598ea9adc7209ea1dd6b40391d831217ab08" Jun 08 12:57:35.213948 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.213916 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" event={"ID":"09d99dd0-6921-4f99-a1f9-152d352cc441","Type":"ContainerDied","Data":"32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d"} Jun 08 12:57:35.214067 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.213984 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32f545934f385c41b25e23a885e534bb78f9edf82a12eb2a44bea027a4fd168d" Jun 08 12:57:35.214067 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.213931 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k" Jun 08 12:57:35.349033 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.349009 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:35.429037 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.428945 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle\") pod \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " Jun 08 12:57:35.429037 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.429010 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtx95\" (UniqueName: \"kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95\") pod \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " Jun 08 12:57:35.429236 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.429043 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util\") pod \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\" (UID: \"e4c023ee-34a6-4b50-984e-c94cca4ae13e\") " Jun 08 12:57:35.429639 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.429611 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle" (OuterVolumeSpecName: "bundle") pod "e4c023ee-34a6-4b50-984e-c94cca4ae13e" (UID: "e4c023ee-34a6-4b50-984e-c94cca4ae13e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:35.431099 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.431080 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95" (OuterVolumeSpecName: "kube-api-access-jtx95") pod "e4c023ee-34a6-4b50-984e-c94cca4ae13e" (UID: "e4c023ee-34a6-4b50-984e-c94cca4ae13e"). InnerVolumeSpecName "kube-api-access-jtx95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:57:35.434351 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.434308 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util" (OuterVolumeSpecName: "util") pod "e4c023ee-34a6-4b50-984e-c94cca4ae13e" (UID: "e4c023ee-34a6-4b50-984e-c94cca4ae13e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:57:35.529893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.529857 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:35.529893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.529887 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtx95\" (UniqueName: \"kubernetes.io/projected/e4c023ee-34a6-4b50-984e-c94cca4ae13e-kube-api-access-jtx95\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:35.529893 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:35.529898 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c023ee-34a6-4b50-984e-c94cca4ae13e-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:57:36.221115 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:36.221088 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" Jun 08 12:57:36.221598 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:36.221089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z" event={"ID":"e4c023ee-34a6-4b50-984e-c94cca4ae13e","Type":"ContainerDied","Data":"23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5"} Jun 08 12:57:36.221598 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:36.221214 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23ce9e3f12df52736230de4a1bfdc6e7e125eb89a3880b7018bc9261ea89dbc5" Jun 08 12:57:42.832766 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:42.832725 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:45.510285 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510249 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4"] Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510680 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="util" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510694 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="util" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510708 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510714 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510724 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510730 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510736 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="pull" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510741 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="pull" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510749 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510754 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="extract" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510765 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="util" Jun 08 12:57:45.510764 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510770 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="util" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510776 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510781 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510789 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="util" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510794 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="util" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510802 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510806 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510813 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="extract" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510819 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="extract" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510825 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="util" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510830 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="util" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510838 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510843 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="pull" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510908 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c023ee-34a6-4b50-984e-c94cca4ae13e" containerName="extract" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510916 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d99dd0-6921-4f99-a1f9-152d352cc441" containerName="extract" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510924 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89b326-31bc-47f4-8851-7409d26779c0" containerName="extract" Jun 08 12:57:45.511127 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.510929 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="519c3adb-d2a3-4282-920e-c1eedd260621" containerName="extract" Jun 08 12:57:45.514033 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.514014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:45.516909 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.516886 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gvhph\"" Jun 08 12:57:45.524444 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.524417 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4"] Jun 08 12:57:45.622137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.622101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pj6\" (UniqueName: \"kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6\") pod \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" (UID: \"619bfca3-f485-4ff7-8387-97db93bb1897\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:45.722677 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.722643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pj6\" (UniqueName: \"kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6\") pod \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" (UID: \"619bfca3-f485-4ff7-8387-97db93bb1897\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:45.747211 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.747173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pj6\" (UniqueName: \"kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6\") pod \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" (UID: \"619bfca3-f485-4ff7-8387-97db93bb1897\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:45.824602 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.824481 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:45.971775 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:45.971747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4"] Jun 08 12:57:45.973580 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:45.973548 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619bfca3_f485_4ff7_8387_97db93bb1897.slice/crio-5b0a7645ebb20f01eeb6e70f210b55bf35d31d48f8216fb0fd4b415a8149c95a WatchSource:0}: Error finding container 5b0a7645ebb20f01eeb6e70f210b55bf35d31d48f8216fb0fd4b415a8149c95a: Status 404 returned error can't find the container with id 5b0a7645ebb20f01eeb6e70f210b55bf35d31d48f8216fb0fd4b415a8149c95a Jun 08 12:57:46.281297 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:46.281264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" event={"ID":"619bfca3-f485-4ff7-8387-97db93bb1897","Type":"ContainerStarted","Data":"5b0a7645ebb20f01eeb6e70f210b55bf35d31d48f8216fb0fd4b415a8149c95a"} Jun 08 12:57:46.456434 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:46.456404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:46.581318 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:46.581232 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:48.294699 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:48.294659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" event={"ID":"619bfca3-f485-4ff7-8387-97db93bb1897","Type":"ContainerStarted","Data":"2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda"} Jun 08 12:57:48.295183 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:48.294787 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:48.311017 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:48.310807 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" podStartSLOduration=1.431553788 podStartE2EDuration="3.310788854s" totalImagesPullingTime="1.879235066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:48.310398341 +0000 UTC m=+383.654822655" watchObservedRunningTime="2026-06-08 12:57:48.310788854 +0000 UTC m=+383.655213134" Jun 08 12:57:50.842899 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:50.842864 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:51.236579 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:51.236498 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:52.719540 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:52.719479 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:53.264968 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:53.264926 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:54.271719 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:54.271685 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:55.141527 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:55.141478 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:56.419436 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.419396 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x"] Jun 08 12:57:56.427840 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.427811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:56.430779 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.430745 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 12:57:56.430950 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.430745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s5dnx\"" Jun 08 12:57:56.433629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.433593 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x"] Jun 08 12:57:56.521961 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.521926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crwj4\" (UniqueName: \"kubernetes.io/projected/d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1-kube-api-access-crwj4\") pod \"dns-operator-controller-manager-864dd78c4c-5dw2x\" (UID: \"d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:56.622949 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.622905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwj4\" (UniqueName: \"kubernetes.io/projected/d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1-kube-api-access-crwj4\") pod \"dns-operator-controller-manager-864dd78c4c-5dw2x\" (UID: \"d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:56.652922 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.652887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crwj4\" (UniqueName: \"kubernetes.io/projected/d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1-kube-api-access-crwj4\") pod \"dns-operator-controller-manager-864dd78c4c-5dw2x\" (UID: \"d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:56.739744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.739651 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:56.875862 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:56.875835 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x"] Jun 08 12:57:56.877738 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:57:56.877711 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e404d0_5d7b_41fe_a3cb_659afc5ba9c1.slice/crio-231d5f2dda39db2aad97d520c50ddb69b1874bf80cec50e03b4f25d46bb563be WatchSource:0}: Error finding container 231d5f2dda39db2aad97d520c50ddb69b1874bf80cec50e03b4f25d46bb563be: Status 404 returned error can't find the container with id 231d5f2dda39db2aad97d520c50ddb69b1874bf80cec50e03b4f25d46bb563be Jun 08 12:57:57.103976 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:57.103887 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:57.353175 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:57.353137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" event={"ID":"d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1","Type":"ContainerStarted","Data":"231d5f2dda39db2aad97d520c50ddb69b1874bf80cec50e03b4f25d46bb563be"} Jun 08 12:57:58.435725 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:58.435690 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:58.535240 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:58.535202 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:57:59.303474 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:59.303434 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:57:59.368306 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:59.368270 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" event={"ID":"d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1","Type":"ContainerStarted","Data":"ee01be7e365051f6246ff2e117bf2aed4fb51619a1d34901ed3717b97a8464b6"} Jun 08 12:57:59.368503 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:59.368352 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:57:59.386191 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:57:59.386093 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" podStartSLOduration=1.133141975 podStartE2EDuration="3.386077548s" totalImagesPullingTime="2.252935573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:59.384485308 +0000 UTC m=+394.728909583" watchObservedRunningTime="2026-06-08 12:57:59.386077548 +0000 UTC m=+394.730501828" Jun 08 12:58:01.233927 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:01.233888 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:01.448008 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:01.447969 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:01.842745 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:01.842694 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:01.909621 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:01.909585 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:10.376675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:10.376647 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5dw2x" Jun 08 12:58:10.559371 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:10.559332 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:10.780136 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:10.780103 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:10.959218 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:10.959179 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:11.358729 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.358698 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4"] Jun 08 12:58:11.358998 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.358900 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" containerName="manager" containerID="cri-o://2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda" gracePeriod=2 Jun 08 12:58:11.375314 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.375247 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4"] Jun 08 12:58:11.406247 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.406211 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh"] Jun 08 12:58:11.406734 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.406613 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" containerName="manager" Jun 08 12:58:11.406734 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.406634 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" containerName="manager" Jun 08 12:58:11.406734 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.406730 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" containerName="manager" Jun 08 12:58:11.410176 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.410153 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:11.440414 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.440382 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh"] Jun 08 12:58:11.457824 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:11.457788 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" is forbidden: User \"system:node:ip-10-0-132-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-250.ec2.internal' and this object" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:11.464246 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.464217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb99k\" (UniqueName: \"kubernetes.io/projected/af6fe7c6-480e-4c1d-91de-325d7d4977c5-kube-api-access-wb99k\") pod \"limitador-operator-controller-manager-859d7b78bd-f2ldh\" (UID: \"af6fe7c6-480e-4c1d-91de-325d7d4977c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:11.566921 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.566876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb99k\" (UniqueName: \"kubernetes.io/projected/af6fe7c6-480e-4c1d-91de-325d7d4977c5-kube-api-access-wb99k\") pod \"limitador-operator-controller-manager-859d7b78bd-f2ldh\" (UID: \"af6fe7c6-480e-4c1d-91de-325d7d4977c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:11.587860 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.587829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb99k\" (UniqueName: \"kubernetes.io/projected/af6fe7c6-480e-4c1d-91de-325d7d4977c5-kube-api-access-wb99k\") pod \"limitador-operator-controller-manager-859d7b78bd-f2ldh\" (UID: \"af6fe7c6-480e-4c1d-91de-325d7d4977c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:11.623836 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.623768 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:11.626118 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:11.626087 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" is forbidden: User \"system:node:ip-10-0-132-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-250.ec2.internal' and this object" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:11.739689 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.739644 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:11.768781 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.768752 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2pj6\" (UniqueName: \"kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6\") pod \"619bfca3-f485-4ff7-8387-97db93bb1897\" (UID: \"619bfca3-f485-4ff7-8387-97db93bb1897\") " Jun 08 12:58:11.770740 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.770710 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6" (OuterVolumeSpecName: "kube-api-access-d2pj6") pod "619bfca3-f485-4ff7-8387-97db93bb1897" (UID: "619bfca3-f485-4ff7-8387-97db93bb1897"). InnerVolumeSpecName "kube-api-access-d2pj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:58:11.870316 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.870281 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2pj6\" (UniqueName: \"kubernetes.io/projected/619bfca3-f485-4ff7-8387-97db93bb1897-kube-api-access-d2pj6\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:58:11.933868 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:11.933833 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh"] Jun 08 12:58:11.935328 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:58:11.935296 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6fe7c6_480e_4c1d_91de_325d7d4977c5.slice/crio-f1d88fbf5162b37ab2158a29c4c9da4e9b22a1641ee8af50df6c57c178dfb75b WatchSource:0}: Error finding container f1d88fbf5162b37ab2158a29c4c9da4e9b22a1641ee8af50df6c57c178dfb75b: Status 404 returned error can't find the container with id f1d88fbf5162b37ab2158a29c4c9da4e9b22a1641ee8af50df6c57c178dfb75b Jun 08 12:58:12.447289 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.447252 2568 generic.go:356] "Generic (PLEG): container finished" podID="619bfca3-f485-4ff7-8387-97db93bb1897" containerID="2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda" exitCode=0 Jun 08 12:58:12.447771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.447305 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:12.447771 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.447361 2568 scope.go:117] "RemoveContainer" containerID="2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda" Jun 08 12:58:12.449238 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.449212 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" event={"ID":"af6fe7c6-480e-4c1d-91de-325d7d4977c5","Type":"ContainerStarted","Data":"8c8da3caee6e972a057773a0ad88f4bcb61b4ad000706363e00ee3993cc9e7fa"} Jun 08 12:58:12.449339 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.449264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" event={"ID":"af6fe7c6-480e-4c1d-91de-325d7d4977c5","Type":"ContainerStarted","Data":"f1d88fbf5162b37ab2158a29c4c9da4e9b22a1641ee8af50df6c57c178dfb75b"} Jun 08 12:58:12.449339 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.449293 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:12.452747 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:12.452716 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" is forbidden: User \"system:node:ip-10-0-132-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-250.ec2.internal' and this object" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:12.454799 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:12.454770 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" is forbidden: User \"system:node:ip-10-0-132-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-250.ec2.internal' and this object" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:12.458146 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.458131 2568 scope.go:117] "RemoveContainer" containerID="2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda" Jun 08 12:58:12.458398 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:12.458379 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda\": container with ID starting with 2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda not found: ID does not exist" containerID="2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda" Jun 08 12:58:12.458458 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.458405 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda"} err="failed to get container status \"2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda\": rpc error: code = NotFound desc = could not find container \"2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda\": container with ID starting with 2ed0929b8b80e230f3be0d29850f30614e7ebe96e49ce6505b017815d7d93fda not found: ID does not exist" Jun 08 12:58:12.481670 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:58:12.481631 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5f2z4\" is forbidden: User \"system:node:ip-10-0-132-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-250.ec2.internal' and this object" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5f2z4" Jun 08 12:58:12.482409 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.482368 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" podStartSLOduration=1.482354242 podStartE2EDuration="1.482354242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:58:12.47949934 +0000 UTC m=+407.823923621" watchObservedRunningTime="2026-06-08 12:58:12.482354242 +0000 UTC m=+407.826778523" Jun 08 12:58:12.960301 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:12.960257 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:13.059225 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:13.059188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:13.153408 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:13.153375 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619bfca3-f485-4ff7-8387-97db93bb1897" path="/var/lib/kubelet/pods/619bfca3-f485-4ff7-8387-97db93bb1897/volumes" Jun 08 12:58:17.284004 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:17.283966 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:17.379782 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:17.379748 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:19.466964 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:19.466918 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:19.567267 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:19.567225 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:23.458093 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:23.458061 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2ldh" Jun 08 12:58:25.240912 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:25.240851 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:25.341102 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:25.341068 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:28.259374 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:28.259345 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:28.384078 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:28.384043 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:28.673695 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:28.673663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:30.663208 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:30.663165 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:30.763760 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:30.763723 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:35.021675 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:35.021641 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:35.122377 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:35.122343 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:38.021418 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:38.021381 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:38.083491 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:38.083453 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:48.013730 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:48.013642 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:48.075110 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:48.075071 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:48.412003 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:48.411963 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:48.512299 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:48.512266 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:52.209054 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:52.209016 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:52.299652 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:52.299611 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:55.592839 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:55.592796 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.078435 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.078402 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.086049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.086024 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:58:57.089578 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.089559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.091851 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.091828 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 12:58:57.091969 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.091907 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f7kbg\"" Jun 08 12:58:57.101476 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.101451 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:58:57.182975 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.182938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhm2v\" (UniqueName: \"kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.183160 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.183038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.183811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.183786 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:58:57.201820 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.201784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.257899 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.257863 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.283719 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.283685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhm2v\" (UniqueName: \"kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.283892 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.283744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.284330 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.284312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.291971 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.291939 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhm2v\" (UniqueName: \"kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v\") pod \"limitador-limitador-64c94fd64f-mgmcw\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.400259 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.400150 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:58:57.545013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.544984 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:58:57.546486 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:58:57.546461 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc4ff80_e1cc_4035_813d_eb702d20aa16.slice/crio-3623cf134158229a9016a0bc863e0b803a0592d1ef95c265f2ceb71ceb47caa8 WatchSource:0}: Error finding container 3623cf134158229a9016a0bc863e0b803a0592d1ef95c265f2ceb71ceb47caa8: Status 404 returned error can't find the container with id 3623cf134158229a9016a0bc863e0b803a0592d1ef95c265f2ceb71ceb47caa8 Jun 08 12:58:57.709597 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.709561 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" event={"ID":"ccc4ff80-e1cc-4035-813d-eb702d20aa16","Type":"ContainerStarted","Data":"3623cf134158229a9016a0bc863e0b803a0592d1ef95c265f2ceb71ceb47caa8"} Jun 08 12:58:57.882560 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.882505 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:58:57.887393 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.887372 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:58:57.889939 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.889903 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4sc6n\"" Jun 08 12:58:57.895203 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.895176 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:58:57.900993 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.900966 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 12:58:57.904502 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.904482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 12:58:57.915471 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.915439 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 12:58:57.927651 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.927615 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.991807 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.991704 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:58:57.994819 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.994791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zts5n\" (UniqueName: \"kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n\") pod \"authorino-58cd955675-66svz\" (UID: \"98205541-9811-40cd-a45d-55a6cdcb5165\") " pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:58:57.994972 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:57.994893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlbtn\" (UniqueName: \"kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn\") pod \"authorino-75d556bd77-6kqhl\" (UID: \"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac\") " pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 12:58:58.096297 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.096260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zts5n\" (UniqueName: \"kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n\") pod \"authorino-58cd955675-66svz\" (UID: \"98205541-9811-40cd-a45d-55a6cdcb5165\") " pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:58:58.096774 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.096335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlbtn\" (UniqueName: \"kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn\") pod \"authorino-75d556bd77-6kqhl\" (UID: \"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac\") " pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 12:58:58.107390 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.107361 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlbtn\" (UniqueName: \"kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn\") pod \"authorino-75d556bd77-6kqhl\" (UID: \"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac\") " pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 12:58:58.107545 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.107387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zts5n\" (UniqueName: \"kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n\") pod \"authorino-58cd955675-66svz\" (UID: \"98205541-9811-40cd-a45d-55a6cdcb5165\") " pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:58:58.199336 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.199305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:58:58.215404 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.215369 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 12:58:58.395617 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.394475 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:58:58.409552 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:58:58.409492 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98205541_9811_40cd_a45d_55a6cdcb5165.slice/crio-fb4bf60c427aa8a6a8805f1f63ae313759c7627a7cac764a90e4514c6e28223c WatchSource:0}: Error finding container fb4bf60c427aa8a6a8805f1f63ae313759c7627a7cac764a90e4514c6e28223c: Status 404 returned error can't find the container with id fb4bf60c427aa8a6a8805f1f63ae313759c7627a7cac764a90e4514c6e28223c Jun 08 12:58:58.427811 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.427777 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 12:58:58.428883 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:58:58.428842 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0dd5c9e_f2e0_498b_9ed1_417bc43bd5ac.slice/crio-3020481476d3759b08b2debf5563b2036f5f74a795464b25cf5527826cb8b37a WatchSource:0}: Error finding container 3020481476d3759b08b2debf5563b2036f5f74a795464b25cf5527826cb8b37a: Status 404 returned error can't find the container with id 3020481476d3759b08b2debf5563b2036f5f74a795464b25cf5527826cb8b37a Jun 08 12:58:58.719629 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.719590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6kqhl" event={"ID":"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac","Type":"ContainerStarted","Data":"3020481476d3759b08b2debf5563b2036f5f74a795464b25cf5527826cb8b37a"} Jun 08 12:58:58.720944 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:58:58.720901 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-66svz" event={"ID":"98205541-9811-40cd-a45d-55a6cdcb5165","Type":"ContainerStarted","Data":"fb4bf60c427aa8a6a8805f1f63ae313759c7627a7cac764a90e4514c6e28223c"} Jun 08 12:59:03.766145 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.766109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" event={"ID":"ccc4ff80-e1cc-4035-813d-eb702d20aa16","Type":"ContainerStarted","Data":"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3"} Jun 08 12:59:03.766672 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.766189 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:59:03.767711 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.767683 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6kqhl" event={"ID":"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac","Type":"ContainerStarted","Data":"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621"} Jun 08 12:59:03.769231 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.769210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-66svz" event={"ID":"98205541-9811-40cd-a45d-55a6cdcb5165","Type":"ContainerStarted","Data":"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095"} Jun 08 12:59:03.785486 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.785439 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" podStartSLOduration=1.500847719 podStartE2EDuration="6.78542499s" totalImagesPullingTime="5.284577271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:03.783073106 +0000 UTC m=+459.127497387" watchObservedRunningTime="2026-06-08 12:59:03.78542499 +0000 UTC m=+459.129849269" Jun 08 12:59:03.797263 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.797218 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6kqhl" podStartSLOduration=2.446575496 podStartE2EDuration="6.797202951s" totalImagesPullingTime="4.350627455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:03.795765149 +0000 UTC m=+459.140189433" watchObservedRunningTime="2026-06-08 12:59:03.797202951 +0000 UTC m=+459.141627280" Jun 08 12:59:03.809453 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.809399 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-66svz" podStartSLOduration=2.399812757 podStartE2EDuration="6.809379343s" totalImagesPullingTime="4.409566586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:03.808294304 +0000 UTC m=+459.152718585" watchObservedRunningTime="2026-06-08 12:59:03.809379343 +0000 UTC m=+459.153803624" Jun 08 12:59:03.833481 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:03.833436 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:59:05.780941 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:05.780896 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-66svz" podUID="98205541-9811-40cd-a45d-55a6cdcb5165" containerName="authorino" containerID="cri-o://8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095" gracePeriod=30 Jun 08 12:59:06.033546 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.033461 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:59:06.184732 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.184682 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zts5n\" (UniqueName: \"kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n\") pod \"98205541-9811-40cd-a45d-55a6cdcb5165\" (UID: \"98205541-9811-40cd-a45d-55a6cdcb5165\") " Jun 08 12:59:06.186715 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.186692 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n" (OuterVolumeSpecName: "kube-api-access-zts5n") pod "98205541-9811-40cd-a45d-55a6cdcb5165" (UID: "98205541-9811-40cd-a45d-55a6cdcb5165"). InnerVolumeSpecName "kube-api-access-zts5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:59:06.286043 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.285944 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zts5n\" (UniqueName: \"kubernetes.io/projected/98205541-9811-40cd-a45d-55a6cdcb5165-kube-api-access-zts5n\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:06.788126 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.788092 2568 generic.go:356] "Generic (PLEG): container finished" podID="98205541-9811-40cd-a45d-55a6cdcb5165" containerID="8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095" exitCode=0 Jun 08 12:59:06.788605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.788142 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-66svz" Jun 08 12:59:06.788605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.788179 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-66svz" event={"ID":"98205541-9811-40cd-a45d-55a6cdcb5165","Type":"ContainerDied","Data":"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095"} Jun 08 12:59:06.788605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.788219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-66svz" event={"ID":"98205541-9811-40cd-a45d-55a6cdcb5165","Type":"ContainerDied","Data":"fb4bf60c427aa8a6a8805f1f63ae313759c7627a7cac764a90e4514c6e28223c"} Jun 08 12:59:06.788605 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.788239 2568 scope.go:117] "RemoveContainer" containerID="8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095" Jun 08 12:59:06.797445 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.797427 2568 scope.go:117] "RemoveContainer" containerID="8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095" Jun 08 12:59:06.797745 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:59:06.797723 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095\": container with ID starting with 8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095 not found: ID does not exist" containerID="8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095" Jun 08 12:59:06.797844 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.797749 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095"} err="failed to get container status \"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095\": rpc error: code = NotFound desc = could not find container \"8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095\": container with ID starting with 8e550312ad72e8f6a41ea37dadedab9c4de409dd1aa2498592d0471bb9ef9095 not found: ID does not exist" Jun 08 12:59:06.819575 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.819551 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:59:06.823914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:06.823892 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-66svz"] Jun 08 12:59:07.152582 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:07.152481 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98205541-9811-40cd-a45d-55a6cdcb5165" path="/var/lib/kubelet/pods/98205541-9811-40cd-a45d-55a6cdcb5165/volumes" Jun 08 12:59:11.937054 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:11.937014 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:59:11.937593 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:11.937257 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" podUID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" containerName="limitador" containerID="cri-o://df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3" gracePeriod=30 Jun 08 12:59:11.938171 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:11.938148 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:59:12.495330 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.495305 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:59:12.643619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.643494 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhm2v\" (UniqueName: \"kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v\") pod \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " Jun 08 12:59:12.643619 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.643561 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file\") pod \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\" (UID: \"ccc4ff80-e1cc-4035-813d-eb702d20aa16\") " Jun 08 12:59:12.643924 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.643898 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file" (OuterVolumeSpecName: "config-file") pod "ccc4ff80-e1cc-4035-813d-eb702d20aa16" (UID: "ccc4ff80-e1cc-4035-813d-eb702d20aa16"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:59:12.645744 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.645706 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v" (OuterVolumeSpecName: "kube-api-access-mhm2v") pod "ccc4ff80-e1cc-4035-813d-eb702d20aa16" (UID: "ccc4ff80-e1cc-4035-813d-eb702d20aa16"). InnerVolumeSpecName "kube-api-access-mhm2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:59:12.745049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.744996 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhm2v\" (UniqueName: \"kubernetes.io/projected/ccc4ff80-e1cc-4035-813d-eb702d20aa16-kube-api-access-mhm2v\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:12.745049 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.745044 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccc4ff80-e1cc-4035-813d-eb702d20aa16-config-file\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:12.833732 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.833695 2568 generic.go:356] "Generic (PLEG): container finished" podID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" containerID="df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3" exitCode=0 Jun 08 12:59:12.833923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.833739 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" Jun 08 12:59:12.833923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.833777 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" event={"ID":"ccc4ff80-e1cc-4035-813d-eb702d20aa16","Type":"ContainerDied","Data":"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3"} Jun 08 12:59:12.833923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.833831 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mgmcw" event={"ID":"ccc4ff80-e1cc-4035-813d-eb702d20aa16","Type":"ContainerDied","Data":"3623cf134158229a9016a0bc863e0b803a0592d1ef95c265f2ceb71ceb47caa8"} Jun 08 12:59:12.833923 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.833855 2568 scope.go:117] "RemoveContainer" containerID="df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3" Jun 08 12:59:12.843209 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.843190 2568 scope.go:117] "RemoveContainer" containerID="df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3" Jun 08 12:59:12.843472 ip-10-0-132-250 kubenswrapper[2568]: E0608 12:59:12.843450 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3\": container with ID starting with df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3 not found: ID does not exist" containerID="df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3" Jun 08 12:59:12.843544 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.843481 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3"} err="failed to get container status \"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3\": rpc error: code = NotFound desc = could not find container \"df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3\": container with ID starting with df659bf269d47cc3eaecd58e7329e3ab62ad6d0277a524a931f354e79be2d5a3 not found: ID does not exist" Jun 08 12:59:12.857151 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.857128 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:59:12.860714 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:12.860689 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mgmcw"] Jun 08 12:59:13.152525 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.152492 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" path="/var/lib/kubelet/pods/ccc4ff80-e1cc-4035-813d-eb702d20aa16/volumes" Jun 08 12:59:13.192885 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.192851 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-46v6m"] Jun 08 12:59:13.193452 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193435 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98205541-9811-40cd-a45d-55a6cdcb5165" containerName="authorino" Jun 08 12:59:13.193499 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193458 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="98205541-9811-40cd-a45d-55a6cdcb5165" containerName="authorino" Jun 08 12:59:13.193499 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193484 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" containerName="limitador" Jun 08 12:59:13.193499 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193493 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" containerName="limitador" Jun 08 12:59:13.193657 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193627 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc4ff80-e1cc-4035-813d-eb702d20aa16" containerName="limitador" Jun 08 12:59:13.193657 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.193640 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="98205541-9811-40cd-a45d-55a6cdcb5165" containerName="authorino" Jun 08 12:59:13.198587 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.198564 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.202137 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.202110 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 12:59:13.212105 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.212081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-46v6m"] Jun 08 12:59:13.236691 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.236645 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:59:13.349374 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.349338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnrz\" (UniqueName: \"kubernetes.io/projected/788d4531-2e2a-46e8-b999-4e74e5f9eac7-kube-api-access-cfnrz\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.349564 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.349455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/788d4531-2e2a-46e8-b999-4e74e5f9eac7-data\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.451069 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.450954 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnrz\" (UniqueName: \"kubernetes.io/projected/788d4531-2e2a-46e8-b999-4e74e5f9eac7-kube-api-access-cfnrz\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.451258 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.451159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/788d4531-2e2a-46e8-b999-4e74e5f9eac7-data\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.451571 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.451552 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/788d4531-2e2a-46e8-b999-4e74e5f9eac7-data\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.460386 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.460359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnrz\" (UniqueName: \"kubernetes.io/projected/788d4531-2e2a-46e8-b999-4e74e5f9eac7-kube-api-access-cfnrz\") pod \"postgres-69fb4594cf-46v6m\" (UID: \"788d4531-2e2a-46e8-b999-4e74e5f9eac7\") " pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.511120 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.511089 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:13.647791 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.647759 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-46v6m"] Jun 08 12:59:13.649165 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:59:13.649140 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788d4531_2e2a_46e8_b999_4e74e5f9eac7.slice/crio-62a8d6bb600868435f95bc7a0273ce2145480479d91e6f2d4524db8c8d9a14b1 WatchSource:0}: Error finding container 62a8d6bb600868435f95bc7a0273ce2145480479d91e6f2d4524db8c8d9a14b1: Status 404 returned error can't find the container with id 62a8d6bb600868435f95bc7a0273ce2145480479d91e6f2d4524db8c8d9a14b1 Jun 08 12:59:13.841740 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:13.841647 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-46v6m" event={"ID":"788d4531-2e2a-46e8-b999-4e74e5f9eac7","Type":"ContainerStarted","Data":"62a8d6bb600868435f95bc7a0273ce2145480479d91e6f2d4524db8c8d9a14b1"} Jun 08 12:59:16.863104 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:16.863067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-46v6m" event={"ID":"788d4531-2e2a-46e8-b999-4e74e5f9eac7","Type":"ContainerStarted","Data":"eaa46516f59bf2215649c93e18295d3edfc89df47a423b3e7b7c5ec514cf4008"} Jun 08 12:59:16.863480 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:16.863188 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:16.885460 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:16.885413 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-46v6m" podStartSLOduration=1.592164133 podStartE2EDuration="3.885397795s" totalImagesPullingTime="2.293233662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:16.882065991 +0000 UTC m=+472.226490280" watchObservedRunningTime="2026-06-08 12:59:16.885397795 +0000 UTC m=+472.229822115" Jun 08 12:59:22.902722 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:22.902689 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-46v6m" Jun 08 12:59:23.214691 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:23.214651 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:59:23.310013 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:23.309978 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:59:23.477021 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:23.476922 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:59:24.413549 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.413498 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf"] Jun 08 12:59:24.476914 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.476873 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf"] Jun 08 12:59:24.477094 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.477009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.479682 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.479656 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:59:24.479830 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.479685 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:59:24.479830 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.479738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5glhh\"" Jun 08 12:59:24.554536 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.554486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fk2p\" (UniqueName: \"kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.554725 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.554605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.554725 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.554627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.655541 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.655475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fk2p\" (UniqueName: \"kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.655721 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.655582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.655721 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.655604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.655934 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.655919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.655990 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.655969 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.674185 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.674131 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fk2p\" (UniqueName: \"kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.786851 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.786807 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:24.963117 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:24.963088 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf"] Jun 08 12:59:24.964567 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:59:24.964508 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc135af_3289_4c06_81c6_113fc017d090.slice/crio-b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a WatchSource:0}: Error finding container b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a: Status 404 returned error can't find the container with id b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a Jun 08 12:59:25.918607 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:25.918567 2568 generic.go:356] "Generic (PLEG): container finished" podID="8fc135af-3289-4c06-81c6-113fc017d090" containerID="29993ec468f7708bd685fad493b8a579fc970964aaa17573f08f5da81b2241be" exitCode=0 Jun 08 12:59:25.918977 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:25.918658 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" event={"ID":"8fc135af-3289-4c06-81c6-113fc017d090","Type":"ContainerDied","Data":"29993ec468f7708bd685fad493b8a579fc970964aaa17573f08f5da81b2241be"} Jun 08 12:59:25.918977 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:25.918720 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" event={"ID":"8fc135af-3289-4c06-81c6-113fc017d090","Type":"ContainerStarted","Data":"b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a"} Jun 08 12:59:27.940010 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:27.939975 2568 generic.go:356] "Generic (PLEG): container finished" podID="8fc135af-3289-4c06-81c6-113fc017d090" containerID="0ad10d7bdbaa73ec51610fd4d1b56a3a12c346a6dc7ebd6b151a8c4bc4e64c3b" exitCode=0 Jun 08 12:59:27.940418 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:27.940060 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" event={"ID":"8fc135af-3289-4c06-81c6-113fc017d090","Type":"ContainerDied","Data":"0ad10d7bdbaa73ec51610fd4d1b56a3a12c346a6dc7ebd6b151a8c4bc4e64c3b"} Jun 08 12:59:28.948012 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:28.947969 2568 generic.go:356] "Generic (PLEG): container finished" podID="8fc135af-3289-4c06-81c6-113fc017d090" containerID="e91f7e50bd0c0ca7803280a9b531cff84cd98f6fda8086ed0adb36fc4aab8236" exitCode=0 Jun 08 12:59:28.948462 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:28.948067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" event={"ID":"8fc135af-3289-4c06-81c6-113fc017d090","Type":"ContainerDied","Data":"e91f7e50bd0c0ca7803280a9b531cff84cd98f6fda8086ed0adb36fc4aab8236"} Jun 08 12:59:30.101079 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.101049 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:30.210528 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.210431 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fk2p\" (UniqueName: \"kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p\") pod \"8fc135af-3289-4c06-81c6-113fc017d090\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " Jun 08 12:59:30.210528 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.210504 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util\") pod \"8fc135af-3289-4c06-81c6-113fc017d090\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " Jun 08 12:59:30.210786 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.210580 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle\") pod \"8fc135af-3289-4c06-81c6-113fc017d090\" (UID: \"8fc135af-3289-4c06-81c6-113fc017d090\") " Jun 08 12:59:30.211015 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.210990 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle" (OuterVolumeSpecName: "bundle") pod "8fc135af-3289-4c06-81c6-113fc017d090" (UID: "8fc135af-3289-4c06-81c6-113fc017d090"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:59:30.212647 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.212624 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p" (OuterVolumeSpecName: "kube-api-access-2fk2p") pod "8fc135af-3289-4c06-81c6-113fc017d090" (UID: "8fc135af-3289-4c06-81c6-113fc017d090"). InnerVolumeSpecName "kube-api-access-2fk2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:59:30.311894 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.311858 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fk2p\" (UniqueName: \"kubernetes.io/projected/8fc135af-3289-4c06-81c6-113fc017d090-kube-api-access-2fk2p\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:30.311894 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.311890 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:30.319043 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.319004 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util" (OuterVolumeSpecName: "util") pod "8fc135af-3289-4c06-81c6-113fc017d090" (UID: "8fc135af-3289-4c06-81c6-113fc017d090"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:59:30.412826 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.412787 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc135af-3289-4c06-81c6-113fc017d090-util\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 12:59:30.961529 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.961488 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" event={"ID":"8fc135af-3289-4c06-81c6-113fc017d090","Type":"ContainerDied","Data":"b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a"} Jun 08 12:59:30.961715 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.961558 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k5mmf" Jun 08 12:59:30.961715 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:30.961560 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b41609c59906cf7f65395a52867cd677468d106e111d42bf1c7a0fc8088ddc8a" Jun 08 12:59:38.565814 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.565776 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9282n"] Jun 08 12:59:38.566227 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566200 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="extract" Jun 08 12:59:38.566227 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566214 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="extract" Jun 08 12:59:38.566300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566236 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="pull" Jun 08 12:59:38.566300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566243 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="pull" Jun 08 12:59:38.566300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566263 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="util" Jun 08 12:59:38.566300 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566269 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="util" Jun 08 12:59:38.566422 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.566351 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc135af-3289-4c06-81c6-113fc017d090" containerName="extract" Jun 08 12:59:38.570761 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.570735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" Jun 08 12:59:38.576227 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.576201 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-qpmnm\"" Jun 08 12:59:38.576375 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.576203 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:59:38.576375 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.576244 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:59:38.583161 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.583136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9282n"] Jun 08 12:59:38.686486 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.686444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86qhn\" (UniqueName: \"kubernetes.io/projected/b3932991-6d15-4294-ba74-af9176d9be96-kube-api-access-86qhn\") pod \"keycloak-operator-d67dbbb48-9282n\" (UID: \"b3932991-6d15-4294-ba74-af9176d9be96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" Jun 08 12:59:38.787248 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.787211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86qhn\" (UniqueName: \"kubernetes.io/projected/b3932991-6d15-4294-ba74-af9176d9be96-kube-api-access-86qhn\") pod \"keycloak-operator-d67dbbb48-9282n\" (UID: \"b3932991-6d15-4294-ba74-af9176d9be96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" Jun 08 12:59:38.797960 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.797925 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86qhn\" (UniqueName: \"kubernetes.io/projected/b3932991-6d15-4294-ba74-af9176d9be96-kube-api-access-86qhn\") pod \"keycloak-operator-d67dbbb48-9282n\" (UID: \"b3932991-6d15-4294-ba74-af9176d9be96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" Jun 08 12:59:38.881750 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:38.881664 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" Jun 08 12:59:39.031078 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:39.031043 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9282n"] Jun 08 12:59:39.032352 ip-10-0-132-250 kubenswrapper[2568]: W0608 12:59:39.032329 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3932991_6d15_4294_ba74_af9176d9be96.slice/crio-9e388f61c02a8c0646965572795091062a92e59444a46cc1c96de029e15d6de0 WatchSource:0}: Error finding container 9e388f61c02a8c0646965572795091062a92e59444a46cc1c96de029e15d6de0: Status 404 returned error can't find the container with id 9e388f61c02a8c0646965572795091062a92e59444a46cc1c96de029e15d6de0 Jun 08 12:59:40.019810 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:40.019769 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" event={"ID":"b3932991-6d15-4294-ba74-af9176d9be96","Type":"ContainerStarted","Data":"9e388f61c02a8c0646965572795091062a92e59444a46cc1c96de029e15d6de0"} Jun 08 12:59:45.053079 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:45.052973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" event={"ID":"b3932991-6d15-4294-ba74-af9176d9be96","Type":"ContainerStarted","Data":"9940b58cfff7290b76b95d738dcb71f6cacc797e480e1ad73a55095a36edde21"} Jun 08 12:59:53.562568 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:53.562510 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 12:59:53.664674 ip-10-0-132-250 kubenswrapper[2568]: I0608 12:59:53.664634 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:07.718329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:07.718288 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:07.783467 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:07.783434 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:23.176292 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.176211 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:23.278031 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.277999 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:23.455042 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.454921 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-9282n" podStartSLOduration=39.750968719 podStartE2EDuration="45.454898331s" totalImagesPullingTime="5.703929612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:45.093906071 +0000 UTC m=+500.438330349" watchObservedRunningTime="2026-06-08 13:00:23.454898331 +0000 UTC m=+538.799322610" Jun 08 13:00:23.457000 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.456974 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:23.460439 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.460422 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:23.478949 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.478929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sz6\" (UniqueName: \"kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6\") pod \"authorino-5d4b67c446-smtqc\" (UID: \"83457889-0fe7-47b7-8588-090a544829ed\") " pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:23.505495 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.505473 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:23.580179 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.580152 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sz6\" (UniqueName: \"kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6\") pod \"authorino-5d4b67c446-smtqc\" (UID: \"83457889-0fe7-47b7-8588-090a544829ed\") " pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:23.589350 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.589333 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sz6\" (UniqueName: \"kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6\") pod \"authorino-5d4b67c446-smtqc\" (UID: \"83457889-0fe7-47b7-8588-090a544829ed\") " pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:23.664995 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.664967 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:23.665241 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.665226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:23.696949 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.696925 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54bfb8755b-99f88"] Jun 08 13:00:23.700409 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.700392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:23.712249 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.712226 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54bfb8755b-99f88"] Jun 08 13:00:23.781851 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.781825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh62r\" (UniqueName: \"kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r\") pod \"authorino-54bfb8755b-99f88\" (UID: \"cef0849e-92e4-4fe0-b617-5fc793ab8a93\") " pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:23.793593 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.793570 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54bfb8755b-99f88"] Jun 08 13:00:23.793820 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:00:23.793803 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gh62r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-54bfb8755b-99f88" podUID="cef0849e-92e4-4fe0-b617-5fc793ab8a93" Jun 08 13:00:23.799907 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.799886 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:23.801697 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:00:23.801675 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83457889_0fe7_47b7_8588_090a544829ed.slice/crio-dca69270621b4c4385621b24198f7a9753a50a85f53349d50cbe45608f54c359 WatchSource:0}: Error finding container dca69270621b4c4385621b24198f7a9753a50a85f53349d50cbe45608f54c359: Status 404 returned error can't find the container with id dca69270621b4c4385621b24198f7a9753a50a85f53349d50cbe45608f54c359 Jun 08 13:00:23.840697 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.840670 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:00:23.843903 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.843886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.846630 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.846612 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 13:00:23.853475 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.853452 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:00:23.882827 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.882806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh62r\" (UniqueName: \"kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r\") pod \"authorino-54bfb8755b-99f88\" (UID: \"cef0849e-92e4-4fe0-b617-5fc793ab8a93\") " pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:23.882917 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.882847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqxbv\" (UniqueName: \"kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.882917 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.882905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.891722 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.891703 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh62r\" (UniqueName: \"kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r\") pod \"authorino-54bfb8755b-99f88\" (UID: \"cef0849e-92e4-4fe0-b617-5fc793ab8a93\") " pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:23.984032 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.983981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.984119 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.984042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxbv\" (UniqueName: \"kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.986239 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.986220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:23.993142 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:23.993124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqxbv\" (UniqueName: \"kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv\") pod \"authorino-c56b44d88-wrjrj\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:24.154427 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.154405 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:00:24.281284 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.281252 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smtqc" event={"ID":"83457889-0fe7-47b7-8588-090a544829ed","Type":"ContainerStarted","Data":"dca69270621b4c4385621b24198f7a9753a50a85f53349d50cbe45608f54c359"} Jun 08 13:00:24.281284 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.281278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:24.287853 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.287830 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:00:24.289865 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:00:24.289842 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd466bc07_fff8_477e_81d0_edfaedbb9136.slice/crio-a4bf47a28eaeba850a5b9d0f736422fdbeec5074bcd67330ae90efe902d176cb WatchSource:0}: Error finding container a4bf47a28eaeba850a5b9d0f736422fdbeec5074bcd67330ae90efe902d176cb: Status 404 returned error can't find the container with id a4bf47a28eaeba850a5b9d0f736422fdbeec5074bcd67330ae90efe902d176cb Jun 08 13:00:24.290295 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.290277 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:24.386505 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.386485 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh62r\" (UniqueName: \"kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r\") pod \"cef0849e-92e4-4fe0-b617-5fc793ab8a93\" (UID: \"cef0849e-92e4-4fe0-b617-5fc793ab8a93\") " Jun 08 13:00:24.388277 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.388253 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r" (OuterVolumeSpecName: "kube-api-access-gh62r") pod "cef0849e-92e4-4fe0-b617-5fc793ab8a93" (UID: "cef0849e-92e4-4fe0-b617-5fc793ab8a93"). InnerVolumeSpecName "kube-api-access-gh62r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:00:24.487473 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:24.487399 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh62r\" (UniqueName: \"kubernetes.io/projected/cef0849e-92e4-4fe0-b617-5fc793ab8a93-kube-api-access-gh62r\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:00:25.288504 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.288465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smtqc" event={"ID":"83457889-0fe7-47b7-8588-090a544829ed","Type":"ContainerStarted","Data":"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3"} Jun 08 13:00:25.288504 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.288490 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-smtqc" podUID="83457889-0fe7-47b7-8588-090a544829ed" containerName="authorino" containerID="cri-o://23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3" gracePeriod=30 Jun 08 13:00:25.290359 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.290335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c56b44d88-wrjrj" event={"ID":"d466bc07-fff8-477e-81d0-edfaedbb9136","Type":"ContainerStarted","Data":"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8"} Jun 08 13:00:25.290359 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.290348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bfb8755b-99f88" Jun 08 13:00:25.290359 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.290364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c56b44d88-wrjrj" event={"ID":"d466bc07-fff8-477e-81d0-edfaedbb9136","Type":"ContainerStarted","Data":"a4bf47a28eaeba850a5b9d0f736422fdbeec5074bcd67330ae90efe902d176cb"} Jun 08 13:00:25.304304 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.304259 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-smtqc" podStartSLOduration=1.7880334150000001 podStartE2EDuration="2.304241792s" totalImagesPullingTime="516.208377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:00:25.302041486 +0000 UTC m=+540.646465757" watchObservedRunningTime="2026-06-08 13:00:25.304241792 +0000 UTC m=+540.648666073" Jun 08 13:00:25.328855 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.328828 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54bfb8755b-99f88"] Jun 08 13:00:25.332029 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.332008 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54bfb8755b-99f88"] Jun 08 13:00:25.345434 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.345394 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c56b44d88-wrjrj" podStartSLOduration=1.951500944 podStartE2EDuration="2.345380966s" totalImagesPullingTime="393.880022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:00:25.34316622 +0000 UTC m=+540.687590501" watchObservedRunningTime="2026-06-08 13:00:25.345380966 +0000 UTC m=+540.689805246" Jun 08 13:00:25.372847 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.372822 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 13:00:25.373040 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.373016 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6kqhl" podUID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" containerName="authorino" containerID="cri-o://ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621" gracePeriod=30 Jun 08 13:00:25.649587 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.649563 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:25.652635 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.652614 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 13:00:25.697630 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.697607 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlbtn\" (UniqueName: \"kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn\") pod \"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac\" (UID: \"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac\") " Jun 08 13:00:25.697828 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.697809 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5sz6\" (UniqueName: \"kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6\") pod \"83457889-0fe7-47b7-8588-090a544829ed\" (UID: \"83457889-0fe7-47b7-8588-090a544829ed\") " Jun 08 13:00:25.699839 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.699807 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6" (OuterVolumeSpecName: "kube-api-access-g5sz6") pod "83457889-0fe7-47b7-8588-090a544829ed" (UID: "83457889-0fe7-47b7-8588-090a544829ed"). InnerVolumeSpecName "kube-api-access-g5sz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:00:25.699946 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.699833 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn" (OuterVolumeSpecName: "kube-api-access-dlbtn") pod "e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" (UID: "e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac"). InnerVolumeSpecName "kube-api-access-dlbtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:00:25.798479 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.798423 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5sz6\" (UniqueName: \"kubernetes.io/projected/83457889-0fe7-47b7-8588-090a544829ed-kube-api-access-g5sz6\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:00:25.798479 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:25.798446 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlbtn\" (UniqueName: \"kubernetes.io/projected/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac-kube-api-access-dlbtn\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:00:26.297487 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.297453 2568 generic.go:356] "Generic (PLEG): container finished" podID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" containerID="ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621" exitCode=0 Jun 08 13:00:26.297911 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.297495 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6kqhl" Jun 08 13:00:26.297911 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.297540 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6kqhl" event={"ID":"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac","Type":"ContainerDied","Data":"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621"} Jun 08 13:00:26.297911 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.297587 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6kqhl" event={"ID":"e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac","Type":"ContainerDied","Data":"3020481476d3759b08b2debf5563b2036f5f74a795464b25cf5527826cb8b37a"} Jun 08 13:00:26.297911 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.297608 2568 scope.go:117] "RemoveContainer" containerID="ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621" Jun 08 13:00:26.298959 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.298938 2568 generic.go:356] "Generic (PLEG): container finished" podID="83457889-0fe7-47b7-8588-090a544829ed" containerID="23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3" exitCode=0 Jun 08 13:00:26.299061 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.298983 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smtqc" Jun 08 13:00:26.299061 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.299020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smtqc" event={"ID":"83457889-0fe7-47b7-8588-090a544829ed","Type":"ContainerDied","Data":"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3"} Jun 08 13:00:26.299061 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.299055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smtqc" event={"ID":"83457889-0fe7-47b7-8588-090a544829ed","Type":"ContainerDied","Data":"dca69270621b4c4385621b24198f7a9753a50a85f53349d50cbe45608f54c359"} Jun 08 13:00:26.308369 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.308352 2568 scope.go:117] "RemoveContainer" containerID="ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621" Jun 08 13:00:26.308671 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:00:26.308643 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621\": container with ID starting with ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621 not found: ID does not exist" containerID="ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621" Jun 08 13:00:26.308794 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.308680 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621"} err="failed to get container status \"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621\": rpc error: code = NotFound desc = could not find container \"ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621\": container with ID starting with ff123ef7b5258355911d72b54686cd6c774127731d502bcfe77d66c495134621 not found: ID does not exist" Jun 08 13:00:26.308794 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.308704 2568 scope.go:117] "RemoveContainer" containerID="23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3" Jun 08 13:00:26.316513 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.316497 2568 scope.go:117] "RemoveContainer" containerID="23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3" Jun 08 13:00:26.317165 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:00:26.317145 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3\": container with ID starting with 23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3 not found: ID does not exist" containerID="23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3" Jun 08 13:00:26.317215 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.317172 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3"} err="failed to get container status \"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3\": rpc error: code = NotFound desc = could not find container \"23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3\": container with ID starting with 23f26b5283f8b766729b076e1e71780069b61f91f8625da675ca97da50fa9ae3 not found: ID does not exist" Jun 08 13:00:26.323040 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.323018 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 13:00:26.326805 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.326787 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6kqhl"] Jun 08 13:00:26.337887 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.337863 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:26.341985 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:26.341967 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smtqc"] Jun 08 13:00:27.152361 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:27.152321 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83457889-0fe7-47b7-8588-090a544829ed" path="/var/lib/kubelet/pods/83457889-0fe7-47b7-8588-090a544829ed/volumes" Jun 08 13:00:27.152732 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:27.152713 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef0849e-92e4-4fe0-b617-5fc793ab8a93" path="/var/lib/kubelet/pods/cef0849e-92e4-4fe0-b617-5fc793ab8a93/volumes" Jun 08 13:00:27.152967 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:27.152951 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" path="/var/lib/kubelet/pods/e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac/volumes" Jun 08 13:00:28.991079 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:28.991043 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:29.088287 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:29.088255 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:29.179883 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:29.179846 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:29.253934 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:29.253852 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:33.088066 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:33.088025 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:00:33.273701 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:00:33.273668 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:04.187533 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:04.187479 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:04.690247 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:04.690207 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:04.802481 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:04.802447 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:25.146698 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:25.146666 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:01:25.151113 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:25.151086 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:01:35.128206 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:35.128171 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:41.486600 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:41.486557 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:41.624148 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:41.624110 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:42.294041 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:42.294006 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:43.641798 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:43.641755 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:43.725992 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:43.725964 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:53.588807 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.588734 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:01:53.589210 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589120 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" containerName="authorino" Jun 08 13:01:53.589210 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589132 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" containerName="authorino" Jun 08 13:01:53.589210 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589146 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83457889-0fe7-47b7-8588-090a544829ed" containerName="authorino" Jun 08 13:01:53.589210 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589151 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="83457889-0fe7-47b7-8588-090a544829ed" containerName="authorino" Jun 08 13:01:53.589340 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589222 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="83457889-0fe7-47b7-8588-090a544829ed" containerName="authorino" Jun 08 13:01:53.589340 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.589234 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dd5c9e-f2e0-498b-9ed1-417bc43bd5ac" containerName="authorino" Jun 08 13:01:53.592285 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.592269 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.596680 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.596660 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 13:01:53.604722 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.604700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:01:53.762435 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.762405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.762665 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.762577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.762716 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.762675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prmfc\" (UniqueName: \"kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.863727 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.863640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prmfc\" (UniqueName: \"kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.863727 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.863680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.863940 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.863743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.864398 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.864378 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.866045 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.866023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.872885 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.872864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prmfc\" (UniqueName: \"kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc\") pod \"authorino-5f8d44888b-tmjcf\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.901437 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.901415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:01:53.904893 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:53.904858 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:54.012993 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.012959 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:54.037685 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.037658 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:01:54.038000 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:01:54.037979 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4575eeaf_d8c0_4236_b3b5_8d8b12228be0.slice/crio-ab6ea41e736f6eaadf73bf8b079da65e0cd77a9082a04f0fc5795157d1fca3dc WatchSource:0}: Error finding container ab6ea41e736f6eaadf73bf8b079da65e0cd77a9082a04f0fc5795157d1fca3dc: Status 404 returned error can't find the container with id ab6ea41e736f6eaadf73bf8b079da65e0cd77a9082a04f0fc5795157d1fca3dc Jun 08 13:01:54.039573 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.039558 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:01:54.838498 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.838409 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" event={"ID":"4575eeaf-d8c0-4236-b3b5-8d8b12228be0","Type":"ContainerStarted","Data":"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f"} Jun 08 13:01:54.838498 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.838457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" event={"ID":"4575eeaf-d8c0-4236-b3b5-8d8b12228be0","Type":"ContainerStarted","Data":"ab6ea41e736f6eaadf73bf8b079da65e0cd77a9082a04f0fc5795157d1fca3dc"} Jun 08 13:01:54.857904 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.857859 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" podStartSLOduration=1.480852433 podStartE2EDuration="1.857845496s" totalImagesPullingTime="376.993063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:54.855866975 +0000 UTC m=+630.200291252" watchObservedRunningTime="2026-06-08 13:01:54.857845496 +0000 UTC m=+630.202269774" Jun 08 13:01:54.898592 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.898543 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:01:54.898764 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:54.898743 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-c56b44d88-wrjrj" podUID="d466bc07-fff8-477e-81d0-edfaedbb9136" containerName="authorino" containerID="cri-o://e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8" gracePeriod=30 Jun 08 13:01:55.171330 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.171304 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:01:55.277400 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.277361 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert\") pod \"d466bc07-fff8-477e-81d0-edfaedbb9136\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " Jun 08 13:01:55.277639 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.277440 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqxbv\" (UniqueName: \"kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv\") pod \"d466bc07-fff8-477e-81d0-edfaedbb9136\" (UID: \"d466bc07-fff8-477e-81d0-edfaedbb9136\") " Jun 08 13:01:55.279397 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.279373 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv" (OuterVolumeSpecName: "kube-api-access-rqxbv") pod "d466bc07-fff8-477e-81d0-edfaedbb9136" (UID: "d466bc07-fff8-477e-81d0-edfaedbb9136"). InnerVolumeSpecName "kube-api-access-rqxbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:01:55.290351 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.290323 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d466bc07-fff8-477e-81d0-edfaedbb9136" (UID: "d466bc07-fff8-477e-81d0-edfaedbb9136"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:01:55.352248 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.352210 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:55.378323 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.378297 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqxbv\" (UniqueName: \"kubernetes.io/projected/d466bc07-fff8-477e-81d0-edfaedbb9136-kube-api-access-rqxbv\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:01:55.378323 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.378323 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d466bc07-fff8-477e-81d0-edfaedbb9136-tls-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:01:55.444699 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.444667 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:55.845653 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.845565 2568 generic.go:356] "Generic (PLEG): container finished" podID="d466bc07-fff8-477e-81d0-edfaedbb9136" containerID="e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8" exitCode=0 Jun 08 13:01:55.845653 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.845608 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c56b44d88-wrjrj" Jun 08 13:01:55.845653 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.845643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c56b44d88-wrjrj" event={"ID":"d466bc07-fff8-477e-81d0-edfaedbb9136","Type":"ContainerDied","Data":"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8"} Jun 08 13:01:55.846156 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.845678 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c56b44d88-wrjrj" event={"ID":"d466bc07-fff8-477e-81d0-edfaedbb9136","Type":"ContainerDied","Data":"a4bf47a28eaeba850a5b9d0f736422fdbeec5074bcd67330ae90efe902d176cb"} Jun 08 13:01:55.846156 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.845701 2568 scope.go:117] "RemoveContainer" containerID="e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8" Jun 08 13:01:55.855436 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.855417 2568 scope.go:117] "RemoveContainer" containerID="e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8" Jun 08 13:01:55.855722 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:01:55.855702 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8\": container with ID starting with e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8 not found: ID does not exist" containerID="e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8" Jun 08 13:01:55.855800 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.855730 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8"} err="failed to get container status \"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8\": rpc error: code = NotFound desc = could not find container \"e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8\": container with ID starting with e6cf66d3a01792fa58a3b92a757c2405fe3164ac5e8a00dfa693ecbae2def8f8 not found: ID does not exist" Jun 08 13:01:55.867016 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.866995 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:01:55.875710 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:55.875332 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c56b44d88-wrjrj"] Jun 08 13:01:57.153028 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:01:57.152999 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d466bc07-fff8-477e-81d0-edfaedbb9136" path="/var/lib/kubelet/pods/d466bc07-fff8-477e-81d0-edfaedbb9136/volumes" Jun 08 13:02:00.983869 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:00.983839 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:24.788844 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:24.788803 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:30.767964 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:30.767922 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:43.271913 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:43.271876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:51.079483 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:51.079448 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:58.134792 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:02:58.134744 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:03:30.838710 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.838628 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b77595979-chww2"] Jun 08 13:03:30.839277 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.839175 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d466bc07-fff8-477e-81d0-edfaedbb9136" containerName="authorino" Jun 08 13:03:30.839277 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.839189 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d466bc07-fff8-477e-81d0-edfaedbb9136" containerName="authorino" Jun 08 13:03:30.839406 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.839289 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d466bc07-fff8-477e-81d0-edfaedbb9136" containerName="authorino" Jun 08 13:03:30.842795 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.842774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.855461 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.855440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b77595979-chww2"] Jun 08 13:03:30.892737 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.892706 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:03:30.911912 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.911882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912026 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.911915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-trusted-ca-bundle\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912026 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.911942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-service-ca\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912026 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.912014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmnq\" (UniqueName: \"kubernetes.io/projected/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-kube-api-access-kzmnq\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.912049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.912079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-oauth-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.912135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.912108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-oauth-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:30.953630 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:30.953577 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:03:31.012763 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.012737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.012763 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.012766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-trusted-ca-bundle\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.012971 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.012785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-service-ca\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013033 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.012966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmnq\" (UniqueName: \"kubernetes.io/projected/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-kube-api-access-kzmnq\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013033 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013141 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-oauth-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013141 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-oauth-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013468 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013599 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013578 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-service-ca\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013664 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-trusted-ca-bundle\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.013757 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.013736 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-oauth-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.015431 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.015410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-oauth-config\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.015561 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.015540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-console-serving-cert\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.021884 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.021866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmnq\" (UniqueName: \"kubernetes.io/projected/e3a2d15c-17b3-4d7f-8bac-4a14202d8e35-kube-api-access-kzmnq\") pod \"console-6b77595979-chww2\" (UID: \"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35\") " pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.155453 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.155380 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:31.294919 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.294893 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b77595979-chww2"] Jun 08 13:03:31.297697 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:03:31.297672 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a2d15c_17b3_4d7f_8bac_4a14202d8e35.slice/crio-5c2230764c5d719ee53d1eb8becc29b05dab55dbd6bee8cd9665fae06d854948 WatchSource:0}: Error finding container 5c2230764c5d719ee53d1eb8becc29b05dab55dbd6bee8cd9665fae06d854948: Status 404 returned error can't find the container with id 5c2230764c5d719ee53d1eb8becc29b05dab55dbd6bee8cd9665fae06d854948 Jun 08 13:03:31.399587 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.399547 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b77595979-chww2" event={"ID":"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35","Type":"ContainerStarted","Data":"99cd2a3fa5eb0a5f9e4feaf2f3622ecba6802546ca7a4c06060bab017f617c39"} Jun 08 13:03:31.399759 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.399606 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b77595979-chww2" event={"ID":"e3a2d15c-17b3-4d7f-8bac-4a14202d8e35","Type":"ContainerStarted","Data":"5c2230764c5d719ee53d1eb8becc29b05dab55dbd6bee8cd9665fae06d854948"} Jun 08 13:03:31.421935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:31.421887 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b77595979-chww2" podStartSLOduration=1.421870083 podStartE2EDuration="1.421870083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:03:31.419498442 +0000 UTC m=+726.763922722" watchObservedRunningTime="2026-06-08 13:03:31.421870083 +0000 UTC m=+726.766294363" Jun 08 13:03:41.156234 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.156199 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:41.156234 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.156242 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:41.161125 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.161102 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:41.463676 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.463593 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b77595979-chww2" Jun 08 13:03:41.510463 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.510434 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 13:03:41.632177 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.632137 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:03:41.684427 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:03:41.684393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:04:06.534344 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.534294 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79955f8ff6-5fsvw" podUID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" containerName="console" containerID="cri-o://d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0" gracePeriod=15 Jun 08 13:04:06.793214 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.793147 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 13:04:06.914668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914629 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914669 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dsth\" (UniqueName: \"kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914715 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914730 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914786 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914867 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.914935 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.914922 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle\") pod \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\" (UID: \"38291e55-62b6-4c5e-a6a2-5248c01e9e32\") " Jun 08 13:04:06.915203 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915127 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca" (OuterVolumeSpecName: "service-ca") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:04:06.915261 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915212 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config" (OuterVolumeSpecName: "console-config") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:04:06.915261 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915222 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:04:06.915443 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915413 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-oauth-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:06.915443 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915440 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:06.915634 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915455 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-service-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:06.915634 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.915497 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:04:06.917146 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.917120 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth" (OuterVolumeSpecName: "kube-api-access-4dsth") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "kube-api-access-4dsth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:04:06.917409 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.917381 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:04:06.917409 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:06.917399 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38291e55-62b6-4c5e-a6a2-5248c01e9e32" (UID: "38291e55-62b6-4c5e-a6a2-5248c01e9e32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:04:07.015974 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.015931 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-serving-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:07.015974 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.015965 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38291e55-62b6-4c5e-a6a2-5248c01e9e32-console-oauth-config\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:07.015974 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.015980 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38291e55-62b6-4c5e-a6a2-5248c01e9e32-trusted-ca-bundle\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:07.016216 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.015992 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dsth\" (UniqueName: \"kubernetes.io/projected/38291e55-62b6-4c5e-a6a2-5248c01e9e32-kube-api-access-4dsth\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:07.619492 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.619402 2568 generic.go:356] "Generic (PLEG): container finished" podID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" containerID="d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0" exitCode=0 Jun 08 13:04:07.619492 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.619446 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955f8ff6-5fsvw" Jun 08 13:04:07.619492 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.619483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955f8ff6-5fsvw" event={"ID":"38291e55-62b6-4c5e-a6a2-5248c01e9e32","Type":"ContainerDied","Data":"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0"} Jun 08 13:04:07.619994 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.619549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955f8ff6-5fsvw" event={"ID":"38291e55-62b6-4c5e-a6a2-5248c01e9e32","Type":"ContainerDied","Data":"a29fc9e5b0fa867955c006645d2f64cab7614d40fc4df8ec9793b8a1bcf78c30"} Jun 08 13:04:07.619994 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.619570 2568 scope.go:117] "RemoveContainer" containerID="d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0" Jun 08 13:04:07.628962 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.628933 2568 scope.go:117] "RemoveContainer" containerID="d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0" Jun 08 13:04:07.629225 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:04:07.629206 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0\": container with ID starting with d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0 not found: ID does not exist" containerID="d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0" Jun 08 13:04:07.629288 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.629238 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0"} err="failed to get container status \"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0\": rpc error: code = NotFound desc = could not find container \"d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0\": container with ID starting with d0984b44239f02fb3bc26e1b780661dfaafed772ae7077d39461bbdd65228cd0 not found: ID does not exist" Jun 08 13:04:07.638418 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.638389 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 13:04:07.643973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:07.643946 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79955f8ff6-5fsvw"] Jun 08 13:04:09.158666 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:09.158631 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" path="/var/lib/kubelet/pods/38291e55-62b6-4c5e-a6a2-5248c01e9e32/volumes" Jun 08 13:04:54.226300 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.226200 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fc9cfc695-zgtrl"] Jun 08 13:04:54.226925 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.226838 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" containerName="console" Jun 08 13:04:54.226925 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.226860 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" containerName="console" Jun 08 13:04:54.227047 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.226970 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="38291e55-62b6-4c5e-a6a2-5248c01e9e32" containerName="console" Jun 08 13:04:54.230227 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.230205 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.236704 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.236674 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc9cfc695-zgtrl"] Jun 08 13:04:54.346050 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.346011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx85v\" (UniqueName: \"kubernetes.io/projected/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-kube-api-access-cx85v\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.346243 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.346068 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-oidc-ca\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.346243 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.346155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-tls-cert\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.447617 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.447580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx85v\" (UniqueName: \"kubernetes.io/projected/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-kube-api-access-cx85v\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.447800 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.447641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-oidc-ca\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.447800 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.447680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-tls-cert\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.448232 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.448211 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-oidc-ca\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.449958 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.449940 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-tls-cert\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.455389 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.455361 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx85v\" (UniqueName: \"kubernetes.io/projected/c8acea12-cb7f-4bff-ae76-6a06fb22fe08-kube-api-access-cx85v\") pod \"authorino-5fc9cfc695-zgtrl\" (UID: \"c8acea12-cb7f-4bff-ae76-6a06fb22fe08\") " pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.541819 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.541727 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" Jun 08 13:04:54.685442 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.685407 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc9cfc695-zgtrl"] Jun 08 13:04:54.685717 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:04:54.685694 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8acea12_cb7f_4bff_ae76_6a06fb22fe08.slice/crio-d04de8af13732d2bf041f6330f10332b8f959529e392cb3700142ad3504ba593 WatchSource:0}: Error finding container d04de8af13732d2bf041f6330f10332b8f959529e392cb3700142ad3504ba593: Status 404 returned error can't find the container with id d04de8af13732d2bf041f6330f10332b8f959529e392cb3700142ad3504ba593 Jun 08 13:04:54.842837 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.842741 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:04:54.900995 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.900961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" event={"ID":"c8acea12-cb7f-4bff-ae76-6a06fb22fe08","Type":"ContainerStarted","Data":"d04de8af13732d2bf041f6330f10332b8f959529e392cb3700142ad3504ba593"} Jun 08 13:04:54.937668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:54.937625 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:04:55.909397 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:55.909312 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" event={"ID":"c8acea12-cb7f-4bff-ae76-6a06fb22fe08","Type":"ContainerStarted","Data":"b21c14cdb10db06b1e9d3d3935d16e9811f27ffcaf7b8bbcb78e85a76ff2fb69"} Jun 08 13:04:55.939833 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:55.939765 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5fc9cfc695-zgtrl" podStartSLOduration=1.5126208289999998 podStartE2EDuration="1.939736976s" totalImagesPullingTime="427.116147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:04:55.937907111 +0000 UTC m=+811.282331424" watchObservedRunningTime="2026-06-08 13:04:55.939736976 +0000 UTC m=+811.284161262" Jun 08 13:04:55.983990 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:55.983952 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:04:55.993539 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:55.992650 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:04:55.993539 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:55.992857 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" podUID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" containerName="authorino" containerID="cri-o://4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f" gracePeriod=30 Jun 08 13:04:56.070645 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.070597 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:04:56.253186 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.253161 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:04:56.364470 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.364441 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert\") pod \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " Jun 08 13:04:56.364667 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.364512 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca\") pod \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " Jun 08 13:04:56.364667 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.364590 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prmfc\" (UniqueName: \"kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc\") pod \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\" (UID: \"4575eeaf-d8c0-4236-b3b5-8d8b12228be0\") " Jun 08 13:04:56.366533 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.366487 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc" (OuterVolumeSpecName: "kube-api-access-prmfc") pod "4575eeaf-d8c0-4236-b3b5-8d8b12228be0" (UID: "4575eeaf-d8c0-4236-b3b5-8d8b12228be0"). InnerVolumeSpecName "kube-api-access-prmfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:04:56.369773 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.369746 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4575eeaf-d8c0-4236-b3b5-8d8b12228be0" (UID: "4575eeaf-d8c0-4236-b3b5-8d8b12228be0"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:04:56.375192 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.375169 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4575eeaf-d8c0-4236-b3b5-8d8b12228be0" (UID: "4575eeaf-d8c0-4236-b3b5-8d8b12228be0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:04:56.466113 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.466078 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-tls-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:56.466113 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.466111 2568 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-oidc-ca\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:56.466305 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.466122 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prmfc\" (UniqueName: \"kubernetes.io/projected/4575eeaf-d8c0-4236-b3b5-8d8b12228be0-kube-api-access-prmfc\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:04:56.916373 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.916340 2568 generic.go:356] "Generic (PLEG): container finished" podID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" containerID="4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f" exitCode=0 Jun 08 13:04:56.916893 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.916384 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" Jun 08 13:04:56.916893 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.916380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" event={"ID":"4575eeaf-d8c0-4236-b3b5-8d8b12228be0","Type":"ContainerDied","Data":"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f"} Jun 08 13:04:56.916893 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.916438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8d44888b-tmjcf" event={"ID":"4575eeaf-d8c0-4236-b3b5-8d8b12228be0","Type":"ContainerDied","Data":"ab6ea41e736f6eaadf73bf8b079da65e0cd77a9082a04f0fc5795157d1fca3dc"} Jun 08 13:04:56.916893 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.916478 2568 scope.go:117] "RemoveContainer" containerID="4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f" Jun 08 13:04:56.927143 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.927059 2568 scope.go:117] "RemoveContainer" containerID="4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f" Jun 08 13:04:56.927414 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:04:56.927388 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f\": container with ID starting with 4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f not found: ID does not exist" containerID="4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f" Jun 08 13:04:56.927495 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.927427 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f"} err="failed to get container status \"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f\": rpc error: code = NotFound desc = could not find container \"4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f\": container with ID starting with 4a04590f5cdfcf1ce8138e512b060d0a7d18da048b04ee3edd0e8d92286bc99f not found: ID does not exist" Jun 08 13:04:56.940147 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.940111 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:04:56.940291 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:56.940159 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f8d44888b-tmjcf"] Jun 08 13:04:57.152728 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:04:57.152697 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" path="/var/lib/kubelet/pods/4575eeaf-d8c0-4236-b3b5-8d8b12228be0/volumes" Jun 08 13:06:25.191396 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:06:25.191304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:06:25.198545 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:06:25.198499 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:06:25.358609 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:06:25.358566 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:26.608622 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:06:26.608587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:42.001742 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:06:42.001705 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:10.669448 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:10.669412 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:10.756897 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:10.756857 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:19.113432 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:19.113391 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:22.207653 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:22.207609 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:24.878940 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:24.878898 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:24.974169 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:24.974131 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:56.980385 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:56.980290 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:57.061462 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:07:57.061429 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:20.932761 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:20.932719 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:26.773757 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:26.773702 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:26.873255 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:26.873211 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:26.971287 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:26.971251 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:27.142424 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:27.142335 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:27.245175 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:27.245130 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:43.638037 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:43.637999 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:43.771227 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:43.771194 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:43.869698 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:43.869661 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:49.787976 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:49.787931 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:49.884370 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:49.884328 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:57.956752 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:57.956715 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:58.071542 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:58.071479 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:58.188678 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:58.188639 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:58.281439 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:08:58.281348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:14.667904 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:14.667807 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:14.799940 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:14.799900 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:14.937304 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:14.937220 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:20.684450 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:20.684418 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:20.785687 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:20.785649 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:41.133550 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:41.133494 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:41.229045 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:41.229010 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:41.336342 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:41.336307 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:47.027221 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:47.027182 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:47.144716 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:47.144681 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:47.251261 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:47.251231 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:47.408807 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:47.408771 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:53.176160 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:53.176120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:53.349152 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:09:53.349117 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:13.104248 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:11:13.104209 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:21.941925 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:11:21.941887 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:22.156900 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:11:22.156859 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:25.234260 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:11:25.234234 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:11:25.259069 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:11:25.259044 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:12:08.539234 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:12:08.539190 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:25.272783 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:16:25.272754 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:16:25.297573 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:16:25.297551 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:16:35.379078 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:16:35.379049 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:20.890442 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:17:20.890404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:19:45.476366 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:19:45.476270 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:21:25.310432 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:21:25.310407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:21:25.335674 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:21:25.335650 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:25:23.671489 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:25:23.671459 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:23.838958 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:23.838920 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:23.895700 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:23.895662 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:25.345776 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:25.345751 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:26:25.377623 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:25.377603 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:26:50.229498 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:50.229461 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:55.614635 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:26:55.614600 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:19.993639 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:19.993553 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:32.954531 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:32.954494 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:34.562948 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.562912 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:34.563400 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.563276 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" containerName="authorino" Jun 08 13:27:34.563400 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.563288 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" containerName="authorino" Jun 08 13:27:34.563400 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.563382 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4575eeaf-d8c0-4236-b3b5-8d8b12228be0" containerName="authorino" Jun 08 13:27:34.565190 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.565170 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.567856 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.567837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e3820926-openshift-default-dockercfg-mffzn\"" Jun 08 13:27:34.595416 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.595395 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:34.621268 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.621241 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:34.666502 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666627 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666627 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666717 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666717 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzmz\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666717 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666835 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666835 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.666835 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.666768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.701548 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.701492 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:34.767527 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzmz\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767649 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767649 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767649 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767649 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767649 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767931 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767931 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767701 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.767931 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.768135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.767998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.768135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.768058 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.768292 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.768272 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.768374 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.768277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.768552 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.768508 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.770108 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.770087 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.770210 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.770174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.784637 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.784612 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzmz\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.786201 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.786175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token\") pod \"e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.808001 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.807974 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:34.876013 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.875962 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:34.914186 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:34.914159 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:35.014943 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.014915 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:35.015234 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:27:35.015211 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d144e6a_27db_4c46_8bda_1d647b326eb8.slice/crio-e88c3947f0355634fd3e370f7485096d75968ad3089787667e405b009c3a5659 WatchSource:0}: Error finding container e88c3947f0355634fd3e370f7485096d75968ad3089787667e405b009c3a5659: Status 404 returned error can't find the container with id e88c3947f0355634fd3e370f7485096d75968ad3089787667e405b009c3a5659 Jun 08 13:27:35.017250 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.017217 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:35.017318 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.017282 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:35.017318 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.017311 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:35.656446 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.656413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" event={"ID":"2d144e6a-27db-4c46-8bda-1d647b326eb8","Type":"ContainerStarted","Data":"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599"} Jun 08 13:27:35.656925 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.656462 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" event={"ID":"2d144e6a-27db-4c46-8bda-1d647b326eb8","Type":"ContainerStarted","Data":"e88c3947f0355634fd3e370f7485096d75968ad3089787667e405b009c3a5659"} Jun 08 13:27:35.678038 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.677998 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" podStartSLOduration=1.6779836540000002 podStartE2EDuration="1.677983654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:27:35.676971228 +0000 UTC m=+2171.021395507" watchObservedRunningTime="2026-06-08 13:27:35.677983654 +0000 UTC m=+2171.022407933" Jun 08 13:27:35.876298 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:35.876271 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:36.880989 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:36.880965 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:37.667635 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:37.667604 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:37.668471 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:37.668455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:39.141559 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:39.141510 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:40.846852 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:40.846809 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:41.012296 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:41.012266 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:41.012445 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:41.012426 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" podUID="2d144e6a-27db-4c46-8bda-1d647b326eb8" containerName="istio-proxy" containerID="cri-o://542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599" gracePeriod=30 Jun 08 13:27:41.044984 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:41.044953 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:41.137790 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:41.137711 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:42.596539 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:42.596486 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:46.259552 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.259509 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:46.361472 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361411 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361472 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361446 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361474 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361535 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361562 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361668 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361642 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361672 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361699 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361767 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtzmz\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361799 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket\") pod \"2d144e6a-27db-4c46-8bda-1d647b326eb8\" (UID: \"2d144e6a-27db-4c46-8bda-1d647b326eb8\") " Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361828 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:27:46.361942 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361888 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.361970 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362056 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362174 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-data\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362192 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-socket\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362208 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-credential-socket\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362223 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d144e6a-27db-4c46-8bda-1d647b326eb8-istiod-ca-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.362262 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.362236 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-workload-certs\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.363807 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.363783 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:46.363807 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.363789 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz" (OuterVolumeSpecName: "kube-api-access-vtzmz") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "kube-api-access-vtzmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:27:46.363945 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.363824 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 13:27:46.363945 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.363823 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d144e6a-27db-4c46-8bda-1d647b326eb8" (UID: "2d144e6a-27db-4c46-8bda-1d647b326eb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:27:46.462821 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.462799 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-envoy\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.462821 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.462820 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtzmz\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-kube-api-access-vtzmz\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.462956 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.462830 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-podinfo\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.462956 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.462839 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d144e6a-27db-4c46-8bda-1d647b326eb8-istio-token\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:46.727166 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.727136 2568 generic.go:356] "Generic (PLEG): container finished" podID="2d144e6a-27db-4c46-8bda-1d647b326eb8" containerID="542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599" exitCode=0 Jun 08 13:27:46.727329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.727182 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" Jun 08 13:27:46.727329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.727235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" event={"ID":"2d144e6a-27db-4c46-8bda-1d647b326eb8","Type":"ContainerDied","Data":"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599"} Jun 08 13:27:46.727329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.727286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd" event={"ID":"2d144e6a-27db-4c46-8bda-1d647b326eb8","Type":"ContainerDied","Data":"e88c3947f0355634fd3e370f7485096d75968ad3089787667e405b009c3a5659"} Jun 08 13:27:46.727329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.727311 2568 scope.go:117] "RemoveContainer" containerID="542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599" Jun 08 13:27:46.737186 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.737167 2568 scope.go:117] "RemoveContainer" containerID="542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599" Jun 08 13:27:46.737410 ip-10-0-132-250 kubenswrapper[2568]: E0608 13:27:46.737394 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599\": container with ID starting with 542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599 not found: ID does not exist" containerID="542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599" Jun 08 13:27:46.737454 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.737417 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599"} err="failed to get container status \"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599\": rpc error: code = NotFound desc = could not find container \"542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599\": container with ID starting with 542fc55c6eed2a73acd29c831b7b08b0e4528b7ce6ba96eab4addd4ab2054599 not found: ID does not exist" Jun 08 13:27:46.749790 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.749768 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:46.753903 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.753873 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e3820926-openshift-default-7d5b5f4cb4-n57vd"] Jun 08 13:27:46.940844 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:46.940813 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:47.015801 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.015721 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:47.152944 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.152917 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d144e6a-27db-4c46-8bda-1d647b326eb8" path="/var/lib/kubelet/pods/2d144e6a-27db-4c46-8bda-1d647b326eb8/volumes" Jun 08 13:27:47.285637 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.285570 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:27:47.285993 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.285937 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d144e6a-27db-4c46-8bda-1d647b326eb8" containerName="istio-proxy" Jun 08 13:27:47.285993 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.285976 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d144e6a-27db-4c46-8bda-1d647b326eb8" containerName="istio-proxy" Jun 08 13:27:47.286129 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.286105 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d144e6a-27db-4c46-8bda-1d647b326eb8" containerName="istio-proxy" Jun 08 13:27:47.288707 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.288690 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.291331 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.291310 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-79230a4e-openshift-default-dockercfg-2pgxq\"" Jun 08 13:27:47.318613 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.318589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:27:47.371281 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371426 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371426 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371426 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbfz\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371426 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371591 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371591 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371591 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.371591 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.371547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.420729 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.420694 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:47.471968 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.471940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472101 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.471974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472101 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.471998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472101 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472101 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472325 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472325 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472209 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472325 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbfz\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472325 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472619 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472619 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472794 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472873 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472801 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.472873 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.472832 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.476003 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.475948 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.476265 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.476160 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.495979 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.495959 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.503399 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.503373 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbfz\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz\") pod \"e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.602191 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.602134 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:47.622290 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.622259 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:47.838299 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.838119 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:27:47.841605 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:27:47.841578 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd461fe_0019_4643_872f_5c8da96bd5a6.slice/crio-ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc WatchSource:0}: Error finding container ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc: Status 404 returned error can't find the container with id ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc Jun 08 13:27:47.843801 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.843768 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:47.843899 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.843827 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:47.843899 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:47.843856 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 08 13:27:48.741753 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:48.741719 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" event={"ID":"9cd461fe-0019-4643-872f-5c8da96bd5a6","Type":"ContainerStarted","Data":"3b68b4c28a64436ab0e99b506b6299aad86683e01f1754672eda43cc35daaf7b"} Jun 08 13:27:48.742194 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:48.741773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" event={"ID":"9cd461fe-0019-4643-872f-5c8da96bd5a6","Type":"ContainerStarted","Data":"ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc"} Jun 08 13:27:48.772309 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:48.772262 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" podStartSLOduration=1.77224871 podStartE2EDuration="1.77224871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:27:48.769250709 +0000 UTC m=+2184.113675002" watchObservedRunningTime="2026-06-08 13:27:48.77224871 +0000 UTC m=+2184.116672989" Jun 08 13:27:49.602985 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:49.602945 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:49.608102 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:49.608078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:49.747390 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:49.747364 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:49.748304 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:49.748288 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:50.584025 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:50.583983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:53.453026 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:53.452989 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:54.567839 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:54.567809 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:27:54.568268 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:54.567968 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" podUID="9cd461fe-0019-4643-872f-5c8da96bd5a6" containerName="istio-proxy" containerID="cri-o://3b68b4c28a64436ab0e99b506b6299aad86683e01f1754672eda43cc35daaf7b" gracePeriod=30 Jun 08 13:27:54.592109 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:54.592075 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:54.692260 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:54.692225 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:56.094082 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:56.094042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:27:59.813007 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.812981 2568 generic.go:356] "Generic (PLEG): container finished" podID="9cd461fe-0019-4643-872f-5c8da96bd5a6" containerID="3b68b4c28a64436ab0e99b506b6299aad86683e01f1754672eda43cc35daaf7b" exitCode=0 Jun 08 13:27:59.813340 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.813054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" event={"ID":"9cd461fe-0019-4643-872f-5c8da96bd5a6","Type":"ContainerDied","Data":"3b68b4c28a64436ab0e99b506b6299aad86683e01f1754672eda43cc35daaf7b"} Jun 08 13:27:59.813340 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.813117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" event={"ID":"9cd461fe-0019-4643-872f-5c8da96bd5a6","Type":"ContainerDied","Data":"ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc"} Jun 08 13:27:59.813340 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.813149 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceb6ed8591a22faa4f09c2da40beb1372c21783e73a25e7b6d50bec3a1497acc" Jun 08 13:27:59.816891 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.816875 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:27:59.878550 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878469 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chbfz\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878550 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878504 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878707 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878558 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878707 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878581 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878707 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878601 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878707 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878620 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878780 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878836 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878847 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878875 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy\") pod \"9cd461fe-0019-4643-872f-5c8da96bd5a6\" (UID: \"9cd461fe-0019-4643-872f-5c8da96bd5a6\") " Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878872 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:59.878973 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.878939 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879052 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879093 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879248 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-data\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879263 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-credential-socket\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879274 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-certs\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879294 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd461fe-0019-4643-872f-5c8da96bd5a6-istiod-ca-cert\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.879329 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.879312 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-workload-socket\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.880598 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.880573 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 13:27:59.881034 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.881013 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:27:59.881107 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.881033 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz" (OuterVolumeSpecName: "kube-api-access-chbfz") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "kube-api-access-chbfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:27:59.881181 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.881163 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cd461fe-0019-4643-872f-5c8da96bd5a6" (UID: "9cd461fe-0019-4643-872f-5c8da96bd5a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:27:59.979684 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.979661 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-envoy\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.979776 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.979684 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chbfz\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-kube-api-access-chbfz\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.979776 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.979700 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-podinfo\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:27:59.979776 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:27:59.979709 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd461fe-0019-4643-872f-5c8da96bd5a6-istio-token\") on node \"ip-10-0-132-250.ec2.internal\" DevicePath \"\"" Jun 08 13:28:00.819256 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:00.819228 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk" Jun 08 13:28:00.843901 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:00.843872 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:28:00.848345 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:00.848320 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-79230a4e-openshift-default-ffdbbf468-ltqpk"] Jun 08 13:28:01.158582 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:01.158547 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd461fe-0019-4643-872f-5c8da96bd5a6" path="/var/lib/kubelet/pods/9cd461fe-0019-4643-872f-5c8da96bd5a6/volumes" Jun 08 13:28:01.269247 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:01.269216 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:28:01.370400 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:01.370371 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:28:07.610770 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:07.610743 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc9cfc695-zgtrl_c8acea12-cb7f-4bff-ae76-6a06fb22fe08/authorino/0.log" Jun 08 13:28:12.414696 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:12.414666 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9d8bf5dcd-jc2rg_8cfd04d3-e751-453f-bd34-cbd91a4918f1/nginx/0.log" Jun 08 13:28:13.226407 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:13.226379 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fpn2r_722eb6f8-4a39-4cf9-a106-c7dbab16f176/manager/0.log" Jun 08 13:28:13.574069 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:13.573995 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-rp644_6c75ab85-01ff-4b33-b23e-b8c40eb1f632/copy-manifests/0.log" Jun 08 13:28:13.590841 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:13.590805 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-rp644_6c75ab85-01ff-4b33-b23e-b8c40eb1f632/manager/0.log" Jun 08 13:28:13.697355 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:13.697321 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-46v6m_788d4531-2e2a-46e8-b999-4e74e5f9eac7/postgres/0.log" Jun 08 13:28:14.462664 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.462633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/util/0.log" Jun 08 13:28:14.469224 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.469188 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/pull/0.log" Jun 08 13:28:14.475999 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.475980 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/extract/0.log" Jun 08 13:28:14.581780 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.581763 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/util/0.log" Jun 08 13:28:14.587806 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.587786 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/pull/0.log" Jun 08 13:28:14.594098 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.594079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/extract/0.log" Jun 08 13:28:14.698970 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.698950 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/util/0.log" Jun 08 13:28:14.705442 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.705426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/pull/0.log" Jun 08 13:28:14.711809 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.711789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/extract/0.log" Jun 08 13:28:14.818964 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.818910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/util/0.log" Jun 08 13:28:14.825148 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.825131 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/pull/0.log" Jun 08 13:28:14.831252 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.831235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/extract/0.log" Jun 08 13:28:14.946558 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:14.946538 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc9cfc695-zgtrl_c8acea12-cb7f-4bff-ae76-6a06fb22fe08/authorino/0.log" Jun 08 13:28:15.184686 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:15.184657 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5dw2x_d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1/manager/0.log" Jun 08 13:28:15.412102 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:15.412069 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvtnt_afda5961-59e0-4d8e-833e-6dc095291c3a/registry-server/0.log" Jun 08 13:28:15.788822 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:15.788793 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2ldh_af6fe7c6-480e-4c1d-91de-325d7d4977c5/manager/0.log" Jun 08 13:28:16.168617 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:16.168592 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc47z69_209296d6-d9bc-4b1a-af9a-3e877b83dc90/istio-proxy/0.log" Jun 08 13:28:16.997939 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:16.997909 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65f9c7f667-7skqb_7004f5a9-acc6-43bc-9505-a953c3bd6c86/router/0.log" Jun 08 13:28:22.282289 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:22.282252 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:28:22.385862 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:22.385830 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" limit=1024 Jun 08 13:28:25.785183 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:25.785112 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r5nlg_e0c1dd8c-7311-4318-95c5-03dd64a347b6/global-pull-secret-syncer/0.log" Jun 08 13:28:25.840081 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:25.840055 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hzdwg_3e10d114-23eb-4173-9b77-e36f49813b91/konnectivity-agent/0.log" Jun 08 13:28:25.940567 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:25.940545 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-250.ec2.internal_aa196d6cc65c8689ea2b6295977c450b/haproxy/0.log" Jun 08 13:28:30.660070 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.660036 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/extract/0.log" Jun 08 13:28:30.683234 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.683209 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/util/0.log" Jun 08 13:28:30.712315 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.712295 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p56dr_519c3adb-d2a3-4282-920e-c1eedd260621/pull/0.log" Jun 08 13:28:30.750852 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.750834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/extract/0.log" Jun 08 13:28:30.773421 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.773399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/util/0.log" Jun 08 13:28:30.794835 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.794815 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hj555_8c89b326-31bc-47f4-8851-7409d26779c0/pull/0.log" Jun 08 13:28:30.829607 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.829590 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/extract/0.log" Jun 08 13:28:30.855050 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.855035 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/util/0.log" Jun 08 13:28:30.885011 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.884985 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73spl8z_e4c023ee-34a6-4b50-984e-c94cca4ae13e/pull/0.log" Jun 08 13:28:30.909040 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.909020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/extract/0.log" Jun 08 13:28:30.929726 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.929674 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/util/0.log" Jun 08 13:28:30.949637 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:30.949615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m7x4k_09d99dd0-6921-4f99-a1f9-152d352cc441/pull/0.log" Jun 08 13:28:31.210059 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:31.209975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc9cfc695-zgtrl_c8acea12-cb7f-4bff-ae76-6a06fb22fe08/authorino/0.log" Jun 08 13:28:31.299148 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:31.299124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5dw2x_d1e404d0-5d7b-41fe-a3cb-659afc5ba9c1/manager/0.log" Jun 08 13:28:31.388406 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:31.388383 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvtnt_afda5961-59e0-4d8e-833e-6dc095291c3a/registry-server/0.log" Jun 08 13:28:31.598758 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:31.598704 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2ldh_af6fe7c6-480e-4c1d-91de-325d7d4977c5/manager/0.log" Jun 08 13:28:33.186741 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.186712 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/alertmanager/0.log" Jun 08 13:28:33.217095 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.217072 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/config-reloader/0.log" Jun 08 13:28:33.237831 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.237808 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/kube-rbac-proxy-web/0.log" Jun 08 13:28:33.261110 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.261088 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/kube-rbac-proxy/0.log" Jun 08 13:28:33.288115 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.288098 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/kube-rbac-proxy-metric/0.log" Jun 08 13:28:33.310714 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.310694 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/prom-label-proxy/0.log" Jun 08 13:28:33.337386 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.337363 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956b2550-92e9-4250-a75b-7a3cbfdf2389/init-config-reloader/0.log" Jun 08 13:28:33.389526 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.389504 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xmt9q_2ab00a37-8256-4ad0-8686-972333016c60/cluster-monitoring-operator/0.log" Jun 08 13:28:33.578292 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.578229 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qkws_33821acd-699b-4432-afd3-548b4fc362c5/node-exporter/0.log" Jun 08 13:28:33.597626 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.597605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qkws_33821acd-699b-4432-afd3-548b4fc362c5/kube-rbac-proxy/0.log" Jun 08 13:28:33.617198 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:33.617180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qkws_33821acd-699b-4432-afd3-548b4fc362c5/init-textfile/0.log" Jun 08 13:28:34.146161 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:34.146124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-nk294_7357f39f-d7ca-425e-85dc-302447abd1f1/prometheus-operator-admission-webhook/0.log" Jun 08 13:28:34.175481 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:34.175457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84968755c7-vtqs7_aabeb1d9-8939-44d3-8cc0-f2394f863721/telemeter-client/0.log" Jun 08 13:28:34.198788 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:34.198758 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84968755c7-vtqs7_aabeb1d9-8939-44d3-8cc0-f2394f863721/reload/0.log" Jun 08 13:28:34.218729 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:34.218703 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84968755c7-vtqs7_aabeb1d9-8939-44d3-8cc0-f2394f863721/kube-rbac-proxy/0.log" Jun 08 13:28:35.652023 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:35.651997 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-jxjxq_2fd4590d-4bcf-4b29-bf2f-010b7e78e5f0/networking-console-plugin/0.log" Jun 08 13:28:36.342162 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:36.342126 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/1.log" Jun 08 13:28:36.349220 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:36.349198 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cgrsh_10392597-91ed-4619-ac9c-4d5555902c36/console-operator/2.log" Jun 08 13:28:36.948473 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:36.948449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b77595979-chww2_e3a2d15c-17b3-4d7f-8bac-4a14202d8e35/console/0.log" Jun 08 13:28:37.001512 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.001494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-f8478_9009226e-8a2d-4553-8f7d-011ffeb385d6/download-server/0.log" Jun 08 13:28:37.164846 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.164818 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7"] Jun 08 13:28:37.165204 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.165192 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd461fe-0019-4643-872f-5c8da96bd5a6" containerName="istio-proxy" Jun 08 13:28:37.165250 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.165205 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd461fe-0019-4643-872f-5c8da96bd5a6" containerName="istio-proxy" Jun 08 13:28:37.165285 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.165268 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd461fe-0019-4643-872f-5c8da96bd5a6" containerName="istio-proxy" Jun 08 13:28:37.167813 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.167795 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.171098 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.171084 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmw6\"/\"openshift-service-ca.crt\"" Jun 08 13:28:37.171812 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.171791 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzmw6\"/\"default-dockercfg-rqr4g\"" Jun 08 13:28:37.171812 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.171809 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmw6\"/\"kube-root-ca.crt\"" Jun 08 13:28:37.180036 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.180014 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7"] Jun 08 13:28:37.283605 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.283545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-podres\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.283605 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.283589 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-lib-modules\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.283770 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.283650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-proc\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.283770 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.283678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-sys\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.283770 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.283709 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dbfk\" (UniqueName: \"kubernetes.io/projected/8e1a4070-b0ab-4a3b-903a-22762869ff14-kube-api-access-2dbfk\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384304 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-podres\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384394 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-lib-modules\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384394 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384346 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-proc\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384394 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-sys\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384562 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dbfk\" (UniqueName: \"kubernetes.io/projected/8e1a4070-b0ab-4a3b-903a-22762869ff14-kube-api-access-2dbfk\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384562 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384428 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-proc\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384562 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-lib-modules\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384562 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-podres\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.384562 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.384496 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1a4070-b0ab-4a3b-903a-22762869ff14-sys\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.392217 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.392194 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dbfk\" (UniqueName: \"kubernetes.io/projected/8e1a4070-b0ab-4a3b-903a-22762869ff14-kube-api-access-2dbfk\") pod \"perf-node-gather-daemonset-hpnr7\" (UID: \"8e1a4070-b0ab-4a3b-903a-22762869ff14\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.477568 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.477548 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:37.604287 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.604261 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7"] Jun 08 13:28:37.605792 ip-10-0-132-250 kubenswrapper[2568]: W0608 13:28:37.605768 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e1a4070_b0ab_4a3b_903a_22762869ff14.slice/crio-c92b02b7a32e8b0b05c8aaebb080c6e1d0c475704c8606759641dfdbc4026ee9 WatchSource:0}: Error finding container c92b02b7a32e8b0b05c8aaebb080c6e1d0c475704c8606759641dfdbc4026ee9: Status 404 returned error can't find the container with id c92b02b7a32e8b0b05c8aaebb080c6e1d0c475704c8606759641dfdbc4026ee9 Jun 08 13:28:37.910135 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:37.910112 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-8rh7p_cb726232-c2db-453d-9d8c-deb609fd01e3/volume-data-source-validator/0.log" Jun 08 13:28:38.034578 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:38.034555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" event={"ID":"8e1a4070-b0ab-4a3b-903a-22762869ff14","Type":"ContainerStarted","Data":"3c0c08c7357cbb60d469eeed653402439ab42f21c87f47c4b764878de8a7b346"} Jun 08 13:28:38.034869 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:38.034606 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:38.034869 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:38.034626 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" event={"ID":"8e1a4070-b0ab-4a3b-903a-22762869ff14","Type":"ContainerStarted","Data":"c92b02b7a32e8b0b05c8aaebb080c6e1d0c475704c8606759641dfdbc4026ee9"} Jun 08 13:28:38.054158 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:38.054121 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" podStartSLOduration=1.054104986 podStartE2EDuration="1.054104986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:28:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:28:38.052348364 +0000 UTC m=+2233.396772643" watchObservedRunningTime="2026-06-08 13:28:38.054104986 +0000 UTC m=+2233.398529266" Jun 08 13:28:39.140535 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:39.140485 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skpfx_80ae8e68-b603-4149-98b9-fad5280ec13d/dns/0.log" Jun 08 13:28:39.211580 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:39.211558 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skpfx_80ae8e68-b603-4149-98b9-fad5280ec13d/kube-rbac-proxy/0.log" Jun 08 13:28:39.350868 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:39.350845 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5w26_3f8b65ce-138b-4fe3-a710-3d242bab1f6d/dns-node-resolver/0.log" Jun 08 13:28:39.997163 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:39.997138 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmlr5_90f9710c-0c45-40de-bdee-000cee2b3227/node-ca/0.log" Jun 08 13:28:41.058545 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:41.058504 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc47z69_209296d6-d9bc-4b1a-af9a-3e877b83dc90/istio-proxy/0.log" Jun 08 13:28:41.420057 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:41.420032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65f9c7f667-7skqb_7004f5a9-acc6-43bc-9505-a953c3bd6c86/router/0.log" Jun 08 13:28:42.084756 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.084726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f7k7g_746735bf-77a6-493d-91dd-f005ff0c0304/serve-healthcheck-canary/0.log" Jun 08 13:28:42.619712 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.619682 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fntcz_6c696c6c-cfaa-4c31-aac6-83e4917a868a/insights-operator/0.log" Jun 08 13:28:42.620499 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.620468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fntcz_6c696c6c-cfaa-4c31-aac6-83e4917a868a/insights-operator/1.log" Jun 08 13:28:42.647267 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.647247 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88fhm_fc566fb5-630f-42c7-98af-cfbde54e703f/kube-rbac-proxy/0.log" Jun 08 13:28:42.668107 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.668087 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88fhm_fc566fb5-630f-42c7-98af-cfbde54e703f/exporter/0.log" Jun 08 13:28:42.692586 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:42.692564 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88fhm_fc566fb5-630f-42c7-98af-cfbde54e703f/extractor/0.log" Jun 08 13:28:44.049595 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:44.049569 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-hpnr7" Jun 08 13:28:45.202437 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:45.202374 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9d8bf5dcd-jc2rg_8cfd04d3-e751-453f-bd34-cbd91a4918f1/nginx/0.log" Jun 08 13:28:45.603573 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:45.603489 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fpn2r_722eb6f8-4a39-4cf9-a106-c7dbab16f176/manager/0.log" Jun 08 13:28:45.885928 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:45.885900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-rp644_6c75ab85-01ff-4b33-b23e-b8c40eb1f632/manager/0.log" Jun 08 13:28:45.908607 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:45.908582 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-rp644_6c75ab85-01ff-4b33-b23e-b8c40eb1f632/copy-manifests/0.log" Jun 08 13:28:45.938148 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:45.938128 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-46v6m_788d4531-2e2a-46e8-b999-4e74e5f9eac7/postgres/0.log" Jun 08 13:28:47.831146 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:47.831065 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f48cfb98d-6dr6h_134c2152-f336-4bfa-afa6-695bbbe3ea56/manager/0.log" Jun 08 13:28:47.897866 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:47.897840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4p4sx_df42a2b5-57d8-4881-9dbe-1c9968520d62/openshift-lws-operator/0.log" Jun 08 13:28:50.758782 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:50.758753 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc47z69_209296d6-d9bc-4b1a-af9a-3e877b83dc90/istio-proxy/0.log" Jun 08 13:28:51.043957 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:51.043890 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65f9c7f667-7skqb_7004f5a9-acc6-43bc-9505-a953c3bd6c86/router/0.log" Jun 08 13:28:52.223956 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:52.223925 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc47z69_209296d6-d9bc-4b1a-af9a-3e877b83dc90/istio-proxy/0.log" Jun 08 13:28:52.552334 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:52.552242 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65f9c7f667-7skqb_7004f5a9-acc6-43bc-9505-a953c3bd6c86/router/0.log" Jun 08 13:28:54.114129 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:54.114096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fh45d_17ea67fe-ed7e-4d33-af00-94a0af9122d9/kube-storage-version-migrator-operator/1.log" Jun 08 13:28:54.115866 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:54.115845 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fh45d_17ea67fe-ed7e-4d33-af00-94a0af9122d9/kube-storage-version-migrator-operator/0.log" Jun 08 13:28:54.304570 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:54.304541 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc47z69_209296d6-d9bc-4b1a-af9a-3e877b83dc90/istio-proxy/0.log" Jun 08 13:28:54.582684 ip-10-0-132-250 kubenswrapper[2568]: I0608 13:28:54.582658 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65f9c7f667-7skqb_7004f5a9-acc6-43bc-9505-a953c3bd6c86/router/0.log"