Jun 06 20:43:46.996916 ip-10-0-133-247 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 06 20:43:46.996923 ip-10-0-133-247 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 06 20:43:46.996930 ip-10-0-133-247 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 06 20:43:46.997075 ip-10-0-133-247 systemd[1]: Failed to start Kubernetes Kubelet. Jun 06 20:43:57.057490 ip-10-0-133-247 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 06 20:43:57.057513 ip-10-0-133-247 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 93db3056fc294c4b85ec83d0abfa5921 -- Jun 06 20:46:09.331927 ip-10-0-133-247 systemd[1]: Starting Kubernetes Kubelet... Jun 06 20:46:09.793214 ip-10-0-133-247 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:09.793214 ip-10-0-133-247 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 20:46:09.793214 ip-10-0-133-247 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:09.793214 ip-10-0-133-247 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 20:46:09.793214 ip-10-0-133-247 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:09.794337 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.794245 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 20:46:09.798624 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798602 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.798624 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798620 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.798624 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798624 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.798624 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798628 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.798624 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798632 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798637 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798641 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798645 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798648 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798653 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798657 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798660 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798664 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798667 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798671 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798675 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798679 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798683 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798688 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798692 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798696 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798700 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798704 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.798922 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798708 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798711 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798716 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798720 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798724 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798728 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798736 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798740 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798744 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798749 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798753 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798757 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798761 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798765 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798769 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798774 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798779 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798784 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798788 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798792 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.799824 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798796 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798801 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798805 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798809 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798813 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798819 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798823 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798828 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798833 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798837 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798842 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798846 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798850 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798855 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798859 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798864 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798870 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798877 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798883 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.800704 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798888 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798893 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798898 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798902 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798907 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798914 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798919 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798923 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798929 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798933 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798938 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798943 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798947 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798952 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798959 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798963 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798968 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798972 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798979 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798983 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.801212 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798987 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798991 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.798996 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799001 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799005 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799009 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799014 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799018 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799022 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799026 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799032 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799038 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799042 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799047 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799051 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799055 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.799059 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800247 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800257 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800262 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.801755 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800268 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800272 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800277 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800281 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800286 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800290 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800294 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800299 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800303 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800307 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800312 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800318 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800323 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800327 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800331 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800335 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800340 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800344 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800348 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800353 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.802252 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800357 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800361 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800365 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800370 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800374 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800379 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800382 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800387 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800391 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800396 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800401 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800405 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800410 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800433 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800438 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800443 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800447 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800451 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800456 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800460 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.802784 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800464 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800468 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800473 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800477 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800484 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800488 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800492 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800496 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800501 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800505 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800509 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800513 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800518 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800522 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800526 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800530 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800537 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800543 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800548 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800553 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.803286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800557 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800561 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800565 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800569 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800576 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800580 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800584 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800589 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800593 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800599 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800603 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800607 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800612 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800616 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800620 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800625 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800629 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800634 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800638 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800642 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.803796 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800646 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800650 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800654 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800658 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800662 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800667 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800671 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800675 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800679 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800683 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800687 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800694 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800699 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800704 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800710 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.800715 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801173 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801187 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801191 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.804309 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801195 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801198 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801201 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801204 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801207 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801210 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801213 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801216 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801219 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801222 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801225 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801228 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801230 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801233 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801236 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801239 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801241 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801244 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801246 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801248 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.804797 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801251 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801253 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801256 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801258 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801261 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801263 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801265 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801268 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801270 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801275 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801278 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801281 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801283 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801286 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801288 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801291 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801298 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801301 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801304 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801306 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.805286 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801309 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801311 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801314 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801317 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801320 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801323 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801326 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801329 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801331 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801334 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801336 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801339 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801342 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801344 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801346 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801349 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801351 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801355 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801357 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.805842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801362 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801366 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801370 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801374 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801377 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801380 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801383 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801385 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801388 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801391 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801393 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801396 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801400 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801403 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801406 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801409 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801412 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801414 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801430 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801433 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.806304 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801435 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801438 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801441 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801443 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801446 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801448 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801451 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801453 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801457 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801459 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801462 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801465 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801467 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801470 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801473 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801477 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.801481 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801557 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801564 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801571 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 20:46:09.806835 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801576 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801580 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801584 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801588 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801592 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801595 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801598 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801602 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801605 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801608 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801611 2555 flags.go:64] FLAG: --cgroup-root="" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801614 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801617 2555 flags.go:64] FLAG: --client-ca-file="" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801620 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801623 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801627 2555 flags.go:64] FLAG: --cluster-domain="" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801630 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801633 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801636 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801639 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801643 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801646 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801649 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 20:46:09.807364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801653 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801656 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801659 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801662 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801665 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801668 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801673 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801676 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801679 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801682 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801685 2555 flags.go:64] FLAG: --enable-server="true" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801688 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801693 2555 flags.go:64] FLAG: --event-burst="100" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801696 2555 flags.go:64] FLAG: --event-qps="50" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801699 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801703 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801706 2555 flags.go:64] FLAG: --eviction-hard="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801710 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801713 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801715 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801718 2555 flags.go:64] FLAG: --eviction-soft="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801721 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801724 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801731 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801734 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 20:46:09.807950 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801736 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801739 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801742 2555 flags.go:64] FLAG: --feature-gates="" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801746 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801749 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801753 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801756 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801759 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801763 2555 flags.go:64] FLAG: --help="false" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801766 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-133-247.ec2.internal" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801770 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801773 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801776 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801780 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801783 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801786 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801789 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801792 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801795 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801798 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801801 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801804 2555 flags.go:64] FLAG: --kube-reserved="" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801807 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801809 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 20:46:09.808617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801812 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801815 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801818 2555 flags.go:64] FLAG: --lock-file="" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801820 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801823 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801826 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801833 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801836 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801839 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801841 2555 flags.go:64] FLAG: --logging-format="text" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801844 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801848 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801851 2555 flags.go:64] FLAG: --manifest-url="" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801854 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801858 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801861 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801866 2555 flags.go:64] FLAG: --max-pods="110" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801869 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801872 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801875 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801878 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801881 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801884 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801889 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801895 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 20:46:09.809233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801899 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801902 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801905 2555 flags.go:64] FLAG: --pod-cidr="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801908 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801913 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801916 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801920 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801923 2555 flags.go:64] FLAG: --port="10250" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801925 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801928 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0965892848477522e" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801932 2555 flags.go:64] FLAG: --qos-reserved="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801935 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801937 2555 flags.go:64] FLAG: --register-node="true" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801942 2555 flags.go:64] FLAG: --register-with-taints="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801945 2555 flags.go:64] FLAG: --registry-burst="10" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801948 2555 flags.go:64] FLAG: --registry-qps="5" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801951 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801954 2555 flags.go:64] FLAG: --reserved-memory="" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801958 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801961 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801964 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801967 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801970 2555 flags.go:64] FLAG: --runonce="false" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801973 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801976 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 20:46:09.809873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801979 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801982 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801985 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801988 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801991 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801994 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.801998 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802001 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802003 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802006 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802009 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802012 2555 flags.go:64] FLAG: --system-cgroups="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802014 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802019 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802022 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802025 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802029 2555 flags.go:64] FLAG: --tls-min-version="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802032 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802034 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802037 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802044 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802047 2555 flags.go:64] FLAG: --v="2" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802051 2555 flags.go:64] FLAG: --version="false" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802055 2555 flags.go:64] FLAG: --vmodule="" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802059 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 20:46:09.810504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.802062 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802175 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802179 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802182 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802185 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802188 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802191 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802194 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802197 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802199 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802202 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802205 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802207 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802210 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802213 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802216 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802218 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802222 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802226 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802228 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.811127 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802231 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802234 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802236 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802239 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802242 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802245 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802247 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802251 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802253 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802256 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802259 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802261 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802264 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802267 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802270 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802272 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802278 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802281 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802284 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802287 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.811647 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802291 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802294 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802297 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802299 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802302 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802305 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802307 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802311 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802313 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802316 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802318 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802321 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802323 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802326 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802328 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802331 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802333 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802336 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802339 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802342 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.812143 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802345 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802347 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802350 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802352 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802355 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802358 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802361 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802365 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802369 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802372 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802375 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802377 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802380 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802382 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802385 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802388 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802390 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802392 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802395 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.812668 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802397 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802401 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802404 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802406 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802409 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802411 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802414 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802433 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802436 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802439 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802442 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802444 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802448 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802451 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802454 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802456 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802459 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802462 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802464 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802467 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.813140 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.802470 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.803244 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.810732 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.810750 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.810768 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.810774 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810828 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810833 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810837 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810840 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810843 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810845 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810848 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810851 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810854 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.813648 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810857 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810861 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810866 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810870 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810874 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810878 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810882 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810886 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810890 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810894 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810897 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810899 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810902 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810905 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810907 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810910 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810912 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810915 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810918 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810921 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.814021 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810924 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810927 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810930 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810933 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810936 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810938 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810941 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810944 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810946 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810949 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810951 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810954 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810956 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810959 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810962 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810964 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810968 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810973 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810978 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.814586 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810981 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810984 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810987 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810990 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810993 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810995 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.810998 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811000 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811003 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811005 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811008 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811010 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811013 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811017 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811019 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811022 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811025 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811028 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811030 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811033 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.815075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811035 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811038 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811040 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811042 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811045 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811047 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811050 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811052 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811055 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811058 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811060 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811063 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811065 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811067 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811070 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811074 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811077 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811080 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811082 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.815741 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811085 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811087 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811090 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811092 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811095 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811097 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811101 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811103 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811105 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811108 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811111 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811113 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.811118 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811234 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:09.816209 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811239 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811242 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811246 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811250 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811253 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811256 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811259 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811262 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811265 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811268 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811270 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811273 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811276 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811279 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811281 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811284 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811286 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811288 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811291 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:09.816597 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811293 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811296 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811299 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811301 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811304 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811306 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811309 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811312 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811314 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811317 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811319 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811322 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811324 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811327 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811329 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811331 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811334 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811337 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811339 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:09.817075 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811341 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811344 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811346 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811349 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811353 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811356 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811359 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811362 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811364 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811367 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811370 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811372 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811375 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811377 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811380 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811382 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811384 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811387 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811389 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:09.817554 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811392 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811395 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811398 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811400 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811403 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811405 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811408 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811410 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811413 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811428 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811431 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811434 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811436 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811439 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811443 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811445 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811448 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811451 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811454 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811456 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:09.818016 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811477 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811480 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811483 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811486 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811489 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811492 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811495 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811498 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811501 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811503 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811506 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811509 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811513 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811515 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811518 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811520 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811523 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811525 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811528 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811530 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:09.818536 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:09.811533 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.811538 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.811651 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.814858 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.816554 2555 server.go:1019] "Starting client certificate rotation" Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.816653 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:46:09.819022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.816692 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:46:09.820379 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.820319 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:46:09.822134 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.822115 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:46:09.834892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.834871 2555 log.go:25] "Validated CRI v1 runtime API" Jun 06 20:46:09.838100 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.838078 2555 log.go:25] "Validated CRI v1 image API" Jun 06 20:46:09.838956 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.838940 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 20:46:09.841452 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.841432 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:46:09.843990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.843972 2555 fs.go:135] Filesystem UUIDs: map[6cabdef4-2df3-46c5-afc4-09e24fb7a963:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a72988fb-83c8-4db7-8bd8-7d33af205195:/dev/nvme0n1p4] Jun 06 20:46:09.844055 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.843990 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 20:46:09.851070 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.850961 2555 manager.go:216] Machine: {Timestamp:2026-06-06 20:46:09.849526499 +0000 UTC m=+0.377277646 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100667 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24278006b7d948210a7f4acd4e73d5 SystemUUID:ec242780-06b7-d948-210a-7f4acd4e73d5 BootID:93db3056-fc29-4c4b-85ec-83d0abfa5921 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:a3:a0:e0:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:a3:a0:e0:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:b6:ba:f7:2c:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 20:46:09.851070 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.851063 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 20:46:09.851183 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.851145 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 20:46:09.854627 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.854599 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 20:46:09.854762 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.854628 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 20:46:09.855458 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.855448 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 20:46:09.855490 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.855461 2555 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 20:46:09.855490 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.855470 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:46:09.855490 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.855483 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:46:09.856783 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.856772 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 20:46:09.861196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861184 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:46:09.861316 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861306 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 20:46:09.861356 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861347 2555 kubelet.go:486] "Attempting to sync node with API server" Jun 06 20:46:09.861438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861367 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 20:46:09.861438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861382 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 20:46:09.861438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861390 2555 kubelet.go:398] "Adding apiserver pod source" Jun 06 20:46:09.861438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861399 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 20:46:09.861863 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861849 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:46:09.861906 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.861884 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:46:09.867367 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.867341 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 20:46:09.869154 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.869140 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 20:46:09.869203 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.869171 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 20:46:09.870572 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870560 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 20:46:09.870611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870576 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 20:46:09.870611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870583 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 20:46:09.870611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870590 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 20:46:09.870611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870603 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870612 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870622 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870627 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870634 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870639 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870647 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 20:46:09.870727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.870653 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 20:46:09.871570 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.871559 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 20:46:09.871616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.871576 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 20:46:09.872327 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.872302 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 20:46:09.872368 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.872302 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 20:46:09.874813 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.874794 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 20:46:09.875087 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.875076 2555 server.go:1268] "Started kubelet" Jun 06 20:46:09.875163 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.875134 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 20:46:09.875220 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.875171 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 20:46:09.875291 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.875270 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 20:46:09.875969 ip-10-0-133-247 systemd[1]: Started Kubernetes Kubelet. Jun 06 20:46:09.877233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.877217 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 20:46:09.877377 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.877360 2555 server.go:310] "Adding debug handlers to kubelet server" Jun 06 20:46:09.882099 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.882068 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 20:46:09.884680 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.883534 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-247.ec2.internal.18b698db31f58cc2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-247.ec2.internal,UID:ip-10-0-133-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-247.ec2.internal,},FirstTimestamp:2026-06-06 20:46:09.87504557 +0000 UTC m=+0.402796716,LastTimestamp:2026-06-06 20:46:09.87504557 +0000 UTC m=+0.402796716,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-247.ec2.internal,}" Jun 06 20:46:09.884911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.884895 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 20:46:09.885011 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.884989 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 20:46:09.885058 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.885025 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:09.885723 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.885703 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 20:46:09.885875 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.885848 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 20:46:09.885875 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.885883 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 20:46:09.886022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886006 2555 factory.go:55] Registering systemd factory Jun 06 20:46:09.886114 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886072 2555 factory.go:223] Registration of the systemd container factory successfully Jun 06 20:46:09.886114 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886078 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 06 20:46:09.886114 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886088 2555 reconciler.go:29] "Reconciler: start to sync state" Jun 06 20:46:09.886332 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886312 2555 factory.go:153] Registering CRI-O factory Jun 06 20:46:09.886386 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886335 2555 factory.go:223] Registration of the crio container factory successfully Jun 06 20:46:09.886469 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886388 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 20:46:09.886469 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886466 2555 factory.go:103] Registering Raw factory Jun 06 20:46:09.886569 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.886557 2555 manager.go:1196] Started watching for new ooms in manager Jun 06 20:46:09.887365 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.887349 2555 manager.go:349] Starting recovery of all containers Jun 06 20:46:09.889603 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.889572 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 20:46:09.889852 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.889719 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 20:46:09.890618 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.890307 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xgkv" Jun 06 20:46:09.896635 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.896412 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xgkv" Jun 06 20:46:09.899488 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.899469 2555 manager.go:354] Recovery completed Jun 06 20:46:09.903719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.903701 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:09.905551 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.905531 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:09.905636 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.905565 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:09.905636 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.905576 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:09.906137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906119 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 20:46:09.906137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906132 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:09.906251 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906134 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 20:46:09.906251 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906190 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:46:09.906911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906894 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:09.906975 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906924 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:09.906975 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.906935 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:09.906975 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.906875 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-247.ec2.internal.18b698db33c7028c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-247.ec2.internal,UID:ip-10-0-133-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-247.ec2.internal,},FirstTimestamp:2026-06-06 20:46:09.905549964 +0000 UTC m=+0.433301113,LastTimestamp:2026-06-06 20:46:09.905549964 +0000 UTC m=+0.433301113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-247.ec2.internal,}" Jun 06 20:46:09.908068 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.908055 2555 policy_none.go:49] "None policy: Start" Jun 06 20:46:09.908120 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.908073 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 20:46:09.908120 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.908084 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 20:46:09.909927 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.909916 2555 policy_none.go:47] "Start" Jun 06 20:46:09.945058 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945039 2555 manager.go:337] "Starting Device Plugin manager" Jun 06 20:46:09.945180 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.945079 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 20:46:09.945180 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945092 2555 server.go:87] "Starting device plugin registration server" Jun 06 20:46:09.945414 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945402 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 20:46:09.945478 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945434 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 20:46:09.945725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945631 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 20:46:09.945907 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945887 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 20:46:09.945907 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.945904 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 20:46:09.947401 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.947335 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 20:46:09.947401 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.947400 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:09.965636 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.965602 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 20:46:09.974438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.966813 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 20:46:09.974438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.966857 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 20:46:09.974438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.966888 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 20:46:09.974438 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:09.966928 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 20:46:09.974438 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:09.969490 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:10.046042 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.045963 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:10.047068 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.047052 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:10.047138 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.047082 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:10.047138 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.047092 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:10.047138 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.047115 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.056277 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.056251 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.056334 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.056283 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-247.ec2.internal\": node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.067775 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.067738 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal"] Jun 06 20:46:10.067865 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.067810 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:10.069651 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.069630 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:10.069728 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.069665 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:10.069728 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.069687 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:10.072258 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.072244 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:10.072378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.072356 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.072452 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.072391 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:10.073065 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073046 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:10.073065 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073064 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:10.073178 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073082 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:10.073178 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073082 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:10.073178 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073096 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:10.073178 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.073105 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:10.075591 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.075574 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.075655 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.075609 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:10.076298 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.076284 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:10.076360 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.076309 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:10.076360 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.076324 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:10.083512 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.083496 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.087709 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.087692 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.087764 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.087715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.087764 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.087733 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.093011 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.092996 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-247.ec2.internal\" not found" node="ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.097673 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.097659 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-247.ec2.internal\" not found" node="ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.184211 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.184179 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.188534 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.188608 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.188608 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188563 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.188608 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.188712 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188625 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.188712 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.188605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.284732 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.284703 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.385487 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.385403 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.399816 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.399793 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.404537 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.404345 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.485946 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.485885 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.586308 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.586276 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.686842 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.686755 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.787224 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.787194 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 06 20:46:10.815521 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.815482 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 20:46:10.816118 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.815695 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:46:10.850903 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.850874 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:10.862348 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.862318 2555 apiserver.go:52] "Watching apiserver" Jun 06 20:46:10.873564 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.873534 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 20:46:10.873911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.873886 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qv28n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp","openshift-image-registry/node-ca-pvqkq","openshift-multus/multus-additional-cni-plugins-kpr4w","openshift-network-diagnostics/network-check-target-z2rl6","openshift-network-operator/iptables-alerter-fv9kn","openshift-ovn-kubernetes/ovnkube-node-h2496","kube-system/global-pull-secret-syncer-d8mxb","openshift-cluster-node-tuning-operator/tuned-n2w7l","openshift-dns/node-resolver-4rsf5","openshift-multus/multus-gnp9m","openshift-multus/network-metrics-daemon-hdrrk"] Jun 06 20:46:10.876292 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.876265 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.878187 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.878165 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.878704 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.878688 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 20:46:10.878842 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.878825 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-89j2r\"" Jun 06 20:46:10.878904 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.878892 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 20:46:10.880203 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.880187 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.880599 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.880579 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 20:46:10.881051 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.881030 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.881149 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.881059 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.881149 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.881081 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8cfm\"" Jun 06 20:46:10.882348 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.882330 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.883590 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.883574 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.883862 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.883850 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.884180 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884166 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 20:46:10.884301 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884285 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:10.884388 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.884368 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:10.884893 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884876 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 20:46:10.884893 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884880 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-prpcd\"" Jun 06 20:46:10.885024 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884909 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 20:46:10.885024 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.884963 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdpqc\"" Jun 06 20:46:10.885736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.885717 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.885736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.885728 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 20:46:10.885895 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.885758 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.885895 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.885797 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.885895 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.885799 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 20:46:10.886501 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.886485 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.888562 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.888535 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.889075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.889061 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.889537 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.889522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsnjm\"" Jun 06 20:46:10.889537 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.889530 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.889642 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.889561 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 20:46:10.891048 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891034 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:10.891111 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.891090 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:10.891607 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891586 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 20:46:10.891699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-agent-certs\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.891699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-socket-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.891699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-registration-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.891699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.891699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891595 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6lw\" (UniqueName: \"kubernetes.io/projected/2fc62846-354d-4071-8d95-7280133a4da6-kube-api-access-jj6lw\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/929b0159-6839-4fdb-b86a-817a3486228f-serviceca\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l56g\" (UniqueName: \"kubernetes.io/projected/929b0159-6839-4fdb-b86a-817a3486228f-kube-api-access-4l56g\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-system-cni-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cnibin\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891859 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.891889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891879 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8c9\" (UniqueName: \"kubernetes.io/projected/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-kube-api-access-jb8c9\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-device-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929b0159-6839-4fdb-b86a-817a3486228f-host\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891977 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-os-release\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.891998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3053f5a2-6737-4414-84de-21fccc3661b0-iptables-alerter-script\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3053f5a2-6737-4414-84de-21fccc3661b0-host-slash\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-konnectivity-ca\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-sys-fs\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.892137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892132 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.892473 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.892473 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.892156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqrdk\" (UniqueName: \"kubernetes.io/projected/3053f5a2-6737-4414-84de-21fccc3661b0-kube-api-access-tqrdk\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.893047 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.893030 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.893387 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.893369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 20:46:10.893483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.893373 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 20:46:10.893483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.893429 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2th5g\"" Jun 06 20:46:10.893766 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.893750 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 20:46:10.895483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.895466 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:46:10.895483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.895480 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.895483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.895487 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.895739 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.895543 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 06 20:46:10.895739 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.895575 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:10.896382 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.896295 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whdd6\"" Jun 06 20:46:10.899136 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.899114 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 20:46:10.899402 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.899385 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rhcpf\"" Jun 06 20:46:10.900216 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.899889 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.900216 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.900183 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 20:41:09 +0000 UTC" deadline="2027-12-16 05:46:20.937709509 +0000 UTC" Jun 06 20:46:10.900358 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.900226 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13377h0m10.037487518s" Jun 06 20:46:10.900358 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.900309 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 20:46:10.901615 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.901593 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal"] Jun 06 20:46:10.901729 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.901669 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:10.901782 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:10.901724 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:10.902411 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.902392 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 20:46:10.902517 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.902495 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rcbvw\"" Jun 06 20:46:10.904781 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.904764 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:46:10.911340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.911320 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:46:10.911477 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.911462 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal"] Jun 06 20:46:10.918086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.918069 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4hnn" Jun 06 20:46:10.925753 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.925735 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4hnn" Jun 06 20:46:10.986998 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.986973 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 20:46:10.989842 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:10.989630 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0313b76425dedbbdaa2ce42744a43bc4.slice/crio-0210dbabec7d209904e832e87ec2f4bfa287bcf73b963e1441035f16bf43f95d WatchSource:0}: Error finding container 0210dbabec7d209904e832e87ec2f4bfa287bcf73b963e1441035f16bf43f95d: Status 404 returned error can't find the container with id 0210dbabec7d209904e832e87ec2f4bfa287bcf73b963e1441035f16bf43f95d Jun 06 20:46:10.989959 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:10.989889 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6682056a4304d1a35505f115402ac6d2.slice/crio-202f0ec5e3a864ffc97fed6f170cf08ab421c52a7fa2a15a210d80618a99763c WatchSource:0}: Error finding container 202f0ec5e3a864ffc97fed6f170cf08ab421c52a7fa2a15a210d80618a99763c: Status 404 returned error can't find the container with id 202f0ec5e3a864ffc97fed6f170cf08ab421c52a7fa2a15a210d80618a99763c Jun 06 20:46:10.992415 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-modprobe-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.992529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992446 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqrdk\" (UniqueName: \"kubernetes.io/projected/3053f5a2-6737-4414-84de-21fccc3661b0-kube-api-access-tqrdk\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.992529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-etc-kubernetes\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.992529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992494 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l56g\" (UniqueName: \"kubernetes.io/projected/929b0159-6839-4fdb-b86a-817a3486228f-kube-api-access-4l56g\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.992529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-system-cni-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-multus\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-run\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-netns\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43654bee-0264-4364-9aaf-895fb9c241a7-ovn-node-metrics-cert\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992645 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992669 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5dw9\" (UniqueName: \"kubernetes.io/projected/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-kube-api-access-f5dw9\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-konnectivity-ca\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.992735 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.993097 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992737 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-systemd\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.993097 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.992952 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pfk\" (UniqueName: \"kubernetes.io/projected/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-kube-api-access-m5pfk\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:10.993199 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-system-cni-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.993248 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6njx9\" (UniqueName: \"kubernetes.io/projected/43654bee-0264-4364-9aaf-895fb9c241a7-kube-api-access-6njx9\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.993297 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.993297 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-netns\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.993378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-hostroot\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.993378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-daemon-config\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.993378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-tuned\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.993523 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-socket-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.993523 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/929b0159-6839-4fdb-b86a-817a3486228f-serviceca\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.993523 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993488 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.993523 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-socket-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993515 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993561 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8c9\" (UniqueName: \"kubernetes.io/projected/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-kube-api-access-jb8c9\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-config\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-konnectivity-ca\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993612 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-kubelet\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-etc-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.993715 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-node-log\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-k8s-cni-cncf-io\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-conf\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993824 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929b0159-6839-4fdb-b86a-817a3486228f-host\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-os-release\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993914 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929b0159-6839-4fdb-b86a-817a3486228f-host\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3053f5a2-6737-4414-84de-21fccc3661b0-iptables-alerter-script\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.993992 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-os-release\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994040 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-kubelet\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994127 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d48l\" (UniqueName: \"kubernetes.io/projected/3e138941-1db3-4911-bf8e-2faf5d8a20d4-kube-api-access-7d48l\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysconfig\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-lib-modules\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994232 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-sys-fs\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-agent-certs\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/929b0159-6839-4fdb-b86a-817a3486228f-serviceca\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994320 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-var-lib-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-sys-fs\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994411 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-bin\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cni-binary-copy\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-bin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3053f5a2-6737-4414-84de-21fccc3661b0-iptables-alerter-script\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.994696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-registration-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994628 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-registration-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6lw\" (UniqueName: \"kubernetes.io/projected/2fc62846-354d-4071-8d95-7280133a4da6-kube-api-access-jj6lw\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994756 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-log-socket\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-multus-certs\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh2bh\" (UniqueName: \"kubernetes.io/projected/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-kube-api-access-sh2bh\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-sys\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-host\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-systemd-units\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.994970 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-systemd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-system-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995084 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-os-release\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-var-lib-kubelet\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-tmp\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.995445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-device-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995197 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995221 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3053f5a2-6737-4414-84de-21fccc3661b0-host-slash\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-slash\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-env-overrides\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-script-lib\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-kubelet-config\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-socket-dir-parent\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fc62846-354d-4071-8d95-7280133a4da6-device-dir\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3053f5a2-6737-4414-84de-21fccc3661b0-host-slash\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-conf-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.996167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-dbus\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-kubernetes\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995830 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-hosts-file\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cnibin\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-ovn\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cnibin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995941 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-tmp-dir\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995955 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-cnibin\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:10.996794 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.995968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-netd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:10.997403 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.997094 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:46:10.998142 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:10.998124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ca4f77f-beb0-404f-98c0-cd1146d4b18e-agent-certs\") pod \"konnectivity-agent-qv28n\" (UID: \"1ca4f77f-beb0-404f-98c0-cd1146d4b18e\") " pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:11.000738 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.000715 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:11.000816 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.000744 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:11.000816 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.000758 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:11.000911 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.000826 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:11.500805293 +0000 UTC m=+2.028556445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:11.001549 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.001523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l56g\" (UniqueName: \"kubernetes.io/projected/929b0159-6839-4fdb-b86a-817a3486228f-kube-api-access-4l56g\") pod \"node-ca-pvqkq\" (UID: \"929b0159-6839-4fdb-b86a-817a3486228f\") " pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:11.001859 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.001841 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqrdk\" (UniqueName: \"kubernetes.io/projected/3053f5a2-6737-4414-84de-21fccc3661b0-kube-api-access-tqrdk\") pod \"iptables-alerter-fv9kn\" (UID: \"3053f5a2-6737-4414-84de-21fccc3661b0\") " pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:11.001966 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.001946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8c9\" (UniqueName: \"kubernetes.io/projected/f697b1bb-4110-4cb3-96dd-9f7a233ad34c-kube-api-access-jb8c9\") pod \"multus-additional-cni-plugins-kpr4w\" (UID: \"f697b1bb-4110-4cb3-96dd-9f7a233ad34c\") " pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:11.002500 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.002412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6lw\" (UniqueName: \"kubernetes.io/projected/2fc62846-354d-4071-8d95-7280133a4da6-kube-api-access-jj6lw\") pod \"aws-ebs-csi-driver-node-j7rfp\" (UID: \"2fc62846-354d-4071-8d95-7280133a4da6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:11.096943 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.096907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-systemd\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.096943 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.096945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pfk\" (UniqueName: \"kubernetes.io/projected/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-kube-api-access-m5pfk\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.096971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6njx9\" (UniqueName: \"kubernetes.io/projected/43654bee-0264-4364-9aaf-895fb9c241a7-kube-api-access-6njx9\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097018 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-systemd\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-netns\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-hostroot\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-daemon-config\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097187 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-hostroot\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097230 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-tuned\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-netns\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-config\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-kubelet\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-etc-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-node-log\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097397 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-kubelet\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-etc-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097465 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-node-log\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-k8s-cni-cncf-io\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097498 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.097532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-conf\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097548 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-kubelet\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097579 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d48l\" (UniqueName: \"kubernetes.io/projected/3e138941-1db3-4911-bf8e-2faf5d8a20d4-kube-api-access-7d48l\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysconfig\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-k8s-cni-cncf-io\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-lib-modules\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097646 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-daemon-config\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-var-lib-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097663 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-kubelet\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-bin\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cni-binary-copy\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysconfig\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-bin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097628 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-conf\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-log-socket\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097785 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-lib-modules\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-bin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-multus-certs\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-var-lib-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-bin\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh2bh\" (UniqueName: \"kubernetes.io/projected/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-kube-api-access-sh2bh\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097842 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-run-multus-certs\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097862 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-sys\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-log-socket\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-host\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.097901 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097898 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-config\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-sys\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097912 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-systemd-units\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-systemd-units\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-host\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.097977 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:11.597958658 +0000 UTC m=+2.125709792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.097998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-systemd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098042 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-systemd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.098973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-system-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098131 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-os-release\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098149 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-var-lib-kubelet\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cni-binary-copy\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-tmp\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098202 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-system-cni-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-os-release\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-slash\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-var-lib-kubelet\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-env-overrides\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-script-lib\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098295 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-slash\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-kubelet-config\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098347 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-socket-dir-parent\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-conf-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.099598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-dbus\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098497 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-socket-dir-parent\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-multus-conf-dir\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-kubernetes\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-hosts-file\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-ovn\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.098597 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098605 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cnibin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-tmp-dir\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-dbus\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098469 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21592303-e9e5-4c36-a0cd-78c9ab9524e0-kubelet-config\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.098663 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:11.598649031 +0000 UTC m=+2.126400164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-netd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098693 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-hosts-file\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-ovn\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098660 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-env-overrides\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-modprobe-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098737 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-cni-netd\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100075 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-kubernetes\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-etc-kubernetes\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-cnibin\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098783 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-etc-kubernetes\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-multus\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098820 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43654bee-0264-4364-9aaf-895fb9c241a7-ovnkube-script-lib\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-run\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098834 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-modprobe-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-netns\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e138941-1db3-4911-bf8e-2faf5d8a20d4-host-var-lib-cni-multus\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-run\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43654bee-0264-4364-9aaf-895fb9c241a7-ovn-node-metrics-cert\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098915 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-host-run-netns\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5dw9\" (UniqueName: \"kubernetes.io/projected/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-kube-api-access-f5dw9\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.098990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-tmp-dir\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.099044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43654bee-0264-4364-9aaf-895fb9c241a7-run-openvswitch\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.100791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.099085 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-sysctl-d\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.101332 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.100762 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-tmp\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.101332 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.100901 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43654bee-0264-4364-9aaf-895fb9c241a7-ovn-node-metrics-cert\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.101332 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.100923 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-etc-tuned\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.104495 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.104474 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:11.106296 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.106269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6njx9\" (UniqueName: \"kubernetes.io/projected/43654bee-0264-4364-9aaf-895fb9c241a7-kube-api-access-6njx9\") pod \"ovnkube-node-h2496\" (UID: \"43654bee-0264-4364-9aaf-895fb9c241a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.106439 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.106321 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pfk\" (UniqueName: \"kubernetes.io/projected/0fe59e50-b461-40b4-8a99-4f08c8e73cdc-kube-api-access-m5pfk\") pod \"node-resolver-4rsf5\" (UID: \"0fe59e50-b461-40b4-8a99-4f08c8e73cdc\") " pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.106550 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.106530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d48l\" (UniqueName: \"kubernetes.io/projected/3e138941-1db3-4911-bf8e-2faf5d8a20d4-kube-api-access-7d48l\") pod \"multus-gnp9m\" (UID: \"3e138941-1db3-4911-bf8e-2faf5d8a20d4\") " pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.107087 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.107070 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh2bh\" (UniqueName: \"kubernetes.io/projected/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-kube-api-access-sh2bh\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:11.107259 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.107244 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5dw9\" (UniqueName: \"kubernetes.io/projected/7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7-kube-api-access-f5dw9\") pod \"tuned-n2w7l\" (UID: \"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7\") " pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.214880 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.214777 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:11.220149 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.220131 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" Jun 06 20:46:11.225966 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.225924 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca4f77f_beb0_404f_98c0_cd1146d4b18e.slice/crio-bfb0ff1a5c72626d4069aba86b67baa3b65b4baf94925d4ee819f479357ed188 WatchSource:0}: Error finding container bfb0ff1a5c72626d4069aba86b67baa3b65b4baf94925d4ee819f479357ed188: Status 404 returned error can't find the container with id bfb0ff1a5c72626d4069aba86b67baa3b65b4baf94925d4ee819f479357ed188 Jun 06 20:46:11.226085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.226006 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvqkq" Jun 06 20:46:11.228896 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.228877 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc62846_354d_4071_8d95_7280133a4da6.slice/crio-e07d963b7161d30d7caee6426153f103503c230d05d905950d4b3b65263d1c75 WatchSource:0}: Error finding container e07d963b7161d30d7caee6426153f103503c230d05d905950d4b3b65263d1c75: Status 404 returned error can't find the container with id e07d963b7161d30d7caee6426153f103503c230d05d905950d4b3b65263d1c75 Jun 06 20:46:11.234207 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.234187 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929b0159_6839_4fdb_b86a_817a3486228f.slice/crio-65a857f32296455f0c6c31ce0b0e35aeff43f4fc9afb7a900d6ac40c14cf8680 WatchSource:0}: Error finding container 65a857f32296455f0c6c31ce0b0e35aeff43f4fc9afb7a900d6ac40c14cf8680: Status 404 returned error can't find the container with id 65a857f32296455f0c6c31ce0b0e35aeff43f4fc9afb7a900d6ac40c14cf8680 Jun 06 20:46:11.251166 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.251145 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" Jun 06 20:46:11.260050 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.260030 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf697b1bb_4110_4cb3_96dd_9f7a233ad34c.slice/crio-093f6df64429e6ceb5ae2be9291e8c2fd65716892a42b366fb3641e7a9fc9111 WatchSource:0}: Error finding container 093f6df64429e6ceb5ae2be9291e8c2fd65716892a42b366fb3641e7a9fc9111: Status 404 returned error can't find the container with id 093f6df64429e6ceb5ae2be9291e8c2fd65716892a42b366fb3641e7a9fc9111 Jun 06 20:46:11.268042 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.268021 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fv9kn" Jun 06 20:46:11.276631 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.276608 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3053f5a2_6737_4414_84de_21fccc3661b0.slice/crio-3df27c430c3eb15ae82653ea51d3176ac0b34e22e957ba305a3df1df05212c7d WatchSource:0}: Error finding container 3df27c430c3eb15ae82653ea51d3176ac0b34e22e957ba305a3df1df05212c7d: Status 404 returned error can't find the container with id 3df27c430c3eb15ae82653ea51d3176ac0b34e22e957ba305a3df1df05212c7d Jun 06 20:46:11.295716 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.295685 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:11.304003 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.303970 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43654bee_0264_4364_9aaf_895fb9c241a7.slice/crio-f2883fb935d811277ee09c2c4285aeda30336873ef660609c6433f07b03ba8fb WatchSource:0}: Error finding container f2883fb935d811277ee09c2c4285aeda30336873ef660609c6433f07b03ba8fb: Status 404 returned error can't find the container with id f2883fb935d811277ee09c2c4285aeda30336873ef660609c6433f07b03ba8fb Jun 06 20:46:11.310162 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.310142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" Jun 06 20:46:11.317822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.317795 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4rsf5" Jun 06 20:46:11.320340 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.320313 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3fb9d2_a4de_4eaf_865b_bf6d69f4a8d7.slice/crio-c72c4ce40007ec23136fcf1bb5121683d9fcf269c260ebd5d678e113287706c9 WatchSource:0}: Error finding container c72c4ce40007ec23136fcf1bb5121683d9fcf269c260ebd5d678e113287706c9: Status 404 returned error can't find the container with id c72c4ce40007ec23136fcf1bb5121683d9fcf269c260ebd5d678e113287706c9 Jun 06 20:46:11.322981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.322819 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gnp9m" Jun 06 20:46:11.329742 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.329718 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe59e50_b461_40b4_8a99_4f08c8e73cdc.slice/crio-5487f1ffbacc65266beea2de7659bb703003735ec038ae0c931937881c348f1e WatchSource:0}: Error finding container 5487f1ffbacc65266beea2de7659bb703003735ec038ae0c931937881c348f1e: Status 404 returned error can't find the container with id 5487f1ffbacc65266beea2de7659bb703003735ec038ae0c931937881c348f1e Jun 06 20:46:11.331828 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:11.331810 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e138941_1db3_4911_bf8e_2faf5d8a20d4.slice/crio-cffa9359358162c6d325648933d26ef95447f68675eb4b536e685b3f3dbf53fd WatchSource:0}: Error finding container cffa9359358162c6d325648933d26ef95447f68675eb4b536e685b3f3dbf53fd: Status 404 returned error can't find the container with id cffa9359358162c6d325648933d26ef95447f68675eb4b536e685b3f3dbf53fd Jun 06 20:46:11.378707 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.378671 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:11.503509 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.503471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:11.503677 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.503613 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:11.503677 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.503627 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:11.503677 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.503639 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:11.503810 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.503698 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:12.503680408 +0000 UTC m=+3.031431564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:11.603951 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.603921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:11.604113 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.603978 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:11.604113 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.604070 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:11.604211 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.604123 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:12.604109958 +0000 UTC m=+3.131861097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:11.604211 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.604070 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:11.604335 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.604219 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:12.604204568 +0000 UTC m=+3.131955704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:11.928860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.928644 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:10 +0000 UTC" deadline="2028-03-22 09:13:25.512996174 +0000 UTC" Jun 06 20:46:11.928860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.928703 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15708h27m13.584296665s" Jun 06 20:46:11.979009 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.978958 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:11.979214 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:11.979100 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:11.999364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:11.999150 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvqkq" event={"ID":"929b0159-6839-4fdb-b86a-817a3486228f","Type":"ContainerStarted","Data":"65a857f32296455f0c6c31ce0b0e35aeff43f4fc9afb7a900d6ac40c14cf8680"} Jun 06 20:46:12.016882 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.016843 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qv28n" event={"ID":"1ca4f77f-beb0-404f-98c0-cd1146d4b18e","Type":"ContainerStarted","Data":"bfb0ff1a5c72626d4069aba86b67baa3b65b4baf94925d4ee819f479357ed188"} Jun 06 20:46:12.029397 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.029360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" event={"ID":"0313b76425dedbbdaa2ce42744a43bc4","Type":"ContainerStarted","Data":"0210dbabec7d209904e832e87ec2f4bfa287bcf73b963e1441035f16bf43f95d"} Jun 06 20:46:12.045383 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.045336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" event={"ID":"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7","Type":"ContainerStarted","Data":"c72c4ce40007ec23136fcf1bb5121683d9fcf269c260ebd5d678e113287706c9"} Jun 06 20:46:12.077727 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.077675 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"f2883fb935d811277ee09c2c4285aeda30336873ef660609c6433f07b03ba8fb"} Jun 06 20:46:12.089337 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.089140 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:12.092295 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.092199 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerStarted","Data":"093f6df64429e6ceb5ae2be9291e8c2fd65716892a42b366fb3641e7a9fc9111"} Jun 06 20:46:12.105083 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.105053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" event={"ID":"2fc62846-354d-4071-8d95-7280133a4da6","Type":"ContainerStarted","Data":"e07d963b7161d30d7caee6426153f103503c230d05d905950d4b3b65263d1c75"} Jun 06 20:46:12.123355 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.123215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerStarted","Data":"202f0ec5e3a864ffc97fed6f170cf08ab421c52a7fa2a15a210d80618a99763c"} Jun 06 20:46:12.142472 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.142270 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gnp9m" event={"ID":"3e138941-1db3-4911-bf8e-2faf5d8a20d4","Type":"ContainerStarted","Data":"cffa9359358162c6d325648933d26ef95447f68675eb4b536e685b3f3dbf53fd"} Jun 06 20:46:12.152125 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.152052 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4rsf5" event={"ID":"0fe59e50-b461-40b4-8a99-4f08c8e73cdc","Type":"ContainerStarted","Data":"5487f1ffbacc65266beea2de7659bb703003735ec038ae0c931937881c348f1e"} Jun 06 20:46:12.181555 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.181461 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fv9kn" event={"ID":"3053f5a2-6737-4414-84de-21fccc3661b0","Type":"ContainerStarted","Data":"3df27c430c3eb15ae82653ea51d3176ac0b34e22e957ba305a3df1df05212c7d"} Jun 06 20:46:12.511903 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.511866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:12.512103 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.512056 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:12.512103 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.512082 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:12.512103 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.512096 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:12.512256 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.512151 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:14.512137227 +0000 UTC m=+5.039888360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:12.612647 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.612609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:12.612838 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.612685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:12.612838 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.612780 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:12.612838 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.612814 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:12.612991 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.612856 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:14.612834995 +0000 UTC m=+5.140586180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:12.612991 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.612876 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:14.612865493 +0000 UTC m=+5.140616627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:12.929865 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.929745 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:10 +0000 UTC" deadline="2028-03-23 01:41:20.525003134 +0000 UTC" Jun 06 20:46:12.929865 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.929785 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15724h55m7.595225323s" Jun 06 20:46:12.967537 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.967298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:12.967537 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.967447 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:12.968019 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:12.967823 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:12.968019 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:12.967918 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:13.970409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:13.967496 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:13.970409 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:13.967649 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:14.531193 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:14.531157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:14.531385 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.531331 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:14.531385 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.531350 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:14.531385 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.531362 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:14.531702 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.531435 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:18.531401224 +0000 UTC m=+9.059152377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:14.632174 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:14.632136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:14.632363 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:14.632207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:14.632363 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.632305 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:14.632363 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.632364 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:18.63234355 +0000 UTC m=+9.160094700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:14.632567 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.632305 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:14.632619 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.632606 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:18.632589683 +0000 UTC m=+9.160340826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:14.967279 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:14.967200 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:14.967464 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:14.967351 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:14.967464 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.967335 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:14.967591 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:14.967474 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:15.967395 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:15.967337 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:15.967842 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:15.967489 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:16.967995 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:16.967958 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:16.968487 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:16.967959 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:16.968487 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:16.968094 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:16.968487 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:16.968171 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:17.971050 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:17.971022 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:17.971513 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:17.971138 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:18.566410 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:18.566318 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:18.566631 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.566480 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:18.566631 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.566508 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:18.566631 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.566520 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:18.566631 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.566583 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.566564457 +0000 UTC m=+17.094315605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:18.667274 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:18.667233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:18.667477 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:18.667310 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:18.667477 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.667381 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:18.667477 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.667415 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:18.667477 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.667464 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.667445058 +0000 UTC m=+17.195196247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:18.667477 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.667481 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.66747463 +0000 UTC m=+17.195225767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:18.968159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:18.967954 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:18.968159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:18.968001 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:18.968159 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.968101 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:18.968618 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:18.968192 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:19.969453 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:19.969139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:19.969453 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:19.969357 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:20.967447 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:20.967401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:20.967641 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:20.967401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:20.967641 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:20.967546 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:20.967752 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:20.967649 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:21.970596 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:21.970335 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:21.971046 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:21.970693 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:22.967968 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:22.967935 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:22.968116 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:22.968047 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:22.968116 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:22.968083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:22.968202 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:22.968178 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:23.967811 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:23.967760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:23.968273 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:23.967915 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:24.967875 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:24.967836 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:24.968313 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:24.967841 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:24.968313 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:24.967961 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:24.968313 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:24.968054 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:25.967377 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:25.967344 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:25.967580 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:25.967502 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:26.625744 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:26.625706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:26.626144 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.625868 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:26.626144 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.625885 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:26.626144 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.625894 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:26.626144 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.625947 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:46:42.625931799 +0000 UTC m=+33.153682954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:26.726996 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:26.726959 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:26.727228 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:26.727014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:26.727228 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.727143 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:26.727228 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.727160 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:26.727228 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.727216 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:42.727199926 +0000 UTC m=+33.254951080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:26.727385 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.727234 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:42.727224934 +0000 UTC m=+33.254976068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:26.967142 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:26.967059 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:26.967332 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.967165 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:26.967332 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:26.967218 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:26.967332 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:26.967311 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:27.967428 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:27.967386 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:27.968296 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:27.967551 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:28.967763 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:28.967728 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:28.968246 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:28.967728 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:28.968246 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:28.967873 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:28.968246 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:28.967920 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:29.967787 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:29.967754 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:29.968207 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:29.967876 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:30.968101 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:30.968058 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:30.968101 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:30.968100 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:30.968546 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:30.968219 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:30.968546 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:30.968322 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:31.967604 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:31.967465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:31.967758 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:31.967646 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:32.225138 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.224909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" event={"ID":"0313b76425dedbbdaa2ce42744a43bc4","Type":"ContainerStarted","Data":"486b1e04ba024ba28c0455be239f5ea6583f23554e2078d1fe2bd502c4cc3944"} Jun 06 20:46:32.230153 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.230119 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" event={"ID":"7d3fb9d2-a4de-4eaf-865b-bf6d69f4a8d7","Type":"ContainerStarted","Data":"1fa5e83cff0cd280be644bb2b300868f8efe89e3f6d29f3dbe2787e25d41aae1"} Jun 06 20:46:32.232854 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.232829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"b7b6a846d5be225359ac6da020d7d0b0dd558cbb44f38aafe1f3513b1bbf74f4"} Jun 06 20:46:32.232962 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.232901 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"9ce5447feb58c87583b611a7df132f0258367869f5a7eb262d893bf739242fda"} Jun 06 20:46:32.234319 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.234296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gnp9m" event={"ID":"3e138941-1db3-4911-bf8e-2faf5d8a20d4","Type":"ContainerStarted","Data":"f1658eb6a4b9cd1467d8074d18eb392417f90e1f62aad19f2eb0ca81db9f73ac"} Jun 06 20:46:32.240479 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.240411 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" podStartSLOduration=22.240393089 podStartE2EDuration="22.240393089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:32.238685492 +0000 UTC m=+22.766436649" watchObservedRunningTime="2026-06-06 20:46:32.240393089 +0000 UTC m=+22.768144245" Jun 06 20:46:32.254010 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.253962 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n2w7l" podStartSLOduration=2.331708524 podStartE2EDuration="22.25394512s" totalImagesPullingTime="19.922236596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:32.253482596 +0000 UTC m=+22.781233752" watchObservedRunningTime="2026-06-06 20:46:32.25394512 +0000 UTC m=+22.781696275" Jun 06 20:46:32.270753 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.270698 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gnp9m" podStartSLOduration=2.322708643 podStartE2EDuration="22.270674627s" totalImagesPullingTime="19.947965984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:32.27048115 +0000 UTC m=+22.798232305" watchObservedRunningTime="2026-06-06 20:46:32.270674627 +0000 UTC m=+22.798425784" Jun 06 20:46:32.968484 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.968206 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:32.968719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:32.968206 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:32.968719 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:32.968551 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:32.968719 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:32.968609 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:33.238548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.238511 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="c37b4528c9e5bbf6c9dd6a496d2d4605eb41c324b93edba3111dded078f6f8f4" exitCode=0 Jun 06 20:46:33.239304 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.238600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"c37b4528c9e5bbf6c9dd6a496d2d4605eb41c324b93edba3111dded078f6f8f4"} Jun 06 20:46:33.240340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.240318 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" event={"ID":"2fc62846-354d-4071-8d95-7280133a4da6","Type":"ContainerStarted","Data":"b6139db7942fb8d11f174c8145447dde341d49ab7a12509d7310fd5ca662503a"} Jun 06 20:46:33.241997 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.241971 2555 generic.go:356] "Generic (PLEG): container finished" podID="6682056a4304d1a35505f115402ac6d2" containerID="42cb15dd66ca22516a78051a3f8de8639f8fce45f2fa3f679fc808306ed5cdd9" exitCode=0 Jun 06 20:46:33.242095 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.242049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerDied","Data":"42cb15dd66ca22516a78051a3f8de8639f8fce45f2fa3f679fc808306ed5cdd9"} Jun 06 20:46:33.243725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.243690 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4rsf5" event={"ID":"0fe59e50-b461-40b4-8a99-4f08c8e73cdc","Type":"ContainerStarted","Data":"c3a682138d0b06f6e157239f59e44eeb43c60c6115a3e659c9279de6241ad61d"} Jun 06 20:46:33.245300 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.245266 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fv9kn" event={"ID":"3053f5a2-6737-4414-84de-21fccc3661b0","Type":"ContainerStarted","Data":"541975b3b0d84324715070b3c1bdc90da4dad89f84adbe58a7b7db633b9c17d4"} Jun 06 20:46:33.246884 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.246860 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvqkq" event={"ID":"929b0159-6839-4fdb-b86a-817a3486228f","Type":"ContainerStarted","Data":"a259280323b47838208830255c9047a6b93d35a308a1d5bf5ad4b88ba46e5fa5"} Jun 06 20:46:33.248313 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.248263 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qv28n" event={"ID":"1ca4f77f-beb0-404f-98c0-cd1146d4b18e","Type":"ContainerStarted","Data":"b11b627f5a7d606e76bb074f1f9bf545494af08c2190c8f4a7528b4cbd264639"} Jun 06 20:46:33.251242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:46:33.251680 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251651 2555 generic.go:356] "Generic (PLEG): container finished" podID="43654bee-0264-4364-9aaf-895fb9c241a7" containerID="b7b6a846d5be225359ac6da020d7d0b0dd558cbb44f38aafe1f3513b1bbf74f4" exitCode=1 Jun 06 20:46:33.251767 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251736 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerDied","Data":"b7b6a846d5be225359ac6da020d7d0b0dd558cbb44f38aafe1f3513b1bbf74f4"} Jun 06 20:46:33.251829 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"87116288e4c45162a842fbc6f2b19af0f373fbb1391d6136ae2284a330b2c391"} Jun 06 20:46:33.251880 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"aef99bb8ff1d18008c064102031c7435de6aca3561fcefd767a43962d3424a94"} Jun 06 20:46:33.251925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"4ff857910040d3a1aab186b9e4119677a9aeaf421bf55a3d2a61126bec1c6410"} Jun 06 20:46:33.251976 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.251962 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"dc0e63c79e9eba8715f0f64f47eec2c17c9cf7a6dc5715bc1811af3d026f56b3"} Jun 06 20:46:33.272331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.272276 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4rsf5" podStartSLOduration=3.359701844 podStartE2EDuration="23.272256281s" totalImagesPullingTime="19.912554437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:33.271403107 +0000 UTC m=+23.799154262" watchObservedRunningTime="2026-06-06 20:46:33.272256281 +0000 UTC m=+23.800007435" Jun 06 20:46:33.284932 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.284883 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qv28n" podStartSLOduration=11.523570565 podStartE2EDuration="23.284868148s" totalImagesPullingTime="11.761297583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:33.284696981 +0000 UTC m=+23.812448134" watchObservedRunningTime="2026-06-06 20:46:33.284868148 +0000 UTC m=+23.812619304" Jun 06 20:46:33.299038 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.298983 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pvqkq" podStartSLOduration=3.290735873 podStartE2EDuration="23.298967761s" totalImagesPullingTime="20.008231888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:33.298359089 +0000 UTC m=+23.826110247" watchObservedRunningTime="2026-06-06 20:46:33.298967761 +0000 UTC m=+23.826718915" Jun 06 20:46:33.329183 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.329137 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fv9kn" podStartSLOduration=3.409739013 podStartE2EDuration="23.329121014s" totalImagesPullingTime="19.919382001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:33.329027217 +0000 UTC m=+23.856778367" watchObservedRunningTime="2026-06-06 20:46:33.329121014 +0000 UTC m=+23.856872168" Jun 06 20:46:33.754103 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.754066 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 20:46:33.959012 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.958902 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T20:46:33.754095826Z","UUID":"dca2d320-80fe-472b-9e66-aee8acbd7033","Handler":null,"Name":"","Endpoint":""} Jun 06 20:46:33.961064 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.961042 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 20:46:33.961190 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.961083 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 20:46:33.967976 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:33.967760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:33.967976 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:33.967944 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:34.256161 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:34.256120 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" event={"ID":"2fc62846-354d-4071-8d95-7280133a4da6","Type":"ContainerStarted","Data":"3bff1c74267bcd8832de5782d19a5504d177b401f84e416c6aec169c5e4bae30"} Jun 06 20:46:34.258239 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:34.258211 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerStarted","Data":"2110742f9dbf5dc3a862b2a452711fe93addd5f09498771f5047be7c977ccdc3"} Jun 06 20:46:34.273320 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:34.273259 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" podStartSLOduration=24.273243639 podStartE2EDuration="24.273243639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:34.272856913 +0000 UTC m=+24.800608079" watchObservedRunningTime="2026-06-06 20:46:34.273243639 +0000 UTC m=+24.800994793" Jun 06 20:46:34.967710 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:34.967612 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:34.967710 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:34.967667 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:34.967963 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:34.967759 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:34.967963 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:34.967869 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:35.264370 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.264338 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:46:35.264808 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.264742 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"cd3625dc3d3a08ee302830aadfd3295f93f0a416986278d77589bae8e707dfad"} Jun 06 20:46:35.266973 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.266942 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" event={"ID":"2fc62846-354d-4071-8d95-7280133a4da6","Type":"ContainerStarted","Data":"c4d70072f37f6485be9c8678117a9558147b6523a19b2b44002cc6b938167e45"} Jun 06 20:46:35.315152 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.315116 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:35.315897 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.315877 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:35.333514 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.333454 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7rfp" podStartSLOduration=2.858594638 podStartE2EDuration="25.333408323s" totalImagesPullingTime="22.474813685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:35.286868571 +0000 UTC m=+25.814619728" watchObservedRunningTime="2026-06-06 20:46:35.333408323 +0000 UTC m=+25.861159479" Jun 06 20:46:35.968066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:35.968031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:35.968265 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:35.968188 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:36.270275 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:36.270238 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:36.270760 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:36.270600 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qv28n" Jun 06 20:46:36.967760 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:36.967727 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:36.967760 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:36.967748 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:36.967974 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:36.967846 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:36.968085 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:36.968062 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:37.967613 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:37.967347 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:37.968283 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:37.967685 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:38.277347 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.277322 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:46:38.277718 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.277697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"8d5da4bb895f4eb7463cc8e8f648a23175cd6569d9d7b12d2f58e7858cfe36f9"} Jun 06 20:46:38.277965 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.277944 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:38.278223 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.278207 2555 scope.go:117] "RemoveContainer" containerID="b7b6a846d5be225359ac6da020d7d0b0dd558cbb44f38aafe1f3513b1bbf74f4" Jun 06 20:46:38.279636 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.279613 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="44169fe2a62c8dc0e3ce571707bed8d2b25bba93ad0493a18c0887a5e8c22abe" exitCode=0 Jun 06 20:46:38.279750 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.279700 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"44169fe2a62c8dc0e3ce571707bed8d2b25bba93ad0493a18c0887a5e8c22abe"} Jun 06 20:46:38.295289 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.295267 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:38.968302 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.968108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:38.968824 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:38.968108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:38.968824 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:38.968406 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:38.968824 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:38.968520 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:39.285925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.285895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:46:39.286263 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.286241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" event={"ID":"43654bee-0264-4364-9aaf-895fb9c241a7","Type":"ContainerStarted","Data":"fc514e5d952fb77bac8784ca62bc614284763147df784ceaed01e003ffa699d9"} Jun 06 20:46:39.286488 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.286469 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:39.286585 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.286561 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:39.302127 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.302104 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:46:39.312941 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.312888 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" podStartSLOduration=8.700916441 podStartE2EDuration="29.312867206s" totalImagesPullingTime="20.611950765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:39.311093073 +0000 UTC m=+29.838844229" watchObservedRunningTime="2026-06-06 20:46:39.312867206 +0000 UTC m=+29.840618362" Jun 06 20:46:39.715243 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.715113 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z2rl6"] Jun 06 20:46:39.715384 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.715251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:39.715384 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:39.715345 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:39.718095 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.718067 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8mxb"] Jun 06 20:46:39.718251 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.718164 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:39.718310 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:39.718268 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:39.718898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.718876 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hdrrk"] Jun 06 20:46:39.719000 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:39.718986 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:39.719122 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:39.719100 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:40.290719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:40.290684 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="b3bc917231294bc6f74e15ec3fdec40d1133073e8de8871c40c93e42ed834969" exitCode=0 Jun 06 20:46:40.291146 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:40.290758 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"b3bc917231294bc6f74e15ec3fdec40d1133073e8de8871c40c93e42ed834969"} Jun 06 20:46:40.968017 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:40.967985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:40.968213 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:40.968110 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:41.967260 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:41.967180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:41.967756 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:41.967180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:41.967756 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:41.967284 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:41.967756 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:41.967352 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:42.298002 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.297966 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="871fd72ea640b9462097ad5dd9989805871f7d14acf1e8b0640dbc4131590333" exitCode=0 Jun 06 20:46:42.298167 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.298016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"871fd72ea640b9462097ad5dd9989805871f7d14acf1e8b0640dbc4131590333"} Jun 06 20:46:42.649029 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.648943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:42.649179 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.649110 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:42.649179 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.649133 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:42.649179 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.649141 2555 projected.go:196] Error preparing data for projected volume kube-api-access-f9lvt for pod openshift-network-diagnostics/network-check-target-z2rl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:42.649277 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.649192 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt podName:14ce3737-36d3-4a37-922e-b7749ee3dbee nodeName:}" failed. No retries permitted until 2026-06-06 20:47:14.649179349 +0000 UTC m=+65.176930485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9lvt" (UniqueName: "kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt") pod "network-check-target-z2rl6" (UID: "14ce3737-36d3-4a37-922e-b7749ee3dbee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:42.749507 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.749472 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:42.749673 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.749539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:42.749673 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.749641 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:42.749673 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.749645 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:42.749809 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.749701 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret podName:21592303-e9e5-4c36-a0cd-78c9ab9524e0 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:14.749683653 +0000 UTC m=+65.277434786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret") pod "global-pull-secret-syncer-d8mxb" (UID: "21592303-e9e5-4c36-a0cd-78c9ab9524e0") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:42.749809 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.749721 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:14.749711278 +0000 UTC m=+65.277462412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:42.968094 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:42.968010 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:42.968542 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:42.968142 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:43.967667 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:43.967627 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:43.967667 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:43.967660 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:43.967944 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:43.967762 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8mxb" podUID="21592303-e9e5-4c36-a0cd-78c9ab9524e0" Jun 06 20:46:43.967944 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:43.967901 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z2rl6" podUID="14ce3737-36d3-4a37-922e-b7749ee3dbee" Jun 06 20:46:44.967572 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:44.967543 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:44.967992 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:44.967669 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:46:45.247534 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.247505 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeReady" Jun 06 20:46:45.247700 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.247659 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 20:46:45.287342 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.287307 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:46:45.293137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.293112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.295804 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.295777 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 20:46:45.295804 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.295801 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 20:46:45.296066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.296030 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 20:46:45.296182 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.296097 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdrjs\"" Jun 06 20:46:45.301182 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.301163 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 20:46:45.305918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.305741 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wxbwn"] Jun 06 20:46:45.309637 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.309591 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.310574 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.310550 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:46:45.312562 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.312537 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 20:46:45.313455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.313291 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 20:46:45.313455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.313317 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-22d9j\"" Jun 06 20:46:45.313977 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.313953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 20:46:45.314380 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.314355 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sdvtj"] Jun 06 20:46:45.318644 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.318607 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.321027 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.321004 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\"" Jun 06 20:46:45.321212 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.321174 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 20:46:45.321479 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.321463 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 20:46:45.330279 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.330255 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxbwn"] Jun 06 20:46:45.334964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.334926 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdvtj"] Jun 06 20:46:45.368889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.368857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.368906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.368989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.369023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.369050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwgn\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369272 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.369082 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369272 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.369134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.369272 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.369175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.466396 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.466360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:45.470285 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470407 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470308 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470503 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470564 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470527 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470564 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.470530 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:46:45.470564 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.470556 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:46:45.470683 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.470665 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:46:45.970640905 +0000 UTC m=+36.498392051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:46:45.470741 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwgn\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470741 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470722 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dade9e8-8977-459f-8d99-f13617a0b79b-config-volume\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.470824 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjgj9\" (UniqueName: \"kubernetes.io/projected/5dade9e8-8977-459f-8d99-f13617a0b79b-kube-api-access-vjgj9\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.470824 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470781 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-cert\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.470824 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470963 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.470963 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470879 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dade9e8-8977-459f-8d99-f13617a0b79b-tmp-dir\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.470963 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mns4c\" (UniqueName: \"kubernetes.io/projected/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-kube-api-access-mns4c\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.470963 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.471147 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.470987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.471642 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.471619 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.471739 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.471667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.471991 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.471969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.475818 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.475797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.475948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.475815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.479870 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.479832 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.479974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.479845 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwgn\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.557234 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.557143 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:45.571993 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.571957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dade9e8-8977-459f-8d99-f13617a0b79b-config-volume\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.571993 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.571994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjgj9\" (UniqueName: \"kubernetes.io/projected/5dade9e8-8977-459f-8d99-f13617a0b79b-kube-api-access-vjgj9\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.572224 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-cert\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.572224 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572056 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dade9e8-8977-459f-8d99-f13617a0b79b-tmp-dir\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.572224 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mns4c\" (UniqueName: \"kubernetes.io/projected/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-kube-api-access-mns4c\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.572224 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.572441 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.572360 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:46:45.572441 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dade9e8-8977-459f-8d99-f13617a0b79b-tmp-dir\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.572559 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.572442 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:46:46.072407871 +0000 UTC m=+36.600159004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:46:45.572717 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.572687 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dade9e8-8977-459f-8d99-f13617a0b79b-config-volume\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.574856 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.574834 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-cert\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.580927 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.580900 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjgj9\" (UniqueName: \"kubernetes.io/projected/5dade9e8-8977-459f-8d99-f13617a0b79b-kube-api-access-vjgj9\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:45.581089 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.581067 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mns4c\" (UniqueName: \"kubernetes.io/projected/5e3e53f1-5dbf-4388-b5c1-61598ad415c7-kube-api-access-mns4c\") pod \"ingress-canary-wxbwn\" (UID: \"5e3e53f1-5dbf-4388-b5c1-61598ad415c7\") " pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.622123 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.622087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxbwn" Jun 06 20:46:45.968158 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.968070 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:46:45.968158 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.968117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:46:45.970769 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.970733 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:46:45.970896 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.970873 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:46:45.971071 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.970975 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:46:45.971071 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.971055 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\"" Jun 06 20:46:45.975433 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:45.975394 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:45.975558 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.975540 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:46:45.975624 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.975561 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:46:45.975671 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:45.975631 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:46:46.975612563 +0000 UTC m=+37.503363719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:46:46.076492 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.076451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:46.076672 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:46.076627 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:46:46.076735 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:46.076707 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:46:47.07669034 +0000 UTC m=+37.604441477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:46:46.297138 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.297112 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxbwn"] Jun 06 20:46:46.301363 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:46:46.301215 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3e53f1_5dbf_4388_b5c1_61598ad415c7.slice/crio-eff9c4f2414365e528642b065f6b695855228b80b7bf8e8b6e236fa10452f768 WatchSource:0}: Error finding container eff9c4f2414365e528642b065f6b695855228b80b7bf8e8b6e236fa10452f768: Status 404 returned error can't find the container with id eff9c4f2414365e528642b065f6b695855228b80b7bf8e8b6e236fa10452f768 Jun 06 20:46:46.312287 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.312254 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxbwn" event={"ID":"5e3e53f1-5dbf-4388-b5c1-61598ad415c7","Type":"ContainerStarted","Data":"eff9c4f2414365e528642b065f6b695855228b80b7bf8e8b6e236fa10452f768"} Jun 06 20:46:46.370906 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.370861 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:46.452785 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.452745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:46.505031 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.504997 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:46.967202 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.967114 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:46:46.969474 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.969451 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\"" Jun 06 20:46:46.970111 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.969480 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:46:46.984387 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:46.984360 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:46.984617 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:46.984535 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:46:46.984617 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:46.984556 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:46:46.984874 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:46.984622 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:46:48.984602244 +0000 UTC m=+39.512353391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:46:47.085145 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.085103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:47.085345 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:47.085247 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:46:47.085345 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:47.085315 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:46:49.085294563 +0000 UTC m=+39.613045712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:46:47.318022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.317987 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="d6e393aeb616236b235c359dc2cde3da13289929b20e4961ae92d252c58be7ca" exitCode=0 Jun 06 20:46:47.318221 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.318056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"d6e393aeb616236b235c359dc2cde3da13289929b20e4961ae92d252c58be7ca"} Jun 06 20:46:47.364778 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.364745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:47.429449 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.429378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:47.601050 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.600965 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:47.731826 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.731790 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:47.831894 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.831858 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:47.884729 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:47.884645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:48.323155 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.323117 2555 generic.go:356] "Generic (PLEG): container finished" podID="f697b1bb-4110-4cb3-96dd-9f7a233ad34c" containerID="5044c8d3621d388efd47d2c84697071b79d73e9b70774a7c9d088c7d79eb9963" exitCode=0 Jun 06 20:46:48.323556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.323197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerDied","Data":"5044c8d3621d388efd47d2c84697071b79d73e9b70774a7c9d088c7d79eb9963"} Jun 06 20:46:48.387433 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.387384 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:48.442695 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.442672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:48.670141 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.670046 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:48.995936 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:48.995906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:49.000789 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.000767 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:49.000924 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:49.000911 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:46:49.000962 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:49.000926 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:46:49.000991 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:49.000976 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:46:53.000960957 +0000 UTC m=+43.528712139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:46:49.097179 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.097147 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:49.101750 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.101727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:49.101874 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:49.101861 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:46:49.101922 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:49.101915 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:46:53.101900126 +0000 UTC m=+43.629651258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:46:49.197411 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.197370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:49.328866 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.328789 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" event={"ID":"f697b1bb-4110-4cb3-96dd-9f7a233ad34c","Type":"ContainerStarted","Data":"4f3f5d0ad710a6ef1e4552b399a0529cafb07b346f7cd4b6db7d614c1cba84f1"} Jun 06 20:46:49.330247 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.330222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxbwn" event={"ID":"5e3e53f1-5dbf-4388-b5c1-61598ad415c7","Type":"ContainerStarted","Data":"14abd7a97b2682002617e3010ef035a1881ceaa0dbfcb8a3fec1f5da44475181"} Jun 06 20:46:49.350330 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.350283 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kpr4w" podStartSLOduration=9.125201894 podStartE2EDuration="39.350264544s" totalImagesPullingTime="30.22506265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:49.349990574 +0000 UTC m=+39.877741725" watchObservedRunningTime="2026-06-06 20:46:49.350264544 +0000 UTC m=+39.878015699" Jun 06 20:46:49.364988 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.364940 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wxbwn" podStartSLOduration=2.296158999 podStartE2EDuration="4.364924287s" totalImagesPullingTime="2.068765288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:49.364573467 +0000 UTC m=+39.892324625" watchObservedRunningTime="2026-06-06 20:46:49.364924287 +0000 UTC m=+39.892675441" Jun 06 20:46:49.792011 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.791976 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:49.841506 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:49.841462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:50.221729 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:50.221644 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:50.273027 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:50.272984 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:50.327216 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:50.327182 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:52.661744 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:52.661706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:53.031082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:53.031050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:46:53.031228 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:53.031177 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:46:53.031228 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:53.031191 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:46:53.031357 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:53.031242 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:47:01.031229002 +0000 UTC m=+51.558980135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:46:53.131780 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:53.131745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:46:53.131881 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:53.131868 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:46:53.131927 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:46:53.131920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:47:01.13190761 +0000 UTC m=+51.659658743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:46:58.539586 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:58.539551 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:46:58.593933 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:46:58.593888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:00.039744 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:00.039707 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:00.141481 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:00.141444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:01.095315 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:01.095274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:47:01.095716 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:01.095443 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:47:01.095716 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:01.095458 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:47:01.095716 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:01.095508 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:47:17.095494997 +0000 UTC m=+67.623246134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:47:01.195625 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:01.195588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:47:01.195823 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:01.195695 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:01.195823 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:01.195744 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:47:17.195731797 +0000 UTC m=+67.723482930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:47:01.275980 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:01.275951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:02.611590 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:02.611559 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:02.713334 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:02.713298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:03.462083 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:03.462047 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:03.517568 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:03.517535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:03.751146 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:03.751111 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:03.804806 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:03.804771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:04.272069 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:04.272025 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:04.324971 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:04.324936 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:11.312613 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:11.312583 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2496" Jun 06 20:47:11.457180 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:11.457133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:11.507555 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:11.507525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:14.696568 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.696529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:47:14.699411 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.699392 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:47:14.709597 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.709576 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:47:14.722209 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.722176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lvt\" (UniqueName: \"kubernetes.io/projected/14ce3737-36d3-4a37-922e-b7749ee3dbee-kube-api-access-f9lvt\") pod \"network-check-target-z2rl6\" (UID: \"14ce3737-36d3-4a37-922e-b7749ee3dbee\") " pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:47:14.783492 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.783463 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\"" Jun 06 20:47:14.791544 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.791516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:47:14.797799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.797779 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:47:14.797851 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.797830 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:47:14.800413 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.800393 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:47:14.800490 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.800450 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:47:14.808466 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:14.808436 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:47:14.808618 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:14.808519 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:48:18.808498114 +0000 UTC m=+129.336249250 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : secret "metrics-daemon-secret" not found Jun 06 20:47:14.810682 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.810658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21592303-e9e5-4c36-a0cd-78c9ab9524e0-original-pull-secret\") pod \"global-pull-secret-syncer-d8mxb\" (UID: \"21592303-e9e5-4c36-a0cd-78c9ab9524e0\") " pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:47:14.921335 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:14.921302 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z2rl6"] Jun 06 20:47:14.925098 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:47:14.925070 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ce3737_36d3_4a37_922e_b7749ee3dbee.slice/crio-1c50d4e3c17dc313f66cff661e050a98e1a4726d30fb21e97035018c27f9028a WatchSource:0}: Error finding container 1c50d4e3c17dc313f66cff661e050a98e1a4726d30fb21e97035018c27f9028a: Status 404 returned error can't find the container with id 1c50d4e3c17dc313f66cff661e050a98e1a4726d30fb21e97035018c27f9028a Jun 06 20:47:15.088165 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:15.088125 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8mxb" Jun 06 20:47:15.213282 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:15.213220 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8mxb"] Jun 06 20:47:15.216802 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:47:15.216770 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21592303_e9e5_4c36_a0cd_78c9ab9524e0.slice/crio-c974155d960d8ee1662a5044e9f09de0f6e6df671556e36bf0687d33bde7d36b WatchSource:0}: Error finding container c974155d960d8ee1662a5044e9f09de0f6e6df671556e36bf0687d33bde7d36b: Status 404 returned error can't find the container with id c974155d960d8ee1662a5044e9f09de0f6e6df671556e36bf0687d33bde7d36b Jun 06 20:47:15.395064 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:15.394971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8mxb" event={"ID":"21592303-e9e5-4c36-a0cd-78c9ab9524e0","Type":"ContainerStarted","Data":"c974155d960d8ee1662a5044e9f09de0f6e6df671556e36bf0687d33bde7d36b"} Jun 06 20:47:15.396125 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:15.396090 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z2rl6" event={"ID":"14ce3737-36d3-4a37-922e-b7749ee3dbee","Type":"ContainerStarted","Data":"1c50d4e3c17dc313f66cff661e050a98e1a4726d30fb21e97035018c27f9028a"} Jun 06 20:47:17.115016 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:17.114962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:47:17.115475 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:17.115131 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:47:17.115475 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:17.115157 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:47:17.115475 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:17.115233 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:47:49.115210798 +0000 UTC m=+99.642961952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:47:17.216433 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:17.216377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:47:17.216631 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:17.216551 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:17.216701 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:17.216633 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:47:49.216612309 +0000 UTC m=+99.744363457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:47:20.410079 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:20.410038 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8mxb" event={"ID":"21592303-e9e5-4c36-a0cd-78c9ab9524e0","Type":"ContainerStarted","Data":"b56aeabe30a55b27dcd65be9b5c5f22122411a789de53f545e57a1b0e256e6c0"} Jun 06 20:47:20.411398 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:20.411372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z2rl6" event={"ID":"14ce3737-36d3-4a37-922e-b7749ee3dbee","Type":"ContainerStarted","Data":"8dbc3e15a52c6ac2597f10f79a1a525e7136ec9f6c847315436e16f98b9fe1f3"} Jun 06 20:47:20.411531 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:20.411478 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:47:20.437107 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:20.437056 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z2rl6" podStartSLOduration=65.783315934 podStartE2EDuration="1m10.437039269s" totalImagesPullingTime="4.653723335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:20.43680495 +0000 UTC m=+70.964556106" watchObservedRunningTime="2026-06-06 20:47:20.437039269 +0000 UTC m=+70.964790425" Jun 06 20:47:20.437274 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:20.437206 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d8mxb" podStartSLOduration=66.063126709 podStartE2EDuration="1m10.437201437s" totalImagesPullingTime="4.374074728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:20.423600566 +0000 UTC m=+70.951351722" watchObservedRunningTime="2026-06-06 20:47:20.437201437 +0000 UTC m=+70.964952593" Jun 06 20:47:24.724756 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:24.724701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:24.776945 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:24.776914 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:25.425244 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:25.425212 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:25.475795 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:25.475758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:25.526280 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:25.526251 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:47:49.153408 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:49.153366 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:47:49.153725 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:49.153526 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:47:49.153725 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:49.153548 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:47:49.153725 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:49.153615 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:48:53.153599238 +0000 UTC m=+163.681350394 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:47:49.254084 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:49.254050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:47:49.254232 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:49.254206 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:49.254328 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:47:49.254316 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:48:53.254300621 +0000 UTC m=+163.782051753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:47:51.416190 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:47:51.416154 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z2rl6" Jun 06 20:48:18.865474 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:48:18.865363 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:48:18.865900 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:18.865524 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:48:18.865900 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:18.865596 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs podName:7ab0d8d5-e060-4c58-bdc4-b2ef89b76792 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:20.865579556 +0000 UTC m=+251.393330693 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs") pod "network-metrics-daemon-hdrrk" (UID: "7ab0d8d5-e060-4c58-bdc4-b2ef89b76792") : secret "metrics-daemon-secret" not found Jun 06 20:48:48.306517 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:48.306464 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" Jun 06 20:48:48.330732 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:48.330691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sdvtj" podUID="5dade9e8-8977-459f-8d99-f13617a0b79b" Jun 06 20:48:48.616639 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:48:48.616570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:48:48.616760 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:48:48.616570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:48:49.977368 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:49.977316 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hdrrk" podUID="7ab0d8d5-e060-4c58-bdc4-b2ef89b76792" Jun 06 20:48:53.214872 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:48:53.214833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:48:53.215355 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:53.214959 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:48:53.215355 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:53.214976 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bfdff76f-fvgm2: secret "image-registry-tls" not found Jun 06 20:48:53.215355 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:53.215061 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls podName:f2f963c2-113b-47eb-aa89-b4992d0fc45a nodeName:}" failed. No retries permitted until 2026-06-06 20:50:55.215028547 +0000 UTC m=+285.742779697 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls") pod "image-registry-64bfdff76f-fvgm2" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a") : secret "image-registry-tls" not found Jun 06 20:48:53.315368 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:48:53.315325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:48:53.315597 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:53.315508 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:48:53.315597 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:48:53.315584 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls podName:5dade9e8-8977-459f-8d99-f13617a0b79b nodeName:}" failed. No retries permitted until 2026-06-06 20:50:55.315562266 +0000 UTC m=+285.843313402 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls") pod "dns-default-sdvtj" (UID: "5dade9e8-8977-459f-8d99-f13617a0b79b") : secret "dns-default-metrics-tls" not found Jun 06 20:49:01.967670 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:01.967628 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:49:11.702277 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:11.702236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:34.923310 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.923275 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt"] Jun 06 20:49:34.926357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.926335 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" Jun 06 20:49:34.927137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.927113 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf"] Jun 06 20:49:34.928772 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.928750 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pkr29\"" Jun 06 20:49:34.928878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.928748 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:49:34.928878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.928836 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 20:49:34.929970 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.929955 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4bfk"] Jun 06 20:49:34.930093 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.930076 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:34.932359 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932338 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 06 20:49:34.932638 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932620 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px"] Jun 06 20:49:34.932720 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932626 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:49:34.932789 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:34.932845 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932628 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7sw96\"" Jun 06 20:49:34.932896 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.932874 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 06 20:49:34.933194 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.933169 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 06 20:49:34.935499 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.935482 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 06 20:49:34.935617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.935555 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:34.935826 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.935811 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:49:34.935898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.935816 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 06 20:49:34.935898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.935866 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q8wsw\"" Jun 06 20:49:34.936194 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.936181 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 06 20:49:34.939501 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.939480 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt"] Jun 06 20:49:34.940488 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.940469 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 20:49:34.940814 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.940795 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 20:49:34.940937 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.940855 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dbfmg\"" Jun 06 20:49:34.941092 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.941076 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:49:34.944272 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.944247 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 06 20:49:34.946303 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.946276 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf"] Jun 06 20:49:34.955455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.955431 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px"] Jun 06 20:49:34.959285 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:34.959254 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4bfk"] Jun 06 20:49:35.012674 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15db359d-ea49-41a7-9e62-1c8bdff096e5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.012674 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j842\" (UniqueName: \"kubernetes.io/projected/02a422db-8e78-4513-b293-c78f3362c423-kube-api-access-8j842\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6q5f\" (UniqueName: \"kubernetes.io/projected/49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5-kube-api-access-s6q5f\") pod \"volume-data-source-validator-78dd696465-jh2zt\" (UID: \"49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15db359d-ea49-41a7-9e62-1c8bdff096e5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-trusted-ca\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85pm\" (UniqueName: \"kubernetes.io/projected/9d87d741-4114-42cc-afae-75e6e8f12cf4-kube-api-access-v85pm\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74vl\" (UniqueName: \"kubernetes.io/projected/15db359d-ea49-41a7-9e62-1c8bdff096e5-kube-api-access-z74vl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d87d741-4114-42cc-afae-75e6e8f12cf4-serving-cert\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.012918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012878 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.013140 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.012929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-config\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.022707 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.022678 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl"] Jun 06 20:49:35.025710 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.025691 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" Jun 06 20:49:35.028340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.028321 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dn59g\"" Jun 06 20:49:35.043011 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.042985 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl"] Jun 06 20:49:35.113567 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113600 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-config\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15db359d-ea49-41a7-9e62-1c8bdff096e5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:35.113691 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j842\" (UniqueName: \"kubernetes.io/projected/02a422db-8e78-4513-b293-c78f3362c423-kube-api-access-8j842\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6q5f\" (UniqueName: \"kubernetes.io/projected/49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5-kube-api-access-s6q5f\") pod \"volume-data-source-validator-78dd696465-jh2zt\" (UID: \"49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:35.113765 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls podName:02a422db-8e78-4513-b293-c78f3362c423 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.613748847 +0000 UTC m=+206.141499979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dh9px" (UID: "02a422db-8e78-4513-b293-c78f3362c423") : secret "samples-operator-tls" not found Jun 06 20:49:35.113799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15db359d-ea49-41a7-9e62-1c8bdff096e5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.114159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-trusted-ca\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.114159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85pm\" (UniqueName: \"kubernetes.io/projected/9d87d741-4114-42cc-afae-75e6e8f12cf4-kube-api-access-v85pm\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.114159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113869 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsc8t\" (UniqueName: \"kubernetes.io/projected/ea4d2f6b-23a7-420d-8847-cfbdd133fe0c-kube-api-access-lsc8t\") pod \"network-check-source-dbd9cf844-8nrhl\" (UID: \"ea4d2f6b-23a7-420d-8847-cfbdd133fe0c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" Jun 06 20:49:35.114159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74vl\" (UniqueName: \"kubernetes.io/projected/15db359d-ea49-41a7-9e62-1c8bdff096e5-kube-api-access-z74vl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.114159 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.113938 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d87d741-4114-42cc-afae-75e6e8f12cf4-serving-cert\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.114545 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.114513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-config\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.114545 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.114541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15db359d-ea49-41a7-9e62-1c8bdff096e5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.114923 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.114902 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d87d741-4114-42cc-afae-75e6e8f12cf4-trusted-ca\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.116365 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.116342 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15db359d-ea49-41a7-9e62-1c8bdff096e5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.116481 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.116441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d87d741-4114-42cc-afae-75e6e8f12cf4-serving-cert\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.118649 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.118623 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-zxdzz"] Jun 06 20:49:35.122793 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.122767 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.125920 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.125892 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nftmd\"" Jun 06 20:49:35.126067 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.125922 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 20:49:35.126067 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.125938 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 20:49:35.126067 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.125890 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 20:49:35.126233 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.126129 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 20:49:35.128057 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.128029 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74vl\" (UniqueName: \"kubernetes.io/projected/15db359d-ea49-41a7-9e62-1c8bdff096e5-kube-api-access-z74vl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xz7nf\" (UID: \"15db359d-ea49-41a7-9e62-1c8bdff096e5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.130966 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.130942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j842\" (UniqueName: \"kubernetes.io/projected/02a422db-8e78-4513-b293-c78f3362c423-kube-api-access-8j842\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.131298 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.131044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85pm\" (UniqueName: \"kubernetes.io/projected/9d87d741-4114-42cc-afae-75e6e8f12cf4-kube-api-access-v85pm\") pod \"console-operator-668fdbf85c-s4bfk\" (UID: \"9d87d741-4114-42cc-afae-75e6e8f12cf4\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.131408 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.131375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6q5f\" (UniqueName: \"kubernetes.io/projected/49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5-kube-api-access-s6q5f\") pod \"volume-data-source-validator-78dd696465-jh2zt\" (UID: \"49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" Jun 06 20:49:35.131791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.131771 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 20:49:35.132852 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.132830 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-zxdzz"] Jun 06 20:49:35.155891 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.155860 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:35.214539 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2c45\" (UniqueName: \"kubernetes.io/projected/2deea783-5dd3-47f6-8a5b-91edc5758641-kube-api-access-t2c45\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.214539 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-snapshots\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.214539 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2deea783-5dd3-47f6-8a5b-91edc5758641-serving-cert\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.214761 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-tmp\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.214761 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-service-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.214854 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsc8t\" (UniqueName: \"kubernetes.io/projected/ea4d2f6b-23a7-420d-8847-cfbdd133fe0c-kube-api-access-lsc8t\") pod \"network-check-source-dbd9cf844-8nrhl\" (UID: \"ea4d2f6b-23a7-420d-8847-cfbdd133fe0c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" Jun 06 20:49:35.214854 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.214843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-trusted-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.215553 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.215525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:35.223003 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.222981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsc8t\" (UniqueName: \"kubernetes.io/projected/ea4d2f6b-23a7-420d-8847-cfbdd133fe0c-kube-api-access-lsc8t\") pod \"network-check-source-dbd9cf844-8nrhl\" (UID: \"ea4d2f6b-23a7-420d-8847-cfbdd133fe0c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" Jun 06 20:49:35.236594 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.236569 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" Jun 06 20:49:35.243743 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.243724 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" Jun 06 20:49:35.254413 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.254386 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:35.315360 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-trusted-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.315644 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2c45\" (UniqueName: \"kubernetes.io/projected/2deea783-5dd3-47f6-8a5b-91edc5758641-kube-api-access-t2c45\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.315720 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315671 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-snapshots\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.315720 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2deea783-5dd3-47f6-8a5b-91edc5758641-serving-cert\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.315836 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-tmp\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.315836 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.315777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-service-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.316322 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.316272 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-tmp\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.316322 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.316306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-trusted-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.316517 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.316320 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2deea783-5dd3-47f6-8a5b-91edc5758641-service-ca-bundle\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.316517 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.316327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2deea783-5dd3-47f6-8a5b-91edc5758641-snapshots\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.318585 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.318551 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2deea783-5dd3-47f6-8a5b-91edc5758641-serving-cert\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.327955 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.327924 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2c45\" (UniqueName: \"kubernetes.io/projected/2deea783-5dd3-47f6-8a5b-91edc5758641-kube-api-access-t2c45\") pod \"insights-operator-896549976-zxdzz\" (UID: \"2deea783-5dd3-47f6-8a5b-91edc5758641\") " pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.336517 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.334264 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" Jun 06 20:49:35.385641 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.385539 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt"] Jun 06 20:49:35.415319 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.415285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf"] Jun 06 20:49:35.418675 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:49:35.418642 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15db359d_ea49_41a7_9e62_1c8bdff096e5.slice/crio-ab9e8cc1e582e73d6a03f796939c2632bde7ecddcb65a43bf925fe76151b7d9f WatchSource:0}: Error finding container ab9e8cc1e582e73d6a03f796939c2632bde7ecddcb65a43bf925fe76151b7d9f: Status 404 returned error can't find the container with id ab9e8cc1e582e73d6a03f796939c2632bde7ecddcb65a43bf925fe76151b7d9f Jun 06 20:49:35.426111 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.426083 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4bfk"] Jun 06 20:49:35.429360 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:49:35.429316 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d87d741_4114_42cc_afae_75e6e8f12cf4.slice/crio-62b744040fa2680d8d6977b60904813b0559ddacfbb0ba73bf7cd0f4016e3bbc WatchSource:0}: Error finding container 62b744040fa2680d8d6977b60904813b0559ddacfbb0ba73bf7cd0f4016e3bbc: Status 404 returned error can't find the container with id 62b744040fa2680d8d6977b60904813b0559ddacfbb0ba73bf7cd0f4016e3bbc Jun 06 20:49:35.445155 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.445119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-zxdzz" Jun 06 20:49:35.474656 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.474620 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl"] Jun 06 20:49:35.477685 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:49:35.477655 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4d2f6b_23a7_420d_8847_cfbdd133fe0c.slice/crio-ab849fa3ea01a8d37d48a456bbed376d67d1e3008756992455bceb3c3a9ac9ec WatchSource:0}: Error finding container ab849fa3ea01a8d37d48a456bbed376d67d1e3008756992455bceb3c3a9ac9ec: Status 404 returned error can't find the container with id ab849fa3ea01a8d37d48a456bbed376d67d1e3008756992455bceb3c3a9ac9ec Jun 06 20:49:35.575258 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.575221 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-zxdzz"] Jun 06 20:49:35.578341 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:49:35.578311 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2deea783_5dd3_47f6_8a5b_91edc5758641.slice/crio-d02829c1e1e09fb7ca2d31ead49e0fcced4395f35df9fd54d76ad859448895de WatchSource:0}: Error finding container d02829c1e1e09fb7ca2d31ead49e0fcced4395f35df9fd54d76ad859448895de: Status 404 returned error can't find the container with id d02829c1e1e09fb7ca2d31ead49e0fcced4395f35df9fd54d76ad859448895de Jun 06 20:49:35.618648 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.618614 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:35.618812 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:35.618728 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:49:35.618812 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:35.618784 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls podName:02a422db-8e78-4513-b293-c78f3362c423 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.618769254 +0000 UTC m=+207.146520387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dh9px" (UID: "02a422db-8e78-4513-b293-c78f3362c423") : secret "samples-operator-tls" not found Jun 06 20:49:35.732623 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.732525 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-zxdzz" event={"ID":"2deea783-5dd3-47f6-8a5b-91edc5758641","Type":"ContainerStarted","Data":"d02829c1e1e09fb7ca2d31ead49e0fcced4395f35df9fd54d76ad859448895de"} Jun 06 20:49:35.733904 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.733884 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" event={"ID":"ea4d2f6b-23a7-420d-8847-cfbdd133fe0c","Type":"ContainerStarted","Data":"cbd6e53d8836dda8137938b60b227a95acdca60e2cefae2a2c07a6c060421a66"} Jun 06 20:49:35.733995 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.733924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" event={"ID":"ea4d2f6b-23a7-420d-8847-cfbdd133fe0c","Type":"ContainerStarted","Data":"ab849fa3ea01a8d37d48a456bbed376d67d1e3008756992455bceb3c3a9ac9ec"} Jun 06 20:49:35.735098 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.735068 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" event={"ID":"15db359d-ea49-41a7-9e62-1c8bdff096e5","Type":"ContainerStarted","Data":"ab9e8cc1e582e73d6a03f796939c2632bde7ecddcb65a43bf925fe76151b7d9f"} Jun 06 20:49:35.736190 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.736166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" event={"ID":"49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5","Type":"ContainerStarted","Data":"8f27a85b985a228410a06cbcf6ef559d2de8027b1040bb5501a76c8008a4507a"} Jun 06 20:49:35.737130 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.737111 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" event={"ID":"9d87d741-4114-42cc-afae-75e6e8f12cf4","Type":"ContainerStarted","Data":"62b744040fa2680d8d6977b60904813b0559ddacfbb0ba73bf7cd0f4016e3bbc"} Jun 06 20:49:35.749858 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:35.749817 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8nrhl" podStartSLOduration=0.749805922 podStartE2EDuration="749.805922ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:35.749181436 +0000 UTC m=+206.276932591" watchObservedRunningTime="2026-06-06 20:49:35.749805922 +0000 UTC m=+206.277557076" Jun 06 20:49:36.630113 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:36.629620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:36.630113 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:36.629888 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:49:36.630113 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:36.629959 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls podName:02a422db-8e78-4513-b293-c78f3362c423 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.629938765 +0000 UTC m=+209.157689898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dh9px" (UID: "02a422db-8e78-4513-b293-c78f3362c423") : secret "samples-operator-tls" not found Jun 06 20:49:37.750171 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:37.750136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" event={"ID":"49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5","Type":"ContainerStarted","Data":"51e27ff7ff57b97a4dfa6ee756869854e256655b9427c51c43922920988d328e"} Jun 06 20:49:37.765169 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:37.765107 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jh2zt" podStartSLOduration=2.354078522 podStartE2EDuration="3.765086005s" totalImagesPullingTime="1.411007483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:37.764848013 +0000 UTC m=+208.292599167" watchObservedRunningTime="2026-06-06 20:49:37.765086005 +0000 UTC m=+208.292837165" Jun 06 20:49:37.836485 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:37.836444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:37.884743 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:37.884702 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:38.647107 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.647080 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:38.647253 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:38.647231 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:49:38.647319 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:38.647309 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls podName:02a422db-8e78-4513-b293-c78f3362c423 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.647289106 +0000 UTC m=+213.175040245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dh9px" (UID: "02a422db-8e78-4513-b293-c78f3362c423") : secret "samples-operator-tls" not found Jun 06 20:49:38.751636 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.751596 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:38.755026 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.754994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-zxdzz" event={"ID":"2deea783-5dd3-47f6-8a5b-91edc5758641","Type":"ContainerStarted","Data":"bfcc35240055b76630508b7af8ad01f3de3066cc02f7b1141cc6b140c0ab4a93"} Jun 06 20:49:38.756608 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.756582 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" event={"ID":"15db359d-ea49-41a7-9e62-1c8bdff096e5","Type":"ContainerStarted","Data":"ce59b7cdf8443c6d66c4836826703387fb562c77e9d9c80aaedcb2abb1da0ad3"} Jun 06 20:49:38.758245 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.758228 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/0.log" Jun 06 20:49:38.758359 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.758264 2555 generic.go:356] "Generic (PLEG): container finished" podID="9d87d741-4114-42cc-afae-75e6e8f12cf4" containerID="b03b066358ee23d8c3af4faa1a36f85a6c510bcfda247e652b98b0c409ee2221" exitCode=255 Jun 06 20:49:38.758359 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.758338 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" event={"ID":"9d87d741-4114-42cc-afae-75e6e8f12cf4","Type":"ContainerDied","Data":"b03b066358ee23d8c3af4faa1a36f85a6c510bcfda247e652b98b0c409ee2221"} Jun 06 20:49:38.758706 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.758587 2555 scope.go:117] "RemoveContainer" containerID="b03b066358ee23d8c3af4faa1a36f85a6c510bcfda247e652b98b0c409ee2221" Jun 06 20:49:38.770644 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.770590 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-zxdzz" podStartSLOduration=0.777685555 podStartE2EDuration="3.770571164s" totalImagesPullingTime="2.992885609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:38.769732235 +0000 UTC m=+209.297483391" watchObservedRunningTime="2026-06-06 20:49:38.770571164 +0000 UTC m=+209.298322300" Jun 06 20:49:38.802128 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.802074 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" podStartSLOduration=1.646090095 podStartE2EDuration="4.802053443s" totalImagesPullingTime="3.155963348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:38.801328465 +0000 UTC m=+209.329079621" watchObservedRunningTime="2026-06-06 20:49:38.802053443 +0000 UTC m=+209.329804602" Jun 06 20:49:38.812282 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:38.812246 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:39.195942 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.195845 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:39.464349 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.464247 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:39.564920 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.564887 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:39.762986 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.762957 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:49:39.763412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.763394 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/0.log" Jun 06 20:49:39.763498 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.763464 2555 generic.go:356] "Generic (PLEG): container finished" podID="9d87d741-4114-42cc-afae-75e6e8f12cf4" containerID="2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5" exitCode=255 Jun 06 20:49:39.763581 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.763554 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" event={"ID":"9d87d741-4114-42cc-afae-75e6e8f12cf4","Type":"ContainerDied","Data":"2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5"} Jun 06 20:49:39.763627 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.763618 2555 scope.go:117] "RemoveContainer" containerID="b03b066358ee23d8c3af4faa1a36f85a6c510bcfda247e652b98b0c409ee2221" Jun 06 20:49:39.763928 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:39.763805 2555 scope.go:117] "RemoveContainer" containerID="2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5" Jun 06 20:49:39.764056 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:39.764034 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4bfk_openshift-console-operator(9d87d741-4114-42cc-afae-75e6e8f12cf4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" podUID="9d87d741-4114-42cc-afae-75e6e8f12cf4" Jun 06 20:49:40.097972 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.097889 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:40.098119 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.098064 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw"] Jun 06 20:49:40.102315 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.102283 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" Jun 06 20:49:40.104992 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.104971 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 06 20:49:40.105133 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.105015 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 06 20:49:40.105205 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.105130 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6bq4n\"" Jun 06 20:49:40.111611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.111582 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw"] Jun 06 20:49:40.188280 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.188245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:40.261069 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.261033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8zpb\" (UniqueName: \"kubernetes.io/projected/977bd5be-39e2-4579-a828-00bb54cfae57-kube-api-access-l8zpb\") pod \"migrator-955ffdf5f-st8hw\" (UID: \"977bd5be-39e2-4579-a828-00bb54cfae57\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" Jun 06 20:49:40.289280 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.289243 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:40.344462 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.344411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:40.363210 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.363112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zpb\" (UniqueName: \"kubernetes.io/projected/977bd5be-39e2-4579-a828-00bb54cfae57-kube-api-access-l8zpb\") pod \"migrator-955ffdf5f-st8hw\" (UID: \"977bd5be-39e2-4579-a828-00bb54cfae57\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" Jun 06 20:49:40.371205 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.371179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8zpb\" (UniqueName: \"kubernetes.io/projected/977bd5be-39e2-4579-a828-00bb54cfae57-kube-api-access-l8zpb\") pod \"migrator-955ffdf5f-st8hw\" (UID: \"977bd5be-39e2-4579-a828-00bb54cfae57\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" Jun 06 20:49:40.413616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.413573 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" Jun 06 20:49:40.541086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.541055 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw"] Jun 06 20:49:40.543775 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:49:40.543748 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977bd5be_39e2_4579_a828_00bb54cfae57.slice/crio-d40e4ba631d3217933f6d29e7455edcb9add60b5c5334ab196171a15dae593a8 WatchSource:0}: Error finding container d40e4ba631d3217933f6d29e7455edcb9add60b5c5334ab196171a15dae593a8: Status 404 returned error can't find the container with id d40e4ba631d3217933f6d29e7455edcb9add60b5c5334ab196171a15dae593a8 Jun 06 20:49:40.768374 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.768349 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:49:40.768803 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.768720 2555 scope.go:117] "RemoveContainer" containerID="2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5" Jun 06 20:49:40.768903 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:40.768879 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4bfk_openshift-console-operator(9d87d741-4114-42cc-afae-75e6e8f12cf4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" podUID="9d87d741-4114-42cc-afae-75e6e8f12cf4" Jun 06 20:49:40.769594 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:40.769571 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" event={"ID":"977bd5be-39e2-4579-a828-00bb54cfae57","Type":"ContainerStarted","Data":"d40e4ba631d3217933f6d29e7455edcb9add60b5c5334ab196171a15dae593a8"} Jun 06 20:49:41.092281 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:41.092195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:41.145953 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:41.145916 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:41.955306 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:41.955274 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.352352 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.352307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.626022 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.625928 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.682915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.682877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:42.683074 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:42.683045 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:49:42.683123 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:42.683117 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls podName:02a422db-8e78-4513-b293-c78f3362c423 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.683102393 +0000 UTC m=+221.210853526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dh9px" (UID: "02a422db-8e78-4513-b293-c78f3362c423") : secret "samples-operator-tls" not found Jun 06 20:49:42.737780 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.737742 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.778402 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.778360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" event={"ID":"977bd5be-39e2-4579-a828-00bb54cfae57","Type":"ContainerStarted","Data":"45f8e11d025d2a569c33d576af8a26cd82cca3f3bef82225b316b22856b53ab2"} Jun 06 20:49:42.778582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.778438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" event={"ID":"977bd5be-39e2-4579-a828-00bb54cfae57","Type":"ContainerStarted","Data":"90f05552a858ae0b40b7472b21c5eef23f449cf42167f46328118f6b263708bb"} Jun 06 20:49:42.795313 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.795260 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st8hw" podStartSLOduration=1.501004019 podStartE2EDuration="2.795242392s" totalImagesPullingTime="1.294238373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:42.795056454 +0000 UTC m=+213.322807602" watchObservedRunningTime="2026-06-06 20:49:42.795242392 +0000 UTC m=+213.322993546" Jun 06 20:49:42.802471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.802439 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.850822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.850787 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4rsf5_0fe59e50-b461-40b4-8a99-4f08c8e73cdc/dns-node-resolver/0.log" Jun 06 20:49:42.864123 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.864094 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:42.962720 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:42.962629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:43.063978 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:43.063942 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:44.029955 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.029893 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:44.049728 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.049696 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvqkq_929b0159-6839-4fdb-b86a-817a3486228f/node-ca/0.log" Jun 06 20:49:44.443387 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.443289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:44.632864 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.632829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:44.698073 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.697994 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:44.840705 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:44.840645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:45.033703 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.033671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:45.050186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.050161 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxbwn_5e3e53f1-5dbf-4388-b5c1-61598ad415c7/serve-healthcheck-canary/0.log" Jun 06 20:49:45.251123 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.251093 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st8hw_977bd5be-39e2-4579-a828-00bb54cfae57/migrator/0.log" Jun 06 20:49:45.255444 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.255403 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:45.255594 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.255469 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:49:45.255853 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.255840 2555 scope.go:117] "RemoveContainer" containerID="2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5" Jun 06 20:49:45.256032 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:49:45.256013 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4bfk_openshift-console-operator(9d87d741-4114-42cc-afae-75e6e8f12cf4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" podUID="9d87d741-4114-42cc-afae-75e6e8f12cf4" Jun 06 20:49:45.450111 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.450029 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st8hw_977bd5be-39e2-4579-a828-00bb54cfae57/graceful-termination/0.log" Jun 06 20:49:45.652625 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:45.652586 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xz7nf_15db359d-ea49-41a7-9e62-1c8bdff096e5/kube-storage-version-migrator-operator/0.log" Jun 06 20:49:46.035253 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.035202 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:46.086261 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.086227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:46.234294 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.234262 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:46.431363 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.431271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:46.637698 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.637667 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:46.833276 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:46.833241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:47.031940 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:47.031909 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:47.974981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:47.974952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:48.268437 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:48.268333 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:48.435823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:48.435794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:48.632492 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:48.632383 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:48.833570 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:48.833538 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:48.888004 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:48.887918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:49.030739 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:49.030700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:50.087674 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.087635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:50.434819 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.434732 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:50.635611 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.635566 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:50.746068 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.746032 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:50.748601 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.748575 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a422db-8e78-4513-b293-c78f3362c423-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dh9px\" (UID: \"02a422db-8e78-4513-b293-c78f3362c423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:50.830742 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.830707 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:50.860949 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.860896 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" Jun 06 20:49:50.992840 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:50.992810 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px"] Jun 06 20:49:51.245719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:51.245687 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:51.814902 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:51.814858 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" event={"ID":"02a422db-8e78-4513-b293-c78f3362c423","Type":"ContainerStarted","Data":"0f59ca377dcb107e87ea6a9625c81712afb224d1101e806af51dc5b153e29b65"} Jun 06 20:49:51.832690 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:51.832649 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:52.229556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:52.229522 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:52.330993 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:52.330944 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:52.433574 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:52.433534 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:52.634740 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:52.634657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:53.065896 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.065860 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:53.358488 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.358455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:53.497764 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.497725 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:53.815370 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.815334 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:53.823248 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.823212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" event={"ID":"02a422db-8e78-4513-b293-c78f3362c423","Type":"ContainerStarted","Data":"19a92682ebe083aeb0add76593551d2365b35f5f0d64b5941fc97ed511912a23"} Jun 06 20:49:53.823397 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.823268 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" event={"ID":"02a422db-8e78-4513-b293-c78f3362c423","Type":"ContainerStarted","Data":"de62853550ca82782786178df6a9fd05c867e8f9838388923df377c3e0a4ea8c"} Jun 06 20:49:53.839595 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:53.839546 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dh9px" podStartSLOduration=18.072953483 podStartE2EDuration="19.8395287s" totalImagesPullingTime="1.766575217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:53.838506936 +0000 UTC m=+224.366258092" watchObservedRunningTime="2026-06-06 20:49:53.8395287 +0000 UTC m=+224.367279869" Jun 06 20:49:58.104594 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:58.104545 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:58.205430 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:49:58.205385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:00.968386 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:00.968358 2555 scope.go:117] "RemoveContainer" containerID="2f92fcfc7367c29bc9af8d6fce7f20acf2e16d83b3db5e5f64475e1b233e19e5" Jun 06 20:50:01.771760 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.771724 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:01.849992 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.849968 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:50:01.850140 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.850032 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" event={"ID":"9d87d741-4114-42cc-afae-75e6e8f12cf4","Type":"ContainerStarted","Data":"795b1892d1937753b131a08ebf478cb2b6cb60b52ca05c4c2021eed89824de27"} Jun 06 20:50:01.850327 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.850308 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:50:01.855258 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.855235 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" Jun 06 20:50:01.867087 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.867041 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-s4bfk" podStartSLOduration=24.72713631 podStartE2EDuration="27.867026716s" totalImagesPullingTime="3.139890406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:01.866053541 +0000 UTC m=+232.393804700" watchObservedRunningTime="2026-06-06 20:50:01.867026716 +0000 UTC m=+232.394777870" Jun 06 20:50:01.870183 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.870160 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:01.925547 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:01.925509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.077157 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.077065 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.252912 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.252872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.308118 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.308080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.671930 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.671891 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.727080 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.727043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:02.978195 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.978163 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p"] Jun 06 20:50:02.980765 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.980739 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:02.983982 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.983956 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xfm9l\"" Jun 06 20:50:02.983982 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.983956 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 20:50:02.997489 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:02.997455 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p"] Jun 06 20:50:03.047557 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.047521 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zgrbg"] Jun 06 20:50:03.047732 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.047588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db6e8abc-d549-4847-a0e9-df50da301441-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kkv6p\" (UID: \"db6e8abc-d549-4847-a0e9-df50da301441\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:03.050334 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.050312 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.052955 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.052934 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-28rxg\"" Jun 06 20:50:03.053089 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.053036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 20:50:03.053510 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.053491 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 20:50:03.065780 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.065750 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgrbg"] Jun 06 20:50:03.075944 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.075886 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.148634 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.149078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db6e8abc-d549-4847-a0e9-df50da301441-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kkv6p\" (UID: \"db6e8abc-d549-4847-a0e9-df50da301441\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:03.149078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7be57c-f31c-453f-8975-0a63a42daa16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.149078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7be57c-f31c-453f-8975-0a63a42daa16-data-volume\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.149078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7be57c-f31c-453f-8975-0a63a42daa16-crio-socket\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.149078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.148908 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwkx\" (UniqueName: \"kubernetes.io/projected/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-api-access-fpwkx\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.151286 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.151261 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db6e8abc-d549-4847-a0e9-df50da301441-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kkv6p\" (UID: \"db6e8abc-d549-4847-a0e9-df50da301441\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:03.163754 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.163706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.249675 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.249675 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7be57c-f31c-453f-8975-0a63a42daa16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.249675 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7be57c-f31c-453f-8975-0a63a42daa16-data-volume\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.249912 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7be57c-f31c-453f-8975-0a63a42daa16-crio-socket\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.249912 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249710 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwkx\" (UniqueName: \"kubernetes.io/projected/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-api-access-fpwkx\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.249912 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.249802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7be57c-f31c-453f-8975-0a63a42daa16-crio-socket\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.250045 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.250023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7be57c-f31c-453f-8975-0a63a42daa16-data-volume\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.250238 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.250210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.252014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.251993 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7be57c-f31c-453f-8975-0a63a42daa16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.257830 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.257805 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwkx\" (UniqueName: \"kubernetes.io/projected/3d7be57c-f31c-453f-8975-0a63a42daa16-kube-api-access-fpwkx\") pod \"insights-runtime-extractor-zgrbg\" (UID: \"3d7be57c-f31c-453f-8975-0a63a42daa16\") " pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.268366 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.268333 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.290136 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.290103 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:03.359007 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.358970 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgrbg" Jun 06 20:50:03.367166 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.367115 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.427196 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.427170 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p"] Jun 06 20:50:03.430694 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:03.430657 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6e8abc_d549_4847_a0e9_df50da301441.slice/crio-2ea22dffd4f18c3f0145210a629d2f34a80c4e09bf2b393ddae401a0bc2046f6 WatchSource:0}: Error finding container 2ea22dffd4f18c3f0145210a629d2f34a80c4e09bf2b393ddae401a0bc2046f6: Status 404 returned error can't find the container with id 2ea22dffd4f18c3f0145210a629d2f34a80c4e09bf2b393ddae401a0bc2046f6 Jun 06 20:50:03.434901 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.434868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.503924 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.503843 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.519732 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.519697 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgrbg"] Jun 06 20:50:03.522955 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:03.522925 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7be57c_f31c_453f_8975_0a63a42daa16.slice/crio-af7a1979596a58ba4f3313c74c7d4d0b2147bccb2663ce862fb30dbf6eb570e7 WatchSource:0}: Error finding container af7a1979596a58ba4f3313c74c7d4d0b2147bccb2663ce862fb30dbf6eb570e7: Status 404 returned error can't find the container with id af7a1979596a58ba4f3313c74c7d4d0b2147bccb2663ce862fb30dbf6eb570e7 Jun 06 20:50:03.645927 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.645891 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.700396 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.700362 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:03.858805 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.858707 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgrbg" event={"ID":"3d7be57c-f31c-453f-8975-0a63a42daa16","Type":"ContainerStarted","Data":"439ea18c52aa844bf6ff19c0cbb3277dda8ef2595e9755a6c34ab975ccaa25e4"} Jun 06 20:50:03.858805 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.858777 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgrbg" event={"ID":"3d7be57c-f31c-453f-8975-0a63a42daa16","Type":"ContainerStarted","Data":"af7a1979596a58ba4f3313c74c7d4d0b2147bccb2663ce862fb30dbf6eb570e7"} Jun 06 20:50:03.859850 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:03.859828 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" event={"ID":"db6e8abc-d549-4847-a0e9-df50da301441","Type":"ContainerStarted","Data":"2ea22dffd4f18c3f0145210a629d2f34a80c4e09bf2b393ddae401a0bc2046f6"} Jun 06 20:50:04.867250 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:04.867218 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgrbg" event={"ID":"3d7be57c-f31c-453f-8975-0a63a42daa16","Type":"ContainerStarted","Data":"78fd21903d3f18f87c7e0f380b455a91a379a0c7c085002f10a612c5e12410a5"} Jun 06 20:50:04.868891 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:04.868856 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" event={"ID":"db6e8abc-d549-4847-a0e9-df50da301441","Type":"ContainerStarted","Data":"e153554bfa2e13ca7d336f74a0f74b54936ec75b9988ff4de3ddf246f1cf014d"} Jun 06 20:50:04.869208 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:04.869182 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:04.874307 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:04.874278 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" Jun 06 20:50:04.884013 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:04.883969 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kkv6p" podStartSLOduration=1.858405358 podStartE2EDuration="2.883952712s" totalImagesPullingTime="1.025547354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:04.882680741 +0000 UTC m=+235.410431895" watchObservedRunningTime="2026-06-06 20:50:04.883952712 +0000 UTC m=+235.411703867" Jun 06 20:50:05.526978 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.526940 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:05.567822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.565797 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6"] Jun 06 20:50:05.571706 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.571675 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.575242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.575210 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 20:50:05.575242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.575228 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 20:50:05.575536 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.575470 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 20:50:05.575536 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.575482 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 20:50:05.576149 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.576129 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 20:50:05.576338 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.576318 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b9t8m\"" Jun 06 20:50:05.577573 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.577551 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6"] Jun 06 20:50:05.592103 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.592054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:05.670629 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.670572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.670629 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.670637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef89db86-2e2f-4b06-a085-9901c5cf0d06-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.670862 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.670751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.670862 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.670777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snh6j\" (UniqueName: \"kubernetes.io/projected/ef89db86-2e2f-4b06-a085-9901c5cf0d06-kube-api-access-snh6j\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.772046 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.772010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.772046 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.772050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef89db86-2e2f-4b06-a085-9901c5cf0d06-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.772287 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.772134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.772287 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.772169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snh6j\" (UniqueName: \"kubernetes.io/projected/ef89db86-2e2f-4b06-a085-9901c5cf0d06-kube-api-access-snh6j\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.772287 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:05.772274 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 06 20:50:05.772453 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:05.772361 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls podName:ef89db86-2e2f-4b06-a085-9901c5cf0d06 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:06.272337701 +0000 UTC m=+236.800088852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-ht7k6" (UID: "ef89db86-2e2f-4b06-a085-9901c5cf0d06") : secret "prometheus-operator-tls" not found Jun 06 20:50:05.772873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.772852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef89db86-2e2f-4b06-a085-9901c5cf0d06-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.774512 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.774492 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:05.780848 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:05.780787 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snh6j\" (UniqueName: \"kubernetes.io/projected/ef89db86-2e2f-4b06-a085-9901c5cf0d06-kube-api-access-snh6j\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:06.022725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.022689 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:06.275801 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.275752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:06.278133 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.278115 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef89db86-2e2f-4b06-a085-9901c5cf0d06-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ht7k6\" (UID: \"ef89db86-2e2f-4b06-a085-9901c5cf0d06\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:06.483978 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.483938 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" Jun 06 20:50:06.613721 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.613683 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6"] Jun 06 20:50:06.618036 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:06.618008 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef89db86_2e2f_4b06_a085_9901c5cf0d06.slice/crio-8a8c5ea8310d45d4bf625df537a08779d5e511a93ddec044a17fa627153c8c6d WatchSource:0}: Error finding container 8a8c5ea8310d45d4bf625df537a08779d5e511a93ddec044a17fa627153c8c6d: Status 404 returned error can't find the container with id 8a8c5ea8310d45d4bf625df537a08779d5e511a93ddec044a17fa627153c8c6d Jun 06 20:50:06.878835 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.878744 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" event={"ID":"ef89db86-2e2f-4b06-a085-9901c5cf0d06","Type":"ContainerStarted","Data":"8a8c5ea8310d45d4bf625df537a08779d5e511a93ddec044a17fa627153c8c6d"} Jun 06 20:50:06.880651 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.880618 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgrbg" event={"ID":"3d7be57c-f31c-453f-8975-0a63a42daa16","Type":"ContainerStarted","Data":"98ca429e16c6c035e03a11c04538c26f266d9d3954b111b15300352cfc45c366"} Jun 06 20:50:06.899781 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:06.899727 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zgrbg" podStartSLOduration=1.760216051 podStartE2EDuration="3.899705652s" totalImagesPullingTime="2.139489601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:06.897971461 +0000 UTC m=+237.425722639" watchObservedRunningTime="2026-06-06 20:50:06.899705652 +0000 UTC m=+237.427456807" Jun 06 20:50:08.407706 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:08.407668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:08.889480 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:08.889449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" event={"ID":"ef89db86-2e2f-4b06-a085-9901c5cf0d06","Type":"ContainerStarted","Data":"cff901d148996ced18a0c4e18ae089f121dd682ea6e490721970f178fe2a8fd3"} Jun 06 20:50:08.889675 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:08.889506 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" event={"ID":"ef89db86-2e2f-4b06-a085-9901c5cf0d06","Type":"ContainerStarted","Data":"8743297a8d7e640de39ea5a9ccfc8cd1ef55eb86382c63edb596f623c46b7332"} Jun 06 20:50:08.905294 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:08.905245 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ht7k6" podStartSLOduration=2.362633908 podStartE2EDuration="3.905227198s" totalImagesPullingTime="1.54259329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:08.904001566 +0000 UTC m=+239.431752721" watchObservedRunningTime="2026-06-06 20:50:08.905227198 +0000 UTC m=+239.432978352" Jun 06 20:50:10.665483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.665442 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:10.860959 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.860925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:10.897055 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.897023 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg"] Jun 06 20:50:10.901348 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.901331 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:10.903660 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.903638 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 06 20:50:10.903660 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.903646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 06 20:50:10.903792 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.903768 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mc8n2\"" Jun 06 20:50:10.911542 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.911516 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg"] Jun 06 20:50:10.917287 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.917233 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48"] Jun 06 20:50:10.920505 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.920484 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:10.920838 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.920818 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cw2wh"] Jun 06 20:50:10.923240 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.923217 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 06 20:50:10.923347 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.923262 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dwz47\"" Jun 06 20:50:10.923347 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.923302 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 06 20:50:10.923498 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.923464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 06 20:50:10.923875 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.923852 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:10.926169 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.926137 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 20:50:10.926377 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.926362 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xcx7p\"" Jun 06 20:50:10.926469 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.926405 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 20:50:10.926469 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.926367 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 20:50:10.934937 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.934915 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48"] Jun 06 20:50:10.935237 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:10.935185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.015947 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.015912 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.016262 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqlx2\" (UniqueName: \"kubernetes.io/projected/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-kube-api-access-jqlx2\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016321 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/651ea8bc-42c3-4717-a2e0-b93298102411-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.016374 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016324 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-wtmp\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016374 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016343 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45174c93-232c-4c94-880e-a48f97275dbc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.016467 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016467 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.016556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvg6\" (UniqueName: \"kubernetes.io/projected/45174c93-232c-4c94-880e-a48f97275dbc-kube-api-access-wdvg6\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.016556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-textfile\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tkvc\" (UniqueName: \"kubernetes.io/projected/651ea8bc-42c3-4717-a2e0-b93298102411-kube-api-access-7tkvc\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.016664 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.016664 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.016664 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.016664 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-sys\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-root\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.016860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-metrics-client-ca\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.017002 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.017002 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016897 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.017002 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.016926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.117409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.117409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvg6\" (UniqueName: \"kubernetes.io/projected/45174c93-232c-4c94-880e-a48f97275dbc-kube-api-access-wdvg6\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117496 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-textfile\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tkvc\" (UniqueName: \"kubernetes.io/projected/651ea8bc-42c3-4717-a2e0-b93298102411-kube-api-access-7tkvc\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117552 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117621 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 06 20:50:11.117687 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117641 2555 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117700 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls podName:651ea8bc-42c3-4717-a2e0-b93298102411 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:11.617678868 +0000 UTC m=+242.145430024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-qwm48" (UID: "651ea8bc-42c3-4717-a2e0-b93298102411") : secret "kube-state-metrics-tls" not found Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-sys\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117834 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls podName:45174c93-232c-4c94-880e-a48f97275dbc nodeName:}" failed. No retries permitted until 2026-06-06 20:50:11.617815197 +0000 UTC m=+242.145566332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-h28jg" (UID: "45174c93-232c-4c94-880e-a48f97275dbc") : secret "openshift-state-metrics-tls" not found Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117853 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-sys\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-textfile\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117931 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:11.117961 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls podName:363c95b1-55c4-4fb0-ab88-b15cdb3e98e3 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:11.617952115 +0000 UTC m=+242.145703248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls") pod "node-exporter-cw2wh" (UID: "363c95b1-55c4-4fb0-ab88-b15cdb3e98e3") : secret "node-exporter-tls" not found Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-root\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-metrics-client-ca\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.117995 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-root\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118069 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqlx2\" (UniqueName: \"kubernetes.io/projected/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-kube-api-access-jqlx2\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/651ea8bc-42c3-4717-a2e0-b93298102411-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118136 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118168 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-wtmp\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45174c93-232c-4c94-880e-a48f97275dbc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.118678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-metrics-client-ca\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.119085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.119085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/651ea8bc-42c3-4717-a2e0-b93298102411-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.119085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/651ea8bc-42c3-4717-a2e0-b93298102411-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.119085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118780 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-wtmp\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.119085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.118959 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45174c93-232c-4c94-880e-a48f97275dbc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.120553 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.120535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.120637 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.120580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.120829 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.120806 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.129688 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.129657 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvg6\" (UniqueName: \"kubernetes.io/projected/45174c93-232c-4c94-880e-a48f97275dbc-kube-api-access-wdvg6\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.130085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.130065 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqlx2\" (UniqueName: \"kubernetes.io/projected/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-kube-api-access-jqlx2\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.130136 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.130088 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tkvc\" (UniqueName: \"kubernetes.io/projected/651ea8bc-42c3-4717-a2e0-b93298102411-kube-api-access-7tkvc\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.199689 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.199593 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.299858 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.299818 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.402131 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.402091 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.499673 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.499636 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.622766 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.622729 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.622964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.622861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.622964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.622911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.625337 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.625308 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/651ea8bc-42c3-4717-a2e0-b93298102411-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qwm48\" (UID: \"651ea8bc-42c3-4717-a2e0-b93298102411\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.625479 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.625314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/363c95b1-55c4-4fb0-ab88-b15cdb3e98e3-node-exporter-tls\") pod \"node-exporter-cw2wh\" (UID: \"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3\") " pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.625479 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.625382 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45174c93-232c-4c94-880e-a48f97275dbc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-h28jg\" (UID: \"45174c93-232c-4c94-880e-a48f97275dbc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.662945 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.662905 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.810662 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.810567 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" Jun 06 20:50:11.831123 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.831095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" Jun 06 20:50:11.838237 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.838213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cw2wh" Jun 06 20:50:11.848872 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:11.848734 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363c95b1_55c4_4fb0_ab88_b15cdb3e98e3.slice/crio-dbd843ba95fe7a492cbc7b95656c91100a92132f370fb83e42be994b3a2db0f8 WatchSource:0}: Error finding container dbd843ba95fe7a492cbc7b95656c91100a92132f370fb83e42be994b3a2db0f8: Status 404 returned error can't find the container with id dbd843ba95fe7a492cbc7b95656c91100a92132f370fb83e42be994b3a2db0f8 Jun 06 20:50:11.887839 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.887713 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.902607 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.902565 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw2wh" event={"ID":"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3","Type":"ContainerStarted","Data":"dbd843ba95fe7a492cbc7b95656c91100a92132f370fb83e42be994b3a2db0f8"} Jun 06 20:50:11.958370 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.958325 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:11.963282 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.963253 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:50:11.969142 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.969077 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:11.971805 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.971690 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 20:50:11.971805 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.971717 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nzbrc\"" Jun 06 20:50:11.971938 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.971919 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 20:50:11.972104 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.972081 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 20:50:11.972329 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.972297 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 20:50:11.972911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.972709 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 20:50:11.972911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.972761 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 20:50:11.972911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.972783 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 20:50:11.973206 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.973169 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 20:50:11.973808 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.973571 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 20:50:11.975250 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:11.975056 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45174c93_232c_4c94_880e_a48f97275dbc.slice/crio-e8dab574741728022711ef246e4a6db33500835c39aa9698b7614d99e862e662 WatchSource:0}: Error finding container e8dab574741728022711ef246e4a6db33500835c39aa9698b7614d99e862e662: Status 404 returned error can't find the container with id e8dab574741728022711ef246e4a6db33500835c39aa9698b7614d99e862e662 Jun 06 20:50:11.975250 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.975232 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg"] Jun 06 20:50:11.981122 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.981100 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:50:11.990253 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:11.990129 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48"] Jun 06 20:50:11.992738 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:11.992700 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651ea8bc_42c3_4717_a2e0_b93298102411.slice/crio-54491da08513fef2d96c28fa6a24ef1a36b422f5a35b23231162250f3a7f3e39 WatchSource:0}: Error finding container 54491da08513fef2d96c28fa6a24ef1a36b422f5a35b23231162250f3a7f3e39: Status 404 returned error can't find the container with id 54491da08513fef2d96c28fa6a24ef1a36b422f5a35b23231162250f3a7f3e39 Jun 06 20:50:12.027489 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027533 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027693 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027693 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027799 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027727 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586cm\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.027948 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.028188 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.027968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129131 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586cm\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129388 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129388 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129275 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129388 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:12.129289 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle podName:0c80166f-8d7e-4200-8412-b27b31cba0fa nodeName:}" failed. No retries permitted until 2026-06-06 20:50:12.629263917 +0000 UTC m=+243.157015068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa") : configmap references non-existent config key: ca-bundle.crt Jun 06 20:50:12.129388 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129334 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129388 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129387 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129698 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129698 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:12.129543 2555 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 06 20:50:12.129698 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:12.129639 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls podName:0c80166f-8d7e-4200-8412-b27b31cba0fa nodeName:}" failed. No retries permitted until 2026-06-06 20:50:12.62962133 +0000 UTC m=+243.157372477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa") : secret "alertmanager-main-tls" not found Jun 06 20:50:12.129698 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.129892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.130129 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.129897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.130640 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.130600 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.133006 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.132971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.133207 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.132983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.133797 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.133749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.134297 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.134134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.134297 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.134248 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.134704 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.134670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.134829 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.134776 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.135227 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.135189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.137628 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.137607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586cm\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.563875 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.563806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:12.635775 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.635727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.636049 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.635800 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.637182 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.637105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.643864 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.643800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.679878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.679819 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:12.685437 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.684376 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:50:12.688786 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.688152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.691183 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.690789 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 20:50:12.691183 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.691011 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 20:50:12.691979 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.691959 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 20:50:12.692412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.692109 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 20:50:12.692412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.692125 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 20:50:12.692412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.691968 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mlw9n\"" Jun 06 20:50:12.692412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.691958 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 20:50:12.692412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.691970 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 20:50:12.708450 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.708319 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 20:50:12.710995 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.710918 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:50:12.736078 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.735992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xz9\" (UniqueName: \"kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736831 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.737106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.736984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838054 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xz9\" (UniqueName: \"kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.838471 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.838329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.839226 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.839162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.840009 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.839941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.840497 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.840474 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.840586 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.840515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.841533 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.841489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.841928 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.841886 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.847480 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.847411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xz9\" (UniqueName: \"kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9\") pod \"console-5997d6d888-pj7tc\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:12.882204 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.882167 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:50:12.909186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.909148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" event={"ID":"651ea8bc-42c3-4717-a2e0-b93298102411","Type":"ContainerStarted","Data":"54491da08513fef2d96c28fa6a24ef1a36b422f5a35b23231162250f3a7f3e39"} Jun 06 20:50:12.911730 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.911680 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" event={"ID":"45174c93-232c-4c94-880e-a48f97275dbc","Type":"ContainerStarted","Data":"f2a01ed21700d8c4974a2dc0e439f1ac4a695212f2fb06bc125170c1939c59e9"} Jun 06 20:50:12.911730 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.911738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" event={"ID":"45174c93-232c-4c94-880e-a48f97275dbc","Type":"ContainerStarted","Data":"c176a805dbacb463f0fdad139e8ba923ab6d644a9402b4aa49d820d8d0c3994d"} Jun 06 20:50:12.911968 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:12.911762 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" event={"ID":"45174c93-232c-4c94-880e-a48f97275dbc","Type":"ContainerStarted","Data":"e8dab574741728022711ef246e4a6db33500835c39aa9698b7614d99e862e662"} Jun 06 20:50:13.006940 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.006906 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:13.053062 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.053032 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:50:13.173230 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:13.173139 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c80166f_8d7e_4200_8412_b27b31cba0fa.slice/crio-5df44096c450df1a84fdfc129c9d7798cfbe79c146af2d1ebea66b6e3af8c60a WatchSource:0}: Error finding container 5df44096c450df1a84fdfc129c9d7798cfbe79c146af2d1ebea66b6e3af8c60a: Status 404 returned error can't find the container with id 5df44096c450df1a84fdfc129c9d7798cfbe79c146af2d1ebea66b6e3af8c60a Jun 06 20:50:13.682128 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.682098 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:50:13.686863 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:13.686823 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd07d79_d1a2_43e4_bbc8_75d0234f1888.slice/crio-9d33224c72196f19ef10cafe8277a4daa299990a51e09f54da283175341ec3c5 WatchSource:0}: Error finding container 9d33224c72196f19ef10cafe8277a4daa299990a51e09f54da283175341ec3c5: Status 404 returned error can't find the container with id 9d33224c72196f19ef10cafe8277a4daa299990a51e09f54da283175341ec3c5 Jun 06 20:50:13.844865 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.844777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:13.918500 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.918464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5997d6d888-pj7tc" event={"ID":"1fd07d79-d1a2-43e4-bbc8-75d0234f1888","Type":"ContainerStarted","Data":"9d33224c72196f19ef10cafe8277a4daa299990a51e09f54da283175341ec3c5"} Jun 06 20:50:13.919841 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.919813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"5df44096c450df1a84fdfc129c9d7798cfbe79c146af2d1ebea66b6e3af8c60a"} Jun 06 20:50:13.922222 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.922192 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" event={"ID":"651ea8bc-42c3-4717-a2e0-b93298102411","Type":"ContainerStarted","Data":"60dde607c499826454b0b0005102be81c6748c4e335d092f99abe563acafdbb9"} Jun 06 20:50:13.922319 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.922248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" event={"ID":"651ea8bc-42c3-4717-a2e0-b93298102411","Type":"ContainerStarted","Data":"4c4f0020f1bf2c93da8bb29dcbafa79af08ed8e3a6c78529f6e79e7399a45e89"} Jun 06 20:50:13.922319 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.922281 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" event={"ID":"651ea8bc-42c3-4717-a2e0-b93298102411","Type":"ContainerStarted","Data":"86bcd4c4a2fe9aae99fc668fc6c7d60f5c1da73df248d552dcd216def56700d7"} Jun 06 20:50:13.925385 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.925019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" event={"ID":"45174c93-232c-4c94-880e-a48f97275dbc","Type":"ContainerStarted","Data":"7f692a28bc2098d29b28454d56587d0548f1c658b674da6ae53d090f63a7b3ed"} Jun 06 20:50:13.926749 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.926673 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:13.927900 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.927859 2555 generic.go:356] "Generic (PLEG): container finished" podID="363c95b1-55c4-4fb0-ab88-b15cdb3e98e3" containerID="a25f5d7da0cfe052bc06b2be8cf85582bfdb93e0f1d2d6bc6c48233dbf75c89e" exitCode=0 Jun 06 20:50:13.927900 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.927896 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw2wh" event={"ID":"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3","Type":"ContainerDied","Data":"a25f5d7da0cfe052bc06b2be8cf85582bfdb93e0f1d2d6bc6c48233dbf75c89e"} Jun 06 20:50:13.941901 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.941858 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qwm48" podStartSLOduration=2.397907993 podStartE2EDuration="3.941839212s" totalImagesPullingTime="1.543931219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:13.94137615 +0000 UTC m=+244.469127306" watchObservedRunningTime="2026-06-06 20:50:13.941839212 +0000 UTC m=+244.469590372" Jun 06 20:50:13.987696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:13.987621 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-h28jg" podStartSLOduration=2.535626706 podStartE2EDuration="3.987595801s" totalImagesPullingTime="1.451969095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:13.986212106 +0000 UTC m=+244.513963273" watchObservedRunningTime="2026-06-06 20:50:13.987595801 +0000 UTC m=+244.515346957" Jun 06 20:50:14.188165 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.188080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:14.389562 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.389522 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:14.933300 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.933255 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3" exitCode=0 Jun 06 20:50:14.933796 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.933340 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3"} Jun 06 20:50:14.935904 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.935816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw2wh" event={"ID":"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3","Type":"ContainerStarted","Data":"60090ecaa89c1d056393d29c2c334537878afafcd9e8448b92f2b9560c6c9704"} Jun 06 20:50:14.936014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.935878 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cw2wh" event={"ID":"363c95b1-55c4-4fb0-ab88-b15cdb3e98e3","Type":"ContainerStarted","Data":"305f34e064fd649a83792122eab715589161531535b6f0a773f30f6af3a50857"} Jun 06 20:50:14.978598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:14.978532 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cw2wh" podStartSLOduration=3.9110096519999997 podStartE2EDuration="4.978514454s" totalImagesPullingTime="975.397862ms" totalInitContainerRuntime="92.10694ms" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:14.977265979 +0000 UTC m=+245.505017135" watchObservedRunningTime="2026-06-06 20:50:14.978514454 +0000 UTC m=+245.506265609" Jun 06 20:50:15.318271 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.318232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6"] Jun 06 20:50:15.321891 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.321868 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.325220 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.325175 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:50:15.325373 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.325318 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-71t36lmnpbrh0\"" Jun 06 20:50:15.326329 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.326293 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 06 20:50:15.326447 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.326367 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 06 20:50:15.326504 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.326369 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 06 20:50:15.326556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.326503 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r7zmb\"" Jun 06 20:50:15.335552 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.335525 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6"] Jun 06 20:50:15.467296 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-audit-log\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467296 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fqx\" (UniqueName: \"kubernetes.io/projected/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-kube-api-access-r2fqx\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467491 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467491 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-metrics-server-audit-profiles\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467590 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-tls\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467590 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-client-certs\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.467590 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.467558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-client-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568700 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-metrics-server-audit-profiles\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568700 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-tls\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-client-certs\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-client-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568829 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-audit-log\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.568925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fqx\" (UniqueName: \"kubernetes.io/projected/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-kube-api-access-r2fqx\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.569180 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.568925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.569873 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.569817 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-metrics-server-audit-profiles\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.570597 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.570541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.570723 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.570672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-audit-log\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.571945 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.571918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-client-certs\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.572465 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.572412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-secret-metrics-server-tls\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.573125 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.573088 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-client-ca-bundle\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.577296 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.577269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fqx\" (UniqueName: \"kubernetes.io/projected/5cd8f068-6a94-4f3d-a9ef-3f8bff57a364-kube-api-access-r2fqx\") pod \"metrics-server-7ffbf6cf77-g7nl6\" (UID: \"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364\") " pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.633326 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.633282 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:15.683548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.683478 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:15.725399 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.725342 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:50:15.729100 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.729074 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.740259 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.740185 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:50:15.749809 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.749743 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:15.872575 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872488 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872575 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872764 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4qwd\" (UniqueName: \"kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872764 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872790 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.872924 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.872903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.911898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.911746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:15.973564 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.973536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4qwd\" (UniqueName: \"kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.973584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.973845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.973896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.973948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.974071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974299 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.974125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974759 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.974661 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.974759 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.974728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.975066 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.974919 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.975455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.975379 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.976786 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.976764 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.977210 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.977186 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:15.982042 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:15.982017 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4qwd\" (UniqueName: \"kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd\") pod \"console-6d858f55cf-zcwws\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:16.044325 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:16.044282 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:16.884315 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:16.884193 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:16.981815 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:16.981773 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:17.110702 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.110591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:17.235631 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.234213 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6"] Jun 06 20:50:17.240045 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:17.240011 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd8f068_6a94_4f3d_a9ef_3f8bff57a364.slice/crio-390c8fcf674997b0fdbb7ac3e864e9cf495647310ed195e26834a5ba86bfbf40 WatchSource:0}: Error finding container 390c8fcf674997b0fdbb7ac3e864e9cf495647310ed195e26834a5ba86bfbf40: Status 404 returned error can't find the container with id 390c8fcf674997b0fdbb7ac3e864e9cf495647310ed195e26834a5ba86bfbf40 Jun 06 20:50:17.256346 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.256198 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:50:17.263131 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:17.263090 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90829777_0e81_4ef1_9906_15460c9e8f78.slice/crio-539042c5e0e09556bffda572abef335af927c413d4ce48ed95af0a98e5782a01 WatchSource:0}: Error finding container 539042c5e0e09556bffda572abef335af927c413d4ce48ed95af0a98e5782a01: Status 404 returned error can't find the container with id 539042c5e0e09556bffda572abef335af927c413d4ce48ed95af0a98e5782a01 Jun 06 20:50:17.952583 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.952543 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" event={"ID":"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364","Type":"ContainerStarted","Data":"390c8fcf674997b0fdbb7ac3e864e9cf495647310ed195e26834a5ba86bfbf40"} Jun 06 20:50:17.954337 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.954294 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858f55cf-zcwws" event={"ID":"90829777-0e81-4ef1-9906-15460c9e8f78","Type":"ContainerStarted","Data":"bc7ff242ba8e77b74c490fce5656b680f3664b329553201a995e8678ddc6f048"} Jun 06 20:50:17.954483 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.954349 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858f55cf-zcwws" event={"ID":"90829777-0e81-4ef1-9906-15460c9e8f78","Type":"ContainerStarted","Data":"539042c5e0e09556bffda572abef335af927c413d4ce48ed95af0a98e5782a01"} Jun 06 20:50:17.956156 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.956118 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5997d6d888-pj7tc" event={"ID":"1fd07d79-d1a2-43e4-bbc8-75d0234f1888","Type":"ContainerStarted","Data":"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda"} Jun 06 20:50:17.959709 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.959688 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297"} Jun 06 20:50:17.959814 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.959755 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673"} Jun 06 20:50:17.959814 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.959799 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0"} Jun 06 20:50:17.959942 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.959837 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503"} Jun 06 20:50:17.959942 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.959877 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb"} Jun 06 20:50:17.971678 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.971628 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d858f55cf-zcwws" podStartSLOduration=2.971606129 podStartE2EDuration="2.971606129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:17.970265733 +0000 UTC m=+248.498016888" watchObservedRunningTime="2026-06-06 20:50:17.971606129 +0000 UTC m=+248.499357285" Jun 06 20:50:17.987340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:17.987283 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5997d6d888-pj7tc" podStartSLOduration=2.633953605 podStartE2EDuration="5.987262646s" totalImagesPullingTime="3.353309041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:17.985630091 +0000 UTC m=+248.513381253" watchObservedRunningTime="2026-06-06 20:50:17.987262646 +0000 UTC m=+248.515013803" Jun 06 20:50:18.965839 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:18.965797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" event={"ID":"5cd8f068-6a94-4f3d-a9ef-3f8bff57a364","Type":"ContainerStarted","Data":"aae9885eb4a5ae93fcf7183414eccc60ab4760cd1d18bfef422667903d0a22a6"} Jun 06 20:50:18.969623 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:18.969588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerStarted","Data":"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2"} Jun 06 20:50:18.982914 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:18.982861 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" podStartSLOduration=2.402935976 podStartE2EDuration="3.982842756s" totalImagesPullingTime="1.57990678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:18.981516216 +0000 UTC m=+249.509267373" watchObservedRunningTime="2026-06-06 20:50:18.982842756 +0000 UTC m=+249.510593911" Jun 06 20:50:19.006289 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:19.006227 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.131562774 podStartE2EDuration="8.006208513s" totalImagesPullingTime="3.855225715s" totalInitContainerRuntime="19.420024ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:19.003850989 +0000 UTC m=+249.531602145" watchObservedRunningTime="2026-06-06 20:50:19.006208513 +0000 UTC m=+249.533959667" Jun 06 20:50:20.934189 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:20.934147 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:50:20.936520 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:20.936494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ab0d8d5-e060-4c58-bdc4-b2ef89b76792-metrics-certs\") pod \"network-metrics-daemon-hdrrk\" (UID: \"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792\") " pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:50:21.171283 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.171253 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\"" Jun 06 20:50:21.179429 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.179396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdrrk" Jun 06 20:50:21.306683 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.306622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:21.334318 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.334300 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hdrrk"] Jun 06 20:50:21.337062 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:21.337033 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab0d8d5_e060_4c58_bdc4_b2ef89b76792.slice/crio-5fb0632f46685a71aae4e3725af3b8374723041446ba308582e566ef8c3b5d3f WatchSource:0}: Error finding container 5fb0632f46685a71aae4e3725af3b8374723041446ba308582e566ef8c3b5d3f: Status 404 returned error can't find the container with id 5fb0632f46685a71aae4e3725af3b8374723041446ba308582e566ef8c3b5d3f Jun 06 20:50:21.407305 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.407273 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:21.989155 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:21.989094 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdrrk" event={"ID":"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792","Type":"ContainerStarted","Data":"5fb0632f46685a71aae4e3725af3b8374723041446ba308582e566ef8c3b5d3f"} Jun 06 20:50:22.177326 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:22.177265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:22.277790 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:22.277714 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:22.994557 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:22.994521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdrrk" event={"ID":"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792","Type":"ContainerStarted","Data":"56cad8f98b136f684ff07e20254d09b94f79b28a2772089741d7fc060a2016cb"} Jun 06 20:50:22.995029 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:22.994587 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdrrk" event={"ID":"7ab0d8d5-e060-4c58-bdc4-b2ef89b76792","Type":"ContainerStarted","Data":"2cfcdff08faf7069999156d83e02b3e2289bd92591d28c403b9f2d00d7c09819"} Jun 06 20:50:23.007414 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.007385 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:23.007561 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.007455 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:50:23.008758 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.008731 2555 patch_prober.go:28] interesting pod/console-5997d6d888-pj7tc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 06 20:50:23.008839 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.008789 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5997d6d888-pj7tc" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 06 20:50:23.011145 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.011102 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hdrrk" podStartSLOduration=252.033955018 podStartE2EDuration="4m13.011087823s" totalImagesPullingTime="977.132805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:23.010467233 +0000 UTC m=+253.538218388" watchObservedRunningTime="2026-06-06 20:50:23.011087823 +0000 UTC m=+253.538838978" Jun 06 20:50:23.094726 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.094693 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:23.152526 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:23.152485 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:25.518017 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:25.517984 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:25.565692 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:25.565652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:26.044723 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.044686 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:26.044886 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.044786 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:50:26.046342 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.046302 2555 patch_prober.go:28] interesting pod/console-6d858f55cf-zcwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:50:26.046521 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.046358 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 20:50:26.697402 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.697369 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:50:26.722779 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.722745 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:50:26.726043 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.726022 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.734445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.734407 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:50:26.896962 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.896912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.896962 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.896966 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.897186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.896991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.897186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.897059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.897308 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.897194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.897308 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.897226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.897308 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.897253 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4x7\" (UniqueName: \"kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.997910 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.997871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998055 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.997924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998055 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.998013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998173 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.998125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998173 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.998157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4x7\" (UniqueName: \"kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998262 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.998221 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.998262 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.998251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.999230 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.999195 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.999380 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.999357 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.999500 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.999195 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:26.999738 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:26.999715 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:27.005606 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:27.005581 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:27.005756 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:27.005668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:27.007716 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:27.007683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4x7\" (UniqueName: \"kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7\") pod \"console-5669cff986-n5fkz\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:27.036284 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:27.036243 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:27.172015 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:27.171984 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:50:27.174315 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:27.174288 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834428dd_8c5c_45e9_bc4c_06663ddbcd55.slice/crio-c34de813e04a93ebe1e098ae0448ac4f37d4b8313c946ca6ce6ca5569e43c637 WatchSource:0}: Error finding container c34de813e04a93ebe1e098ae0448ac4f37d4b8313c946ca6ce6ca5569e43c637: Status 404 returned error can't find the container with id c34de813e04a93ebe1e098ae0448ac4f37d4b8313c946ca6ce6ca5569e43c637 Jun 06 20:50:28.019335 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:28.019299 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669cff986-n5fkz" event={"ID":"834428dd-8c5c-45e9-bc4c-06663ddbcd55","Type":"ContainerStarted","Data":"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955"} Jun 06 20:50:28.019751 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:28.019352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669cff986-n5fkz" event={"ID":"834428dd-8c5c-45e9-bc4c-06663ddbcd55","Type":"ContainerStarted","Data":"c34de813e04a93ebe1e098ae0448ac4f37d4b8313c946ca6ce6ca5569e43c637"} Jun 06 20:50:28.036367 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:28.036312 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5669cff986-n5fkz" podStartSLOduration=2.036291782 podStartE2EDuration="2.036291782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:28.035290142 +0000 UTC m=+258.563041302" watchObservedRunningTime="2026-06-06 20:50:28.036291782 +0000 UTC m=+258.564042938" Jun 06 20:50:32.283616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:32.283574 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:32.333280 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:32.333246 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:35.634309 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:35.634270 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:35.634755 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:35.634336 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:36.044922 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:36.044884 2555 patch_prober.go:28] interesting pod/console-6d858f55cf-zcwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:50:36.045093 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:36.044942 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 20:50:37.036530 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.036478 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:37.036530 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.036544 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:50:37.038108 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.038079 2555 patch_prober.go:28] interesting pod/console-5669cff986-n5fkz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 06 20:50:37.038291 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.038129 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5669cff986-n5fkz" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 06 20:50:37.061246 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.061200 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:37.118865 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:37.118815 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:39.359123 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:39.359087 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:39.460639 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:39.460610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:41.865657 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:41.865621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:41.918925 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:41.918887 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:45.088931 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:45.088895 2555 generic.go:356] "Generic (PLEG): container finished" podID="15db359d-ea49-41a7-9e62-1c8bdff096e5" containerID="ce59b7cdf8443c6d66c4836826703387fb562c77e9d9c80aaedcb2abb1da0ad3" exitCode=0 Jun 06 20:50:45.089412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:45.088948 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" event={"ID":"15db359d-ea49-41a7-9e62-1c8bdff096e5","Type":"ContainerDied","Data":"ce59b7cdf8443c6d66c4836826703387fb562c77e9d9c80aaedcb2abb1da0ad3"} Jun 06 20:50:45.089412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:45.089317 2555 scope.go:117] "RemoveContainer" containerID="ce59b7cdf8443c6d66c4836826703387fb562c77e9d9c80aaedcb2abb1da0ad3" Jun 06 20:50:46.045230 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:46.045197 2555 patch_prober.go:28] interesting pod/console-6d858f55cf-zcwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:50:46.045409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:46.045252 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 20:50:46.094754 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:46.094718 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xz7nf" event={"ID":"15db359d-ea49-41a7-9e62-1c8bdff096e5","Type":"ContainerStarted","Data":"c7303b527ae0efaa1c61473dc69d123519ad6a982219cddd251503a8730a7da2"} Jun 06 20:50:47.036946 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:47.036906 2555 patch_prober.go:28] interesting pod/console-5669cff986-n5fkz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 06 20:50:47.037120 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:47.036977 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5669cff986-n5fkz" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 06 20:50:48.393447 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:48.393395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:48.446820 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:48.446784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:51.338753 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:51.338713 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:51.388995 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:51.388961 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:51.617619 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:51.617520 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sdvtj" podUID="5dade9e8-8977-459f-8d99-f13617a0b79b" Jun 06 20:50:51.617619 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:50:51.617520 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" Jun 06 20:50:51.718047 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:51.718005 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5997d6d888-pj7tc" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerName="console" containerID="cri-o://6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda" gracePeriod=15 Jun 06 20:50:52.119380 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:52.119343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:50:52.119592 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:52.119343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:50:55.257231 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.257184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:50:55.259725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.259701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"image-registry-64bfdff76f-fvgm2\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:50:55.358583 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.358523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:50:55.360914 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.360888 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dade9e8-8977-459f-8d99-f13617a0b79b-metrics-tls\") pod \"dns-default-sdvtj\" (UID: \"5dade9e8-8977-459f-8d99-f13617a0b79b\") " pod="openshift-dns/dns-default-sdvtj" Jun 06 20:50:55.424248 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.424210 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdrjs\"" Jun 06 20:50:55.424380 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.424215 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\"" Jun 06 20:50:55.431272 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.431252 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:50:55.431445 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.431427 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:50:55.588605 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.588542 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:50:55.590947 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:55.590918 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f963c2_113b_47eb_aa89_b4992d0fc45a.slice/crio-248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5 WatchSource:0}: Error finding container 248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5: Status 404 returned error can't find the container with id 248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5 Jun 06 20:50:55.602561 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.602536 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdvtj"] Jun 06 20:50:55.605950 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:50:55.605910 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dade9e8_8977_459f_8d99_f13617a0b79b.slice/crio-f8e6440c0a7965a0b6740d332b8543fbb2d2fc8e47c2a2bffc6cb9a8a7eb8921 WatchSource:0}: Error finding container f8e6440c0a7965a0b6740d332b8543fbb2d2fc8e47c2a2bffc6cb9a8a7eb8921: Status 404 returned error can't find the container with id f8e6440c0a7965a0b6740d332b8543fbb2d2fc8e47c2a2bffc6cb9a8a7eb8921 Jun 06 20:50:55.639250 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.639223 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:55.643250 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:55.643223 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7ffbf6cf77-g7nl6" Jun 06 20:50:56.045731 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.045694 2555 patch_prober.go:28] interesting pod/console-6d858f55cf-zcwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:50:56.045910 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.045743 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 20:50:56.137737 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.137698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdvtj" event={"ID":"5dade9e8-8977-459f-8d99-f13617a0b79b","Type":"ContainerStarted","Data":"f8e6440c0a7965a0b6740d332b8543fbb2d2fc8e47c2a2bffc6cb9a8a7eb8921"} Jun 06 20:50:56.139631 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.139601 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" event={"ID":"f2f963c2-113b-47eb-aa89-b4992d0fc45a","Type":"ContainerStarted","Data":"e523f927780914fd15e83c7880238eb883842da5b1fe5ba029bc1414e023554a"} Jun 06 20:50:56.139767 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.139652 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" event={"ID":"f2f963c2-113b-47eb-aa89-b4992d0fc45a","Type":"ContainerStarted","Data":"248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5"} Jun 06 20:50:56.159330 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:56.159278 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" podStartSLOduration=286.159257745 podStartE2EDuration="4m46.159257745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:56.157887565 +0000 UTC m=+286.685638739" watchObservedRunningTime="2026-06-06 20:50:56.159257745 +0000 UTC m=+286.687008903" Jun 06 20:50:57.037340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:57.037301 2555 patch_prober.go:28] interesting pod/console-5669cff986-n5fkz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 06 20:50:57.037736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:57.037361 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5669cff986-n5fkz" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 06 20:50:57.145150 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:57.145111 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:50:58.150497 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:58.150463 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdvtj" event={"ID":"5dade9e8-8977-459f-8d99-f13617a0b79b","Type":"ContainerStarted","Data":"00563ceb30b6d042fb360d4329878ed387e90fda0b8824bfb36e9a1451b454e7"} Jun 06 20:50:58.150892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:58.150519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdvtj" event={"ID":"5dade9e8-8977-459f-8d99-f13617a0b79b","Type":"ContainerStarted","Data":"8d1ce9f5694f498d9c379604a2926c080d1070aeee3bb4f8e621d13e8abc7c97"} Jun 06 20:50:58.167015 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:58.166945 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sdvtj" podStartSLOduration=251.219313758 podStartE2EDuration="4m13.166924312s" totalImagesPullingTime="1.947610554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:58.166276468 +0000 UTC m=+288.694027623" watchObservedRunningTime="2026-06-06 20:50:58.166924312 +0000 UTC m=+288.694675468" Jun 06 20:50:59.154976 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:50:59.154945 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:51:00.869778 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:00.869739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:00.969913 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:00.969883 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:05.185700 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:05.185660 2555 generic.go:356] "Generic (PLEG): container finished" podID="2deea783-5dd3-47f6-8a5b-91edc5758641" containerID="bfcc35240055b76630508b7af8ad01f3de3066cc02f7b1141cc6b140c0ab4a93" exitCode=0 Jun 06 20:51:05.186088 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:05.185738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-zxdzz" event={"ID":"2deea783-5dd3-47f6-8a5b-91edc5758641","Type":"ContainerDied","Data":"bfcc35240055b76630508b7af8ad01f3de3066cc02f7b1141cc6b140c0ab4a93"} Jun 06 20:51:05.186131 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:05.186120 2555 scope.go:117] "RemoveContainer" containerID="bfcc35240055b76630508b7af8ad01f3de3066cc02f7b1141cc6b140c0ab4a93" Jun 06 20:51:06.048185 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.048152 2555 patch_prober.go:28] interesting pod/console-6d858f55cf-zcwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:51:06.048539 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.048501 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 20:51:06.192474 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.192443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-zxdzz" event={"ID":"2deea783-5dd3-47f6-8a5b-91edc5758641","Type":"ContainerStarted","Data":"c5a96dce2fe518c8505a08079c44a5aca1dc9f20074c04f12970e15cba55a6a0"} Jun 06 20:51:06.865598 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.865571 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5997d6d888-pj7tc_1fd07d79-d1a2-43e4-bbc8-75d0234f1888/console/0.log" Jun 06 20:51:06.867944 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.867927 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:51:06.965728 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965690 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965735 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965755 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965785 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2xz9\" (UniqueName: \"kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965860 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965881 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.965915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.965905 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config\") pod \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\" (UID: \"1fd07d79-d1a2-43e4-bbc8-75d0234f1888\") " Jun 06 20:51:06.966589 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.966193 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config" (OuterVolumeSpecName: "console-config") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:06.966589 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.966259 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:06.966589 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.966332 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:06.966589 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.966446 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:06.968182 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.968155 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:06.968251 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.968233 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:06.968285 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:06.968267 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9" (OuterVolumeSpecName: "kube-api-access-h2xz9") pod "1fd07d79-d1a2-43e4-bbc8-75d0234f1888" (UID: "1fd07d79-d1a2-43e4-bbc8-75d0234f1888"). InnerVolumeSpecName "kube-api-access-h2xz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:07.036919 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.036882 2555 patch_prober.go:28] interesting pod/console-5669cff986-n5fkz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 06 20:51:07.037085 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.036956 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5669cff986-n5fkz" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 06 20:51:07.066672 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066637 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066672 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066666 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-oauth-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066672 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066677 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-oauth-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066905 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066687 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-service-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066905 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066695 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066905 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066703 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-console-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.066905 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.066712 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2xz9\" (UniqueName: \"kubernetes.io/projected/1fd07d79-d1a2-43e4-bbc8-75d0234f1888-kube-api-access-h2xz9\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:07.198509 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198480 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5997d6d888-pj7tc_1fd07d79-d1a2-43e4-bbc8-75d0234f1888/console/0.log" Jun 06 20:51:07.198981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198522 2555 generic.go:356] "Generic (PLEG): container finished" podID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerID="6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda" exitCode=137 Jun 06 20:51:07.198981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198582 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5997d6d888-pj7tc" Jun 06 20:51:07.198981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198624 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5997d6d888-pj7tc" event={"ID":"1fd07d79-d1a2-43e4-bbc8-75d0234f1888","Type":"ContainerDied","Data":"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda"} Jun 06 20:51:07.198981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5997d6d888-pj7tc" event={"ID":"1fd07d79-d1a2-43e4-bbc8-75d0234f1888","Type":"ContainerDied","Data":"9d33224c72196f19ef10cafe8277a4daa299990a51e09f54da283175341ec3c5"} Jun 06 20:51:07.198981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.198726 2555 scope.go:117] "RemoveContainer" containerID="6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda" Jun 06 20:51:07.207716 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.207697 2555 scope.go:117] "RemoveContainer" containerID="6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda" Jun 06 20:51:07.208006 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:07.207982 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda\": container with ID starting with 6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda not found: ID does not exist" containerID="6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda" Jun 06 20:51:07.208100 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.208013 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda"} err="failed to get container status \"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda\": rpc error: code = NotFound desc = could not find container \"6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda\": container with ID starting with 6a524652156c17549d5960c07cea0a91fc01d34680ca19dfc12a0a479cf0dcda not found: ID does not exist" Jun 06 20:51:07.219409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.219374 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:51:07.225617 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.225553 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5997d6d888-pj7tc"] Jun 06 20:51:07.972587 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:07.972550 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" path="/var/lib/kubelet/pods/1fd07d79-d1a2-43e4-bbc8-75d0234f1888/volumes" Jun 06 20:51:08.253252 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:08.253109 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/init-config-reloader/0.log" Jun 06 20:51:08.452235 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:08.452186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/alertmanager/0.log" Jun 06 20:51:08.651571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:08.651474 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/config-reloader/0.log" Jun 06 20:51:08.851619 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:08.851587 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/kube-rbac-proxy-web/0.log" Jun 06 20:51:09.051958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.051925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/kube-rbac-proxy/0.log" Jun 06 20:51:09.162343 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.162311 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sdvtj" Jun 06 20:51:09.251796 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.251768 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/kube-rbac-proxy-metric/0.log" Jun 06 20:51:09.451653 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.451577 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c80166f-8d7e-4200-8412-b27b31cba0fa/prom-label-proxy/0.log" Jun 06 20:51:09.851440 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.851385 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-state-metrics/0.log" Jun 06 20:51:09.902350 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.902327 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:51:09.905010 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.904983 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:51:09.907737 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.907715 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:51:09.909812 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.909796 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:51:09.917201 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:09.917169 2555 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 20:51:10.051040 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:10.051014 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-rbac-proxy-main/0.log" Jun 06 20:51:10.250811 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:10.250781 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-rbac-proxy-self/0.log" Jun 06 20:51:10.450884 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:10.450849 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7ffbf6cf77-g7nl6_5cd8f068-6a94-4f3d-a9ef-3f8bff57a364/metrics-server/0.log" Jun 06 20:51:10.479345 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:10.479315 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:10.851721 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:10.851689 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/init-textfile/0.log" Jun 06 20:51:11.052827 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:11.052797 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/node-exporter/0.log" Jun 06 20:51:11.251364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:11.251329 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/kube-rbac-proxy/0.log" Jun 06 20:51:12.655489 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:12.655456 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/kube-rbac-proxy-main/0.log" Jun 06 20:51:12.851793 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:12.851764 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/kube-rbac-proxy-self/0.log" Jun 06 20:51:13.052036 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:13.051999 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/openshift-state-metrics/0.log" Jun 06 20:51:14.653945 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:14.653907 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ht7k6_ef89db86-2e2f-4b06-a085-9901c5cf0d06/prometheus-operator/0.log" Jun 06 20:51:14.851238 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:14.851208 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ht7k6_ef89db86-2e2f-4b06-a085-9901c5cf0d06/kube-rbac-proxy/0.log" Jun 06 20:51:15.051672 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:15.051637 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kkv6p_db6e8abc-d549-4847-a0e9-df50da301441/prometheus-operator-admission-webhook/0.log" Jun 06 20:51:15.435672 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:15.435592 2555 patch_prober.go:28] interesting pod/image-registry-64bfdff76f-fvgm2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:51:15.435823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:15.435669 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:51:16.049309 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:16.049276 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:51:16.053473 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:16.053444 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:51:16.188679 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:16.188638 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:17.040913 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.040880 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:51:17.045063 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.045042 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:51:17.101614 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.101581 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:51:17.251179 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.251151 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:51:17.454134 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.454034 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/2.log" Jun 06 20:51:17.510444 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.510381 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:17.651952 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:17.651892 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5669cff986-n5fkz_834428dd-8c5c-45e9-bc4c-06663ddbcd55/console/0.log" Jun 06 20:51:18.052115 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.052087 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d858f55cf-zcwws_90829777-0e81-4ef1-9906-15460c9e8f78/console/0.log" Jun 06 20:51:18.154902 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.154869 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:51:18.292449 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.292402 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:18.394691 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.394610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:18.449011 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.448980 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:18.450306 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.450284 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdvtj_5dade9e8-8977-459f-8d99-f13617a0b79b/dns/0.log" Jun 06 20:51:18.651033 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:18.650932 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdvtj_5dade9e8-8977-459f-8d99-f13617a0b79b/kube-rbac-proxy/0.log" Jun 06 20:51:19.650348 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:19.650318 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4rsf5_0fe59e50-b461-40b4-8a99-4f08c8e73cdc/dns-node-resolver/0.log" Jun 06 20:51:20.250796 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:20.250763 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64bfdff76f-fvgm2_f2f963c2-113b-47eb-aa89-b4992d0fc45a/registry/0.log" Jun 06 20:51:20.851063 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:20.851034 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvqkq_929b0159-6839-4fdb-b86a-817a3486228f/node-ca/0.log" Jun 06 20:51:21.851081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:21.851038 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxbwn_5e3e53f1-5dbf-4388-b5c1-61598ad415c7/serve-healthcheck-canary/0.log" Jun 06 20:51:25.260685 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:25.260649 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:25.363541 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:25.363495 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:26.971472 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:26.971436 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:27.073779 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:27.073740 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:28.185070 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:28.185032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:28.243135 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:28.243096 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:30.145295 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.145256 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:51:30.145830 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.145643 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerName="console" Jun 06 20:51:30.145830 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.145657 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerName="console" Jun 06 20:51:30.145830 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.145724 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fd07d79-d1a2-43e4-bbc8-75d0234f1888" containerName="console" Jun 06 20:51:30.152540 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.152511 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.162943 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.162920 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:51:30.210624 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.210593 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:30.276906 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.276863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277096 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.276929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277096 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.276964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277096 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.276989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277096 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.277081 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzkk\" (UniqueName: \"kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277246 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.277143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.277246 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.277211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.309856 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.309817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:30.378305 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378305 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378375 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378394 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzkk\" (UniqueName: \"kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.378571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.378500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.379235 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.379210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.379374 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.379316 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.379374 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.379336 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.379475 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.379462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.380742 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.380718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.380983 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.380963 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.389748 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.389719 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzkk\" (UniqueName: \"kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk\") pod \"console-694c5c46d-mmkl9\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.464719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.464625 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:30.626828 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:30.626786 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:51:30.631173 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:51:30.631144 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17db85a4_ec19_46f5_bb79_0d5afd7538fd.slice/crio-157419a04c6895988169758cb4fa366d888650435c1600dcf786f611b7328a14 WatchSource:0}: Error finding container 157419a04c6895988169758cb4fa366d888650435c1600dcf786f611b7328a14: Status 404 returned error can't find the container with id 157419a04c6895988169758cb4fa366d888650435c1600dcf786f611b7328a14 Jun 06 20:51:31.188263 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.188224 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:51:31.269639 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.269607 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:31.269911 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.269883 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="alertmanager" containerID="cri-o://f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" gracePeriod=120 Jun 06 20:51:31.270151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.269993 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-metric" containerID="cri-o://9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" gracePeriod=120 Jun 06 20:51:31.270151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.270028 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="prom-label-proxy" containerID="cri-o://b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" gracePeriod=120 Jun 06 20:51:31.270151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.270017 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="config-reloader" containerID="cri-o://48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" gracePeriod=120 Jun 06 20:51:31.270151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.270065 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-web" containerID="cri-o://ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" gracePeriod=120 Jun 06 20:51:31.270151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.269995 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy" containerID="cri-o://5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" gracePeriod=120 Jun 06 20:51:31.317086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.317046 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:31.318464 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.318411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694c5c46d-mmkl9" event={"ID":"17db85a4-ec19-46f5-bb79-0d5afd7538fd","Type":"ContainerStarted","Data":"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076"} Jun 06 20:51:31.318615 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.318528 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694c5c46d-mmkl9" event={"ID":"17db85a4-ec19-46f5-bb79-0d5afd7538fd","Type":"ContainerStarted","Data":"157419a04c6895988169758cb4fa366d888650435c1600dcf786f611b7328a14"} Jun 06 20:51:31.461492 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.461380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:31.560915 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:31.560880 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:32.327556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327526 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" exitCode=0 Jun 06 20:51:32.327556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327553 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" exitCode=0 Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327563 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" exitCode=0 Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327572 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" exitCode=0 Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327596 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2"} Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327660 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673"} Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503"} Jun 06 20:51:32.327974 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.327714 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb"} Jun 06 20:51:32.527692 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.527664 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:32.556277 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.556212 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-694c5c46d-mmkl9" podStartSLOduration=2.556190642 podStartE2EDuration="2.556190642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:51:31.334880965 +0000 UTC m=+321.862632122" watchObservedRunningTime="2026-06-06 20:51:32.556190642 +0000 UTC m=+323.083941799" Jun 06 20:51:32.598822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598722 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.598822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598760 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.598822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598804 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598844 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598867 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598889 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598952 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-586cm\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.598978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.599010 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.599047 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599086 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.599082 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599452 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.599119 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.599452 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.599154 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") pod \"0c80166f-8d7e-4200-8412-b27b31cba0fa\" (UID: \"0c80166f-8d7e-4200-8412-b27b31cba0fa\") " Jun 06 20:51:32.602082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.601717 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume" (OuterVolumeSpecName: "config-volume") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.602082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.601987 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out" (OuterVolumeSpecName: "config-out") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:51:32.602082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602032 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:32.602082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602056 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.602372 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602255 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:32.602372 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602264 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:51:32.602582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602560 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.602981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.602746 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:32.603969 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.603943 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.604513 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.604484 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm" (OuterVolumeSpecName: "kube-api-access-586cm") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "kube-api-access-586cm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:32.604964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.604936 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.607519 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.607501 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.614107 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.614081 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config" (OuterVolumeSpecName: "web-config") pod "0c80166f-8d7e-4200-8412-b27b31cba0fa" (UID: "0c80166f-8d7e-4200-8412-b27b31cba0fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:32.700782 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700740 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-metrics-client-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.700782 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700776 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-main-db\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.700782 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700786 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-main-tls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700796 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-volume\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700804 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-tls-assets\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700812 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c80166f-8d7e-4200-8412-b27b31cba0fa-config-out\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700819 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-cluster-tls-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700829 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-web-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700838 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c80166f-8d7e-4200-8412-b27b31cba0fa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700847 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-586cm\" (UniqueName: \"kubernetes.io/projected/0c80166f-8d7e-4200-8412-b27b31cba0fa-kube-api-access-586cm\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700857 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700866 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:32.701021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:32.700875 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c80166f-8d7e-4200-8412-b27b31cba0fa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:33.335894 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335853 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" exitCode=0 Jun 06 20:51:33.335894 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335885 2555 generic.go:356] "Generic (PLEG): container finished" podID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerID="ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" exitCode=0 Jun 06 20:51:33.336357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335893 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297"} Jun 06 20:51:33.336357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335947 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.336357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335966 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0"} Jun 06 20:51:33.336357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.335993 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c80166f-8d7e-4200-8412-b27b31cba0fa","Type":"ContainerDied","Data":"5df44096c450df1a84fdfc129c9d7798cfbe79c146af2d1ebea66b6e3af8c60a"} Jun 06 20:51:33.336357 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.336023 2555 scope.go:117] "RemoveContainer" containerID="b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" Jun 06 20:51:33.344507 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.344257 2555 scope.go:117] "RemoveContainer" containerID="9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" Jun 06 20:51:33.351742 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.351723 2555 scope.go:117] "RemoveContainer" containerID="5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" Jun 06 20:51:33.359231 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.359202 2555 scope.go:117] "RemoveContainer" containerID="ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" Jun 06 20:51:33.361058 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.361032 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:33.365942 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.365908 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:33.371725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.371701 2555 scope.go:117] "RemoveContainer" containerID="48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" Jun 06 20:51:33.380032 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.380011 2555 scope.go:117] "RemoveContainer" containerID="f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" Jun 06 20:51:33.389770 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.389552 2555 scope.go:117] "RemoveContainer" containerID="23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3" Jun 06 20:51:33.391152 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391126 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:33.391493 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391479 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="init-config-reloader" Jun 06 20:51:33.391548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391495 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="init-config-reloader" Jun 06 20:51:33.391548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391510 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-metric" Jun 06 20:51:33.391548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391518 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-metric" Jun 06 20:51:33.391548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391539 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="config-reloader" Jun 06 20:51:33.391548 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391546 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="config-reloader" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391554 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="alertmanager" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391559 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="alertmanager" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391569 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391574 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391581 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="prom-label-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391587 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="prom-label-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391596 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-web" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391603 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-web" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391657 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-metric" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391666 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391672 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="alertmanager" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391681 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="kube-rbac-proxy-web" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391690 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="prom-label-proxy" Jun 06 20:51:33.391699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.391698 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" containerName="config-reloader" Jun 06 20:51:33.398759 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.398728 2555 scope.go:117] "RemoveContainer" containerID="b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" Jun 06 20:51:33.398878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.398851 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.399582 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.399357 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2\": container with ID starting with b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2 not found: ID does not exist" containerID="b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" Jun 06 20:51:33.399582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.399400 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2"} err="failed to get container status \"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2\": rpc error: code = NotFound desc = could not find container \"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2\": container with ID starting with b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2 not found: ID does not exist" Jun 06 20:51:33.399582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.399543 2555 scope.go:117] "RemoveContainer" containerID="9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" Jun 06 20:51:33.399899 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.399856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:33.399984 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.399926 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297\": container with ID starting with 9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297 not found: ID does not exist" containerID="9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" Jun 06 20:51:33.399984 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.399951 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297"} err="failed to get container status \"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297\": rpc error: code = NotFound desc = could not find container \"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297\": container with ID starting with 9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297 not found: ID does not exist" Jun 06 20:51:33.399984 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.399971 2555 scope.go:117] "RemoveContainer" containerID="5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" Jun 06 20:51:33.400227 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.400208 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673\": container with ID starting with 5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673 not found: ID does not exist" containerID="5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" Jun 06 20:51:33.400283 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400232 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673"} err="failed to get container status \"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673\": rpc error: code = NotFound desc = could not find container \"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673\": container with ID starting with 5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673 not found: ID does not exist" Jun 06 20:51:33.400283 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400248 2555 scope.go:117] "RemoveContainer" containerID="ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" Jun 06 20:51:33.400586 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.400563 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0\": container with ID starting with ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0 not found: ID does not exist" containerID="ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" Jun 06 20:51:33.400668 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400597 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0"} err="failed to get container status \"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0\": rpc error: code = NotFound desc = could not find container \"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0\": container with ID starting with ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0 not found: ID does not exist" Jun 06 20:51:33.400668 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400618 2555 scope.go:117] "RemoveContainer" containerID="48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" Jun 06 20:51:33.400851 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.400828 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503\": container with ID starting with 48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503 not found: ID does not exist" containerID="48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" Jun 06 20:51:33.400930 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400860 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503"} err="failed to get container status \"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503\": rpc error: code = NotFound desc = could not find container \"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503\": container with ID starting with 48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503 not found: ID does not exist" Jun 06 20:51:33.400930 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.400885 2555 scope.go:117] "RemoveContainer" containerID="f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" Jun 06 20:51:33.401210 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.401175 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb\": container with ID starting with f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb not found: ID does not exist" containerID="f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" Jun 06 20:51:33.401320 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401209 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb"} err="failed to get container status \"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb\": rpc error: code = NotFound desc = could not find container \"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb\": container with ID starting with f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb not found: ID does not exist" Jun 06 20:51:33.401320 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401230 2555 scope.go:117] "RemoveContainer" containerID="23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3" Jun 06 20:51:33.401532 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401487 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nzbrc\"" Jun 06 20:51:33.401532 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:51:33.401519 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3\": container with ID starting with 23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3 not found: ID does not exist" containerID="23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3" Jun 06 20:51:33.401666 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401544 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3"} err="failed to get container status \"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3\": rpc error: code = NotFound desc = could not find container \"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3\": container with ID starting with 23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3 not found: ID does not exist" Jun 06 20:51:33.401666 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401565 2555 scope.go:117] "RemoveContainer" containerID="b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2" Jun 06 20:51:33.401790 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 20:51:33.401842 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401815 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 20:51:33.401898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401841 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2"} err="failed to get container status \"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2\": rpc error: code = NotFound desc = could not find container \"b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2\": container with ID starting with b610820808c59a8eab5f3e7b5c78d48d54346ee6859ece0f91748ba5570d72f2 not found: ID does not exist" Jun 06 20:51:33.401898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401862 2555 scope.go:117] "RemoveContainer" containerID="9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297" Jun 06 20:51:33.401898 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401864 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 20:51:33.402051 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401815 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 20:51:33.402051 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401960 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 20:51:33.402051 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.401918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 20:51:33.402188 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402069 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 20:51:33.402188 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402101 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297"} err="failed to get container status \"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297\": rpc error: code = NotFound desc = could not find container \"9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297\": container with ID starting with 9613c23ae7a829042b2f6dea901f54a270978eaa4f062d2eaab8f06beaee5297 not found: ID does not exist" Jun 06 20:51:33.402188 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402126 2555 scope.go:117] "RemoveContainer" containerID="5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673" Jun 06 20:51:33.402188 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402126 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 20:51:33.402461 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402404 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673"} err="failed to get container status \"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673\": rpc error: code = NotFound desc = could not find container \"5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673\": container with ID starting with 5b9765a37034a1a7451f4d1bfdb460c76132fee08a837083d22fc5b06269d673 not found: ID does not exist" Jun 06 20:51:33.402461 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402435 2555 scope.go:117] "RemoveContainer" containerID="ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0" Jun 06 20:51:33.402725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402705 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0"} err="failed to get container status \"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0\": rpc error: code = NotFound desc = could not find container \"ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0\": container with ID starting with ccb60c60e9ea3479d66807b23b06b1f917d589dc704982c0071dd4eefb1c63b0 not found: ID does not exist" Jun 06 20:51:33.402725 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402724 2555 scope.go:117] "RemoveContainer" containerID="48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503" Jun 06 20:51:33.402977 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402958 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503"} err="failed to get container status \"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503\": rpc error: code = NotFound desc = could not find container \"48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503\": container with ID starting with 48a30904094f408bfd0b1a95fe19dcd0a4c4214be7afa6a0ed9a5fb02857f503 not found: ID does not exist" Jun 06 20:51:33.403048 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.402978 2555 scope.go:117] "RemoveContainer" containerID="f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb" Jun 06 20:51:33.403209 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.403187 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb"} err="failed to get container status \"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb\": rpc error: code = NotFound desc = could not find container \"f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb\": container with ID starting with f6340acf525a36308fb6b1f8f6a18bc5afa70d28a0999ac6f7718da4cb633aeb not found: ID does not exist" Jun 06 20:51:33.403209 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.403206 2555 scope.go:117] "RemoveContainer" containerID="23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3" Jun 06 20:51:33.403451 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.403402 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3"} err="failed to get container status \"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3\": rpc error: code = NotFound desc = could not find container \"23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3\": container with ID starting with 23435fb9a5a8da891d0de6b777f8df3b7d1c4311484535bd30d969f79fcd12c3 not found: ID does not exist" Jun 06 20:51:33.408264 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.408242 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 20:51:33.409936 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.409916 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:33.506740 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.506705 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:33.509308 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-web-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509393 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509455 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509565 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-config-out\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509616 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz2hb\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-kube-api-access-qz2hb\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509765 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.509765 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.509649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611061 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.610975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611061 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611061 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-config-out\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611120 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz2hb\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-kube-api-access-qz2hb\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611145 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611175 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611289 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611331 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611828 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-web-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611828 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611828 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.611988 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.611937 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.612450 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.612403 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6489331-320c-499c-aba6-1f0c041dbf66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.614336 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.614286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.614336 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.614277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.614717 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.614695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.614932 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.614907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.614932 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.614922 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.615184 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.615165 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-web-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.615311 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.615285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.615639 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.615620 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6489331-320c-499c-aba6-1f0c041dbf66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.615734 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.615714 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6489331-320c-499c-aba6-1f0c041dbf66-config-out\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.619807 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.619779 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz2hb\" (UniqueName: \"kubernetes.io/projected/f6489331-320c-499c-aba6-1f0c041dbf66-kube-api-access-qz2hb\") pod \"alertmanager-main-0\" (UID: \"f6489331-320c-499c-aba6-1f0c041dbf66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.711186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.711142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:51:33.859137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.859111 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:51:33.860883 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:51:33.860846 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6489331_320c_499c_aba6_1f0c041dbf66.slice/crio-6bcff00187ca70b965257269351e33e944e002d213a567f8b7e9bc892319ff68 WatchSource:0}: Error finding container 6bcff00187ca70b965257269351e33e944e002d213a567f8b7e9bc892319ff68: Status 404 returned error can't find the container with id 6bcff00187ca70b965257269351e33e944e002d213a567f8b7e9bc892319ff68 Jun 06 20:51:33.980856 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:33.980822 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c80166f-8d7e-4200-8412-b27b31cba0fa" path="/var/lib/kubelet/pods/0c80166f-8d7e-4200-8412-b27b31cba0fa/volumes" Jun 06 20:51:34.343736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:34.343699 2555 generic.go:356] "Generic (PLEG): container finished" podID="f6489331-320c-499c-aba6-1f0c041dbf66" containerID="5f1fcb5076ff0ccb2382bc2524f750431cffb9f0da4c032880972508c67b0146" exitCode=0 Jun 06 20:51:34.344119 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:34.343767 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerDied","Data":"5f1fcb5076ff0ccb2382bc2524f750431cffb9f0da4c032880972508c67b0146"} Jun 06 20:51:34.344119 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:34.343818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"6bcff00187ca70b965257269351e33e944e002d213a567f8b7e9bc892319ff68"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.353974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"62599d7364ac401e6422ec07f08893f7c8ec61f19254389f00f482d94234545a"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.354066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"0e3b9d912fa98c1723b2789671b202e26498cb89774cfa2e13f83f8af48ecc49"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.354105 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"89318f49e84f43204b6afa6f34f53658aba1e06c7aff73a0eeb3ecaa18c76a79"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.354144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"9212858afb5133448ad703200df471ccae4365275e90a8db40c4d361292c46a6"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.354178 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"590303ba2560271be00c5c338df17be995533ccee974a1f76cd586ae0d0683ab"} Jun 06 20:51:35.355463 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.354215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6489331-320c-499c-aba6-1f0c041dbf66","Type":"ContainerStarted","Data":"617caee81638c9e1ddcd3cc70fd2e9010dc84533cedf9a19ab38fc7ce9fe7511"} Jun 06 20:51:35.384995 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.384934 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.365960316 podStartE2EDuration="2.384915454s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.955138ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:51:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:51:35.382959026 +0000 UTC m=+325.910710181" watchObservedRunningTime="2026-06-06 20:51:35.384915454 +0000 UTC m=+325.912666608" Jun 06 20:51:35.691253 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.691161 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:35.792054 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:35.792006 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:40.464894 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:40.464849 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:40.465359 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:40.464920 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:40.469772 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:40.469751 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:41.390889 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:41.390856 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:51:41.436435 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:41.436383 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:51:41.525883 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:41.525833 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:41.578237 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:41.578201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:41.632730 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:41.632699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:42.265736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.265664 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d858f55cf-zcwws" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" containerID="cri-o://bc7ff242ba8e77b74c490fce5656b680f3664b329553201a995e8678ddc6f048" gracePeriod=15 Jun 06 20:51:42.393837 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.393804 2555 generic.go:356] "Generic (PLEG): container finished" podID="90829777-0e81-4ef1-9906-15460c9e8f78" containerID="bc7ff242ba8e77b74c490fce5656b680f3664b329553201a995e8678ddc6f048" exitCode=0 Jun 06 20:51:42.393981 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.393875 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858f55cf-zcwws" event={"ID":"90829777-0e81-4ef1-9906-15460c9e8f78","Type":"ContainerDied","Data":"bc7ff242ba8e77b74c490fce5656b680f3664b329553201a995e8678ddc6f048"} Jun 06 20:51:42.530458 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.530372 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:51:42.698113 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698069 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698113 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698127 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698164 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4qwd\" (UniqueName: \"kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698281 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698378 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698363 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698392 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698571 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698440 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config\") pod \"90829777-0e81-4ef1-9906-15460c9e8f78\" (UID: \"90829777-0e81-4ef1-9906-15460c9e8f78\") " Jun 06 20:51:42.698691 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698671 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:42.698743 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698686 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca" (OuterVolumeSpecName: "service-ca") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:42.698872 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698846 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.698872 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.698866 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-service-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.699046 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.699003 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config" (OuterVolumeSpecName: "console-config") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:42.699171 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.699149 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:42.700464 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.700438 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd" (OuterVolumeSpecName: "kube-api-access-t4qwd") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "kube-api-access-t4qwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:42.700613 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.700591 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:42.700659 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.700606 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90829777-0e81-4ef1-9906-15460c9e8f78" (UID: "90829777-0e81-4ef1-9906-15460c9e8f78"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:42.800328 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.800229 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-oauth-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.800328 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.800269 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90829777-0e81-4ef1-9906-15460c9e8f78-console-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.800328 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.800278 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-oauth-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.800328 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.800287 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90829777-0e81-4ef1-9906-15460c9e8f78-console-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:42.800328 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:42.800296 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4qwd\" (UniqueName: \"kubernetes.io/projected/90829777-0e81-4ef1-9906-15460c9e8f78-kube-api-access-t4qwd\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:43.399448 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.399400 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858f55cf-zcwws" event={"ID":"90829777-0e81-4ef1-9906-15460c9e8f78","Type":"ContainerDied","Data":"539042c5e0e09556bffda572abef335af927c413d4ce48ed95af0a98e5782a01"} Jun 06 20:51:43.399448 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.399447 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858f55cf-zcwws" Jun 06 20:51:43.399699 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.399475 2555 scope.go:117] "RemoveContainer" containerID="bc7ff242ba8e77b74c490fce5656b680f3664b329553201a995e8678ddc6f048" Jun 06 20:51:43.420939 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.420911 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:51:43.424004 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.423982 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d858f55cf-zcwws"] Jun 06 20:51:43.973163 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:43.973129 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" path="/var/lib/kubelet/pods/90829777-0e81-4ef1-9906-15460c9e8f78/volumes" Jun 06 20:51:46.404373 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:46.404326 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:51:56.208473 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.208372 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerName="registry" containerID="cri-o://e523f927780914fd15e83c7880238eb883842da5b1fe5ba029bc1414e023554a" gracePeriod=30 Jun 06 20:51:56.462164 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.462079 2555 generic.go:356] "Generic (PLEG): container finished" podID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerID="e523f927780914fd15e83c7880238eb883842da5b1fe5ba029bc1414e023554a" exitCode=0 Jun 06 20:51:56.462294 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.462161 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" event={"ID":"f2f963c2-113b-47eb-aa89-b4992d0fc45a","Type":"ContainerDied","Data":"e523f927780914fd15e83c7880238eb883842da5b1fe5ba029bc1414e023554a"} Jun 06 20:51:56.462294 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.462209 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" event={"ID":"f2f963c2-113b-47eb-aa89-b4992d0fc45a","Type":"ContainerDied","Data":"248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5"} Jun 06 20:51:56.462294 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.462223 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="248894cc6d595afae752506d1689f6855f77851ab13d39178189dd955e6c6aa5" Jun 06 20:51:56.467686 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.467664 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:51:56.621271 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621233 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621285 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621314 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621347 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621375 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621393 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621486 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621459 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621812 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621605 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwgn\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn\") pod \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\" (UID: \"f2f963c2-113b-47eb-aa89-b4992d0fc45a\") " Jun 06 20:51:56.621914 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621885 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:56.621980 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.621895 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:56.624119 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.624086 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:56.624244 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.624185 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:56.624244 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.624203 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn" (OuterVolumeSpecName: "kube-api-access-6xwgn") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "kube-api-access-6xwgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:56.624244 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.624221 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:56.624391 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.624262 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:56.631212 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.631181 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f2f963c2-113b-47eb-aa89-b4992d0fc45a" (UID: "f2f963c2-113b-47eb-aa89-b4992d0fc45a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:51:56.722823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722789 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwgn\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-kube-api-access-6xwgn\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.722823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722824 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-installation-pull-secrets\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722838 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-trusted-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722850 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-certificates\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722861 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-bound-sa-token\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722874 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2f963c2-113b-47eb-aa89-b4992d0fc45a-image-registry-private-configuration\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722886 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2f963c2-113b-47eb-aa89-b4992d0fc45a-registry-tls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:56.723028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:56.722900 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2f963c2-113b-47eb-aa89-b4992d0fc45a-ca-trust-extracted\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:51:57.466244 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:57.466211 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfdff76f-fvgm2" Jun 06 20:51:57.486788 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:57.486753 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:51:57.490726 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:57.490702 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64bfdff76f-fvgm2"] Jun 06 20:51:57.973112 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:51:57.973080 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" path="/var/lib/kubelet/pods/f2f963c2-113b-47eb-aa89-b4992d0fc45a/volumes" Jun 06 20:52:06.459864 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.459800 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5669cff986-n5fkz" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" containerID="cri-o://8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955" gracePeriod=15 Jun 06 20:52:06.705990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.705957 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:52:06.810879 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.810843 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.810902 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.810919 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.810945 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc4x7\" (UniqueName: \"kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811004 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811041 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811293 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811088 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config\") pod \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\" (UID: \"834428dd-8c5c-45e9-bc4c-06663ddbcd55\") " Jun 06 20:52:06.811368 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811340 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:52:06.811458 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811438 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:52:06.811518 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811454 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca" (OuterVolumeSpecName: "service-ca") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:52:06.811579 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.811553 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config" (OuterVolumeSpecName: "console-config") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:52:06.813340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.813315 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7" (OuterVolumeSpecName: "kube-api-access-qc4x7") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "kube-api-access-qc4x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:52:06.813340 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.813324 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:52:06.813478 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.813367 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "834428dd-8c5c-45e9-bc4c-06663ddbcd55" (UID: "834428dd-8c5c-45e9-bc4c-06663ddbcd55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:52:06.911823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911768 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc4x7\" (UniqueName: \"kubernetes.io/projected/834428dd-8c5c-45e9-bc4c-06663ddbcd55-kube-api-access-qc4x7\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.911823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911814 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.911823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911824 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.911823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911834 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834428dd-8c5c-45e9-bc4c-06663ddbcd55-console-oauth-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.911823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911842 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.912128 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911851 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-oauth-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:06.912128 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:06.911859 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834428dd-8c5c-45e9-bc4c-06663ddbcd55-service-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:52:07.511173 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.511139 2555 generic.go:356] "Generic (PLEG): container finished" podID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerID="8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955" exitCode=0 Jun 06 20:52:07.511647 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.511186 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669cff986-n5fkz" Jun 06 20:52:07.511647 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.511229 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669cff986-n5fkz" event={"ID":"834428dd-8c5c-45e9-bc4c-06663ddbcd55","Type":"ContainerDied","Data":"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955"} Jun 06 20:52:07.511647 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.511289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669cff986-n5fkz" event={"ID":"834428dd-8c5c-45e9-bc4c-06663ddbcd55","Type":"ContainerDied","Data":"c34de813e04a93ebe1e098ae0448ac4f37d4b8313c946ca6ce6ca5569e43c637"} Jun 06 20:52:07.511647 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.511323 2555 scope.go:117] "RemoveContainer" containerID="8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955" Jun 06 20:52:07.520396 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.520379 2555 scope.go:117] "RemoveContainer" containerID="8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955" Jun 06 20:52:07.520675 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:52:07.520656 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955\": container with ID starting with 8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955 not found: ID does not exist" containerID="8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955" Jun 06 20:52:07.520712 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.520683 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955"} err="failed to get container status \"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955\": rpc error: code = NotFound desc = could not find container \"8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955\": container with ID starting with 8fd786a73d6c8d8f9d033d822b8547d52b5b1839fb52ece2ebb5a560d1f8b955 not found: ID does not exist" Jun 06 20:52:07.531719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.531693 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:52:07.537449 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.537408 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5669cff986-n5fkz"] Jun 06 20:52:07.977301 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:07.977266 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" path="/var/lib/kubelet/pods/834428dd-8c5c-45e9-bc4c-06663ddbcd55/volumes" Jun 06 20:52:36.226324 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:36.226285 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:52:36.282252 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:52:36.282210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:53:40.269382 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:53:40.269299 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:54:33.854955 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:54:33.854904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:23.255638 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:23.255592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:23.306658 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:23.306627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:25.404979 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:25.404945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:25.454295 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:25.454256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:42.806487 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806454 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845b84d97c-bl548"] Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806797 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806810 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806834 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806843 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806849 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerName="registry" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806855 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerName="registry" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806910 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f963c2-113b-47eb-aa89-b4992d0fc45a" containerName="registry" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806917 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="834428dd-8c5c-45e9-bc4c-06663ddbcd55" containerName="console" Jun 06 20:55:42.806958 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.806926 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="90829777-0e81-4ef1-9906-15460c9e8f78" containerName="console" Jun 06 20:55:42.810106 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.810083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.836674 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.836636 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b84d97c-bl548"] Jun 06 20:55:42.860619 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.860565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:42.907500 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.907470 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:42.937966 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.937940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.937973 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.937995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-service-ca\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.938017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-oauth-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.938038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dljkj\" (UniqueName: \"kubernetes.io/projected/21554051-8eb7-45d9-aa4c-a544a6d5c85c-kube-api-access-dljkj\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.938056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-oauth-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:42.938081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:42.938072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-trusted-ca-bundle\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038667 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038676 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-service-ca\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-oauth-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dljkj\" (UniqueName: \"kubernetes.io/projected/21554051-8eb7-45d9-aa4c-a544a6d5c85c-kube-api-access-dljkj\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-oauth-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.038860 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.038826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-trusted-ca-bundle\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.039530 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.039483 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.039530 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.039517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-oauth-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.039696 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.039526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-service-ca\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.039791 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.039773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21554051-8eb7-45d9-aa4c-a544a6d5c85c-trusted-ca-bundle\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.041240 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.041219 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-serving-cert\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.041240 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.041231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21554051-8eb7-45d9-aa4c-a544a6d5c85c-console-oauth-config\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.047361 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.047339 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dljkj\" (UniqueName: \"kubernetes.io/projected/21554051-8eb7-45d9-aa4c-a544a6d5c85c-kube-api-access-dljkj\") pod \"console-845b84d97c-bl548\" (UID: \"21554051-8eb7-45d9-aa4c-a544a6d5c85c\") " pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.118996 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.118928 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:43.248028 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.247998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b84d97c-bl548"] Jun 06 20:55:43.250910 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:55:43.250883 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21554051_8eb7_45d9_aa4c_a544a6d5c85c.slice/crio-64aee3703826ab6fcbbf07faec3f52686da1f8c7198ef34c3e72b9fac6aeca1d WatchSource:0}: Error finding container 64aee3703826ab6fcbbf07faec3f52686da1f8c7198ef34c3e72b9fac6aeca1d: Status 404 returned error can't find the container with id 64aee3703826ab6fcbbf07faec3f52686da1f8c7198ef34c3e72b9fac6aeca1d Jun 06 20:55:43.374405 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.374320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b84d97c-bl548" event={"ID":"21554051-8eb7-45d9-aa4c-a544a6d5c85c","Type":"ContainerStarted","Data":"0d91fe5c01d18b361bfcf82762bc32e990af35201fda712b13635f7e3b7956fe"} Jun 06 20:55:43.374405 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.374380 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b84d97c-bl548" event={"ID":"21554051-8eb7-45d9-aa4c-a544a6d5c85c","Type":"ContainerStarted","Data":"64aee3703826ab6fcbbf07faec3f52686da1f8c7198ef34c3e72b9fac6aeca1d"} Jun 06 20:55:43.392615 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:43.392567 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845b84d97c-bl548" podStartSLOduration=1.392552324 podStartE2EDuration="1.392552324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:55:43.391534395 +0000 UTC m=+573.919285549" watchObservedRunningTime="2026-06-06 20:55:43.392552324 +0000 UTC m=+573.920303478" Jun 06 20:55:48.393546 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:48.393514 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:48.494630 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:48.494595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:48.595800 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:48.595755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:53.119515 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.119406 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:53.119515 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.119503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:53.124240 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.124218 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:53.416658 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.416583 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845b84d97c-bl548" Jun 06 20:55:53.459402 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.459370 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:55:53.550702 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.550672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:53.600189 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.600151 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:55:53.656964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:55:53.656934 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:03.020757 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:03.020721 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:06.366431 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:06.366373 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:06.454884 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:06.454852 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:09.933382 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:09.933357 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:56:09.933871 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:09.933362 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 20:56:09.937409 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:09.937382 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:56:09.937894 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:09.937871 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 20:56:18.483458 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.483386 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-694c5c46d-mmkl9" podUID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" containerName="console" containerID="cri-o://5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076" gracePeriod=15 Jun 06 20:56:18.727021 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.726995 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:56:18.750790 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750719 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.750790 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750761 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.750990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750797 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjzkk\" (UniqueName: \"kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.750990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750825 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.750990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750851 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.750990 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.750972 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.751179 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751036 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert\") pod \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\" (UID: \"17db85a4-ec19-46f5-bb79-0d5afd7538fd\") " Jun 06 20:56:18.751236 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751112 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:56:18.751291 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751272 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config" (OuterVolumeSpecName: "console-config") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:56:18.751363 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751344 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-oauth-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.751439 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751368 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.751675 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751570 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:56:18.751813 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.751726 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:56:18.753408 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.753378 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:56:18.753408 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.753383 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk" (OuterVolumeSpecName: "kube-api-access-wjzkk") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "kube-api-access-wjzkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:56:18.753578 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.753561 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17db85a4-ec19-46f5-bb79-0d5afd7538fd" (UID: "17db85a4-ec19-46f5-bb79-0d5afd7538fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:56:18.852007 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.851974 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-serving-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.852007 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.852002 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17db85a4-ec19-46f5-bb79-0d5afd7538fd-console-oauth-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.852007 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.852011 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjzkk\" (UniqueName: \"kubernetes.io/projected/17db85a4-ec19-46f5-bb79-0d5afd7538fd-kube-api-access-wjzkk\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.852221 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.852019 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:18.852221 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:18.852028 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17db85a4-ec19-46f5-bb79-0d5afd7538fd-service-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 20:56:19.517044 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.517006 2555 generic.go:356] "Generic (PLEG): container finished" podID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" containerID="5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076" exitCode=0 Jun 06 20:56:19.517529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.517056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694c5c46d-mmkl9" event={"ID":"17db85a4-ec19-46f5-bb79-0d5afd7538fd","Type":"ContainerDied","Data":"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076"} Jun 06 20:56:19.517529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.517089 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694c5c46d-mmkl9" event={"ID":"17db85a4-ec19-46f5-bb79-0d5afd7538fd","Type":"ContainerDied","Data":"157419a04c6895988169758cb4fa366d888650435c1600dcf786f611b7328a14"} Jun 06 20:56:19.517529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.517108 2555 scope.go:117] "RemoveContainer" containerID="5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076" Jun 06 20:56:19.517529 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.517058 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694c5c46d-mmkl9" Jun 06 20:56:19.525584 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.525565 2555 scope.go:117] "RemoveContainer" containerID="5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076" Jun 06 20:56:19.525822 ip-10-0-133-247 kubenswrapper[2555]: E0606 20:56:19.525802 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076\": container with ID starting with 5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076 not found: ID does not exist" containerID="5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076" Jun 06 20:56:19.525882 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.525835 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076"} err="failed to get container status \"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076\": rpc error: code = NotFound desc = could not find container \"5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076\": container with ID starting with 5ae7c9827ddcca999ba326cdfb75916a622e74466be880eb99c16c494ddcd076 not found: ID does not exist" Jun 06 20:56:19.538778 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.538750 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:56:19.542878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.542856 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-694c5c46d-mmkl9"] Jun 06 20:56:19.972901 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:19.972876 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" path="/var/lib/kubelet/pods/17db85a4-ec19-46f5-bb79-0d5afd7538fd/volumes" Jun 06 20:56:27.952262 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:27.952174 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:29.091976 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.091945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:29.975355 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.975322 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x"] Jun 06 20:56:29.975659 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.975646 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" containerName="console" Jun 06 20:56:29.975712 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.975661 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" containerName="console" Jun 06 20:56:29.975746 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.975712 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="17db85a4-ec19-46f5-bb79-0d5afd7538fd" containerName="console" Jun 06 20:56:29.980281 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.980245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:29.983783 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.983760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:56:29.983783 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.983762 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 06 20:56:29.983933 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.983792 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xmlts\"" Jun 06 20:56:29.992868 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:29.992847 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x"] Jun 06 20:56:30.046336 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.046307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6k9b\" (UniqueName: \"kubernetes.io/projected/6ebf7534-b73f-4347-8c41-34a12e7115eb-kube-api-access-h6k9b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.046336 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.046341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebf7534-b73f-4347-8c41-34a12e7115eb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.146918 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.146877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6k9b\" (UniqueName: \"kubernetes.io/projected/6ebf7534-b73f-4347-8c41-34a12e7115eb-kube-api-access-h6k9b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.147304 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.146931 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebf7534-b73f-4347-8c41-34a12e7115eb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.147364 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.147343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ebf7534-b73f-4347-8c41-34a12e7115eb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.155702 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.155678 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6k9b\" (UniqueName: \"kubernetes.io/projected/6ebf7534-b73f-4347-8c41-34a12e7115eb-kube-api-access-h6k9b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mbq2x\" (UID: \"6ebf7534-b73f-4347-8c41-34a12e7115eb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.290451 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.290358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" Jun 06 20:56:30.420077 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.419957 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x"] Jun 06 20:56:30.423180 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:56:30.423150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebf7534_b73f_4347_8c41_34a12e7115eb.slice/crio-3c3afab01e45119021a22dc0f2ae11e2fb5772c10f0e3a0f6f6d1cb1711f19c4 WatchSource:0}: Error finding container 3c3afab01e45119021a22dc0f2ae11e2fb5772c10f0e3a0f6f6d1cb1711f19c4: Status 404 returned error can't find the container with id 3c3afab01e45119021a22dc0f2ae11e2fb5772c10f0e3a0f6f6d1cb1711f19c4 Jun 06 20:56:30.426355 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.426332 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:56:30.562991 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:30.562899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" event={"ID":"6ebf7534-b73f-4347-8c41-34a12e7115eb","Type":"ContainerStarted","Data":"3c3afab01e45119021a22dc0f2ae11e2fb5772c10f0e3a0f6f6d1cb1711f19c4"} Jun 06 20:56:31.593407 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:31.593355 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:31.693388 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:31.693293 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:33.579856 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:33.579816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" event={"ID":"6ebf7534-b73f-4347-8c41-34a12e7115eb","Type":"ContainerStarted","Data":"1215eca5d8c10ee5917b43a32116551b784e889b4575ed654ce2789a1365d09d"} Jun 06 20:56:33.601474 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:33.601387 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mbq2x" podStartSLOduration=2.073099751 podStartE2EDuration="4.601368685s" totalImagesPullingTime="2.528268934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:56:33.601158582 +0000 UTC m=+624.128909737" watchObservedRunningTime="2026-06-06 20:56:33.601368685 +0000 UTC m=+624.129119841" Jun 06 20:56:33.694068 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:33.694025 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:33.799837 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:33.799796 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:34.016010 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:34.015976 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:34.116031 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:34.115998 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:35.993710 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:35.993669 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7"] Jun 06 20:56:35.997255 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:35.997232 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:35.999736 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:35.999715 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 20:56:35.999861 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:35.999764 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 20:56:36.000749 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.000729 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mpckv\"" Jun 06 20:56:36.006986 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.006964 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7"] Jun 06 20:56:36.100174 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.100141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.100346 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.100202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdgl\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-kube-api-access-bmdgl\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.201524 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.201489 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdgl\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-kube-api-access-bmdgl\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.201702 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.201539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.210782 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.210751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.210897 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.210879 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdgl\" (UniqueName: \"kubernetes.io/projected/7a8264d0-36dc-4b12-835b-4c74890ee51a-kube-api-access-bmdgl\") pod \"cert-manager-webhook-7dc76cbb94-jhzf7\" (UID: \"7a8264d0-36dc-4b12-835b-4c74890ee51a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.325788 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.325703 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:36.450788 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.450764 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7"] Jun 06 20:56:36.453200 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:56:36.453165 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a8264d0_36dc_4b12_835b_4c74890ee51a.slice/crio-400f1808d94a90995496d8fe5c1b5ff9aa39e930827e03797da5e8bed39a5507 WatchSource:0}: Error finding container 400f1808d94a90995496d8fe5c1b5ff9aa39e930827e03797da5e8bed39a5507: Status 404 returned error can't find the container with id 400f1808d94a90995496d8fe5c1b5ff9aa39e930827e03797da5e8bed39a5507 Jun 06 20:56:36.594144 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:36.594066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" event={"ID":"7a8264d0-36dc-4b12-835b-4c74890ee51a","Type":"ContainerStarted","Data":"400f1808d94a90995496d8fe5c1b5ff9aa39e930827e03797da5e8bed39a5507"} Jun 06 20:56:37.008520 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:37.008479 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:37.603239 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:37.603202 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:38.548367 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:38.548331 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:38.648843 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:38.648807 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:39.196347 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.196318 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg"] Jun 06 20:56:39.199371 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.199352 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.201912 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.201891 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hvnr2\"" Jun 06 20:56:39.209850 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.209829 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg"] Jun 06 20:56:39.330775 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.330742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfj6\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-kube-api-access-ldfj6\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.330943 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.330823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.432213 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.432170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.432408 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.432269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfj6\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-kube-api-access-ldfj6\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.440468 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.440445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.440576 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.440535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfj6\" (UniqueName: \"kubernetes.io/projected/8b1bdce1-185c-4c68-9402-68bda17561a4-kube-api-access-ldfj6\") pod \"cert-manager-cainjector-5d99449ffd-zmmrg\" (UID: \"8b1bdce1-185c-4c68-9402-68bda17561a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.508943 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.508911 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" Jun 06 20:56:39.614723 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.614691 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" event={"ID":"7a8264d0-36dc-4b12-835b-4c74890ee51a","Type":"ContainerStarted","Data":"7380c9ad4456acfec0d1f7be1823c6a9cd98f775ef002f58d3e97a87f61e6194"} Jun 06 20:56:39.615151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.614808 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:39.647633 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.647514 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" podStartSLOduration=1.865965071 podStartE2EDuration="4.647493325s" totalImagesPullingTime="2.781528254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:56:39.646690148 +0000 UTC m=+630.174441302" watchObservedRunningTime="2026-06-06 20:56:39.647493325 +0000 UTC m=+630.175244478" Jun 06 20:56:39.651059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:39.651028 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg"] Jun 06 20:56:39.653876 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:56:39.653849 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b1bdce1_185c_4c68_9402_68bda17561a4.slice/crio-7a54b52f1d177afd440c64c04b993aa15bfa9e946d31281228ff5ad5e00db8a9 WatchSource:0}: Error finding container 7a54b52f1d177afd440c64c04b993aa15bfa9e946d31281228ff5ad5e00db8a9: Status 404 returned error can't find the container with id 7a54b52f1d177afd440c64c04b993aa15bfa9e946d31281228ff5ad5e00db8a9 Jun 06 20:56:40.620746 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:40.620702 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" event={"ID":"8b1bdce1-185c-4c68-9402-68bda17561a4","Type":"ContainerStarted","Data":"c3879a7c960e6eaddd59a8e5dfeded06289afeadfc1fb0e379d82158d897f0b3"} Jun 06 20:56:40.621221 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:40.620756 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" event={"ID":"8b1bdce1-185c-4c68-9402-68bda17561a4","Type":"ContainerStarted","Data":"7a54b52f1d177afd440c64c04b993aa15bfa9e946d31281228ff5ad5e00db8a9"} Jun 06 20:56:40.635564 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:40.635515 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zmmrg" podStartSLOduration=1.635500805 podStartE2EDuration="1.635500805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:56:40.63501096 +0000 UTC m=+631.162762115" watchObservedRunningTime="2026-06-06 20:56:40.635500805 +0000 UTC m=+631.163251958" Jun 06 20:56:45.394302 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:45.394264 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:45.555983 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:45.555954 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:45.622828 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:45.622796 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jhzf7" Jun 06 20:56:45.642456 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:45.642410 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:46.255740 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.255702 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-4nkkg"] Jun 06 20:56:46.259181 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.259163 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.261924 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.261897 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p92d7\"" Jun 06 20:56:46.270014 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.269987 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-4nkkg"] Jun 06 20:56:46.396863 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.396827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-bound-sa-token\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.396863 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.396872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnz7\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-kube-api-access-9fnz7\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.497920 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.497885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnz7\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-kube-api-access-9fnz7\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.498043 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.497985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-bound-sa-token\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.505902 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.505843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-bound-sa-token\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.506065 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.506043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnz7\" (UniqueName: \"kubernetes.io/projected/8a570fa0-faa6-4deb-aa41-0f0c4ecfa268-kube-api-access-9fnz7\") pod \"cert-manager-59c77684cc-4nkkg\" (UID: \"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268\") " pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.574413 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.574387 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-4nkkg" Jun 06 20:56:46.709434 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:46.709393 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-4nkkg"] Jun 06 20:56:46.712863 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:56:46.712821 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a570fa0_faa6_4deb_aa41_0f0c4ecfa268.slice/crio-28d153975a8021bc26a5c280aa3b67d51570b39c098730d1505cd604877f73ea WatchSource:0}: Error finding container 28d153975a8021bc26a5c280aa3b67d51570b39c098730d1505cd604877f73ea: Status 404 returned error can't find the container with id 28d153975a8021bc26a5c280aa3b67d51570b39c098730d1505cd604877f73ea Jun 06 20:56:47.653863 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:47.653823 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-4nkkg" event={"ID":"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268","Type":"ContainerStarted","Data":"4f5bff7d54fa0b107812c17cb81ac26d06efba5721f6052da12207e10da9df21"} Jun 06 20:56:47.654245 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:47.653872 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-4nkkg" event={"ID":"8a570fa0-faa6-4deb-aa41-0f0c4ecfa268","Type":"ContainerStarted","Data":"28d153975a8021bc26a5c280aa3b67d51570b39c098730d1505cd604877f73ea"} Jun 06 20:56:47.668649 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:47.668581 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-4nkkg" podStartSLOduration=1.668565975 podStartE2EDuration="1.668565975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:56:47.667773626 +0000 UTC m=+638.195524792" watchObservedRunningTime="2026-06-06 20:56:47.668565975 +0000 UTC m=+638.196317120" Jun 06 20:56:50.994258 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:50.994220 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:51.091524 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:51.091494 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:56:52.993049 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:56:52.993014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:04.022439 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:04.022380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:04.074439 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:04.074393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:07.009202 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:07.009163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:07.105186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:07.105150 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:07.776533 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:07.776499 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.015311 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.015271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.106352 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.106266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.132109 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.132077 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn"] Jun 06 20:57:08.138224 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.138201 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.140717 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.140693 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 20:57:08.140811 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.140725 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 20:57:08.140811 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.140697 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 20:57:08.141038 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.141025 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-48mzl\"" Jun 06 20:57:08.141102 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.141087 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 20:57:08.154190 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.154161 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn"] Jun 06 20:57:08.180020 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.179986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.180401 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.180032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.180401 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.180051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.180401 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.180069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.180401 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.180096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg96d\" (UniqueName: \"kubernetes.io/projected/b6c594ea-7eb1-486d-9b01-831699ed005e-kube-api-access-cg96d\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.230170 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.230134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.280939 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.280898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.280939 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.280940 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.281160 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.280974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.281160 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.281028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg96d\" (UniqueName: \"kubernetes.io/projected/b6c594ea-7eb1-486d-9b01-831699ed005e-kube-api-access-cg96d\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.281160 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.281116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.281540 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.281513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.283336 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.283307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c594ea-7eb1-486d-9b01-831699ed005e-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.283498 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.283477 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.283633 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.283615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c594ea-7eb1-486d-9b01-831699ed005e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.290059 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.290031 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg96d\" (UniqueName: \"kubernetes.io/projected/b6c594ea-7eb1-486d-9b01-831699ed005e-kube-api-access-cg96d\") pod \"opendatahub-operator-controller-manager-d755ddb6c-mhnhn\" (UID: \"b6c594ea-7eb1-486d-9b01-831699ed005e\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.332152 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.332114 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.426484 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.426378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.449377 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.449348 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:08.527316 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.527282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.594005 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.593980 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn"] Jun 06 20:57:08.596936 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:57:08.596909 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c594ea_7eb1_486d_9b01_831699ed005e.slice/crio-39e3dea8848f1c1c795dc6e75e017eda175050c24b3a05df8f01168ad9a2d48b WatchSource:0}: Error finding container 39e3dea8848f1c1c795dc6e75e017eda175050c24b3a05df8f01168ad9a2d48b: Status 404 returned error can't find the container with id 39e3dea8848f1c1c795dc6e75e017eda175050c24b3a05df8f01168ad9a2d48b Jun 06 20:57:08.599186 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.599143 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:08.756178 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:08.756144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" event={"ID":"b6c594ea-7eb1-486d-9b01-831699ed005e","Type":"ContainerStarted","Data":"39e3dea8848f1c1c795dc6e75e017eda175050c24b3a05df8f01168ad9a2d48b"} Jun 06 20:57:09.954137 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:09.954097 2555 scope.go:117] "RemoveContainer" containerID="e523f927780914fd15e83c7880238eb883842da5b1fe5ba029bc1414e023554a" Jun 06 20:57:11.772964 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:11.772923 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" event={"ID":"b6c594ea-7eb1-486d-9b01-831699ed005e","Type":"ContainerStarted","Data":"189139b3ab56b11ce30e783e0ce626be36ba82d225d01aa188ec164a6464e96b"} Jun 06 20:57:12.779052 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:12.779012 2555 generic.go:356] "Generic (PLEG): container finished" podID="b6c594ea-7eb1-486d-9b01-831699ed005e" containerID="189139b3ab56b11ce30e783e0ce626be36ba82d225d01aa188ec164a6464e96b" exitCode=0 Jun 06 20:57:12.779499 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:12.779083 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" event={"ID":"b6c594ea-7eb1-486d-9b01-831699ed005e","Type":"ContainerDied","Data":"189139b3ab56b11ce30e783e0ce626be36ba82d225d01aa188ec164a6464e96b"} Jun 06 20:57:13.252556 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:13.252510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:13.347346 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:13.347307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:13.785599 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:13.785558 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" event={"ID":"b6c594ea-7eb1-486d-9b01-831699ed005e","Type":"ContainerStarted","Data":"c42cf43fe1d6841f4eb8deadae0e94e206994f87539ec17005d4e5062b3edd8a"} Jun 06 20:57:13.786011 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:13.785703 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:13.809329 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:13.809277 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" podStartSLOduration=1.61370227 podStartE2EDuration="5.809263964s" totalImagesPullingTime="3.224231296s" totalInitContainerRuntime="971.330398ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:13.808407404 +0000 UTC m=+664.336158559" watchObservedRunningTime="2026-06-06 20:57:13.809263964 +0000 UTC m=+664.337015119" Jun 06 20:57:24.791589 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:24.791558 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-mhnhn" Jun 06 20:57:25.146333 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.146243 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:25.199349 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.199316 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:25.678024 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.677989 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8"] Jun 06 20:57:25.685752 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.685734 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.689579 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689554 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:57:25.689719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689597 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 20:57:25.689719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689555 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 20:57:25.689719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689554 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 20:57:25.689719 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689557 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xt4k6\"" Jun 06 20:57:25.689944 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.689739 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 20:57:25.692703 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.692680 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8"] Jun 06 20:57:25.741822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.741785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.741994 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.741837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7t5\" (UniqueName: \"kubernetes.io/projected/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-kube-api-access-ms7t5\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.741994 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.741904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-manager-config\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.741994 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.741953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.843315 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.843285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7t5\" (UniqueName: \"kubernetes.io/projected/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-kube-api-access-ms7t5\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.843822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.843322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-manager-config\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.843822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.843350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.843822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.843527 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.844162 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.844139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-manager-config\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.845822 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.845803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.845909 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.845853 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.850681 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.850660 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7t5\" (UniqueName: \"kubernetes.io/projected/e13f4f32-1d5c-4599-a586-8c4dd5f7f993-kube-api-access-ms7t5\") pod \"lws-controller-manager-68d9b98c67-n9gc8\" (UID: \"e13f4f32-1d5c-4599-a586-8c4dd5f7f993\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:25.996094 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:25.996060 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:26.137635 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:26.137609 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8"] Jun 06 20:57:26.141040 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:57:26.141014 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13f4f32_1d5c_4599_a586_8c4dd5f7f993.slice/crio-7c5e923f7cf08d2229fa8cc86443e7fbd531c30d65a8032db15365190d2e5c79 WatchSource:0}: Error finding container 7c5e923f7cf08d2229fa8cc86443e7fbd531c30d65a8032db15365190d2e5c79: Status 404 returned error can't find the container with id 7c5e923f7cf08d2229fa8cc86443e7fbd531c30d65a8032db15365190d2e5c79 Jun 06 20:57:26.847242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:26.847208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" event={"ID":"e13f4f32-1d5c-4599-a586-8c4dd5f7f993","Type":"ContainerStarted","Data":"7c5e923f7cf08d2229fa8cc86443e7fbd531c30d65a8032db15365190d2e5c79"} Jun 06 20:57:27.178977 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.178881 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:27.308376 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.308269 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:27.508892 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.508851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:27.625151 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.625109 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:27.797659 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.797563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:27.961613 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.961580 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2"] Jun 06 20:57:27.970955 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.970924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:27.973953 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.973899 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 20:57:27.973953 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.973918 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 20:57:27.973953 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.973924 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 20:57:27.974919 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.974897 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 20:57:27.975043 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.974942 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d8xbs\"" Jun 06 20:57:27.981279 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:27.981251 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2"] Jun 06 20:57:28.036939 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.036893 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:28.066081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.065993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddff439-c968-4505-b897-ccc1ec947853-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.066081 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.066051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985lg\" (UniqueName: \"kubernetes.io/projected/7ddff439-c968-4505-b897-ccc1ec947853-kube-api-access-985lg\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.066303 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.066142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ddff439-c968-4505-b897-ccc1ec947853-tmp\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.167410 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.167372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ddff439-c968-4505-b897-ccc1ec947853-tmp\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.167605 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.167516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddff439-c968-4505-b897-ccc1ec947853-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.167605 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.167557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985lg\" (UniqueName: \"kubernetes.io/projected/7ddff439-c968-4505-b897-ccc1ec947853-kube-api-access-985lg\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.170002 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.169970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ddff439-c968-4505-b897-ccc1ec947853-tmp\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.170327 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.170300 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddff439-c968-4505-b897-ccc1ec947853-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.176460 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.176406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-985lg\" (UniqueName: \"kubernetes.io/projected/7ddff439-c968-4505-b897-ccc1ec947853-kube-api-access-985lg\") pod \"kube-auth-proxy-ccf7fd987-d8kc2\" (UID: \"7ddff439-c968-4505-b897-ccc1ec947853\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.197680 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.197637 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:28.285282 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.285250 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" Jun 06 20:57:28.311587 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.311500 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:28.419878 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.419769 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:28.807088 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.806982 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:28.891642 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.890020 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2"] Jun 06 20:57:28.895211 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:57:28.895172 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddff439_c968_4505_b897_ccc1ec947853.slice/crio-c49dc0c0db7338be35d546db0cd6d51dcb4a6124bb17850a2d2d6dc56659454e WatchSource:0}: Error finding container c49dc0c0db7338be35d546db0cd6d51dcb4a6124bb17850a2d2d6dc56659454e: Status 404 returned error can't find the container with id c49dc0c0db7338be35d546db0cd6d51dcb4a6124bb17850a2d2d6dc56659454e Jun 06 20:57:28.934823 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:28.934785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:29.868655 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:29.868585 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" event={"ID":"e13f4f32-1d5c-4599-a586-8c4dd5f7f993","Type":"ContainerStarted","Data":"3f8824a8f069fc655928690b4bd19e4fb6786a0b92e12cee9dd324b0e919b016"} Jun 06 20:57:29.869091 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:29.868750 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:29.870140 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:29.870115 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" event={"ID":"7ddff439-c968-4505-b897-ccc1ec947853","Type":"ContainerStarted","Data":"c49dc0c0db7338be35d546db0cd6d51dcb4a6124bb17850a2d2d6dc56659454e"} Jun 06 20:57:29.885048 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:29.884995 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" podStartSLOduration=2.218160917 podStartE2EDuration="4.884974847s" totalImagesPullingTime="2.66681393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:29.884285495 +0000 UTC m=+680.412036651" watchObservedRunningTime="2026-06-06 20:57:29.884974847 +0000 UTC m=+680.412726003" Jun 06 20:57:31.881817 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:31.881783 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" event={"ID":"7ddff439-c968-4505-b897-ccc1ec947853","Type":"ContainerStarted","Data":"8506e0a1d971aa2c954d24b581f7fdc83d051a4771b88548ebdfe79cfdf6a120"} Jun 06 20:57:31.897300 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:31.897249 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-d8kc2" podStartSLOduration=2.489469515 podStartE2EDuration="4.897232119s" totalImagesPullingTime="2.407762604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:31.896457882 +0000 UTC m=+682.424209035" watchObservedRunningTime="2026-06-06 20:57:31.897232119 +0000 UTC m=+682.424983251" Jun 06 20:57:37.226242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:37.226197 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:37.318803 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:37.318765 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:37.415090 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:37.415052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:37.567126 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:37.567037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:37.723044 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:37.718300 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:40.878626 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:40.878587 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-n9gc8" Jun 06 20:57:43.911006 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:43.910963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:44.010805 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:44.010744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:45.043054 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:45.043011 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:45.140830 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:45.140792 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:45.585578 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:45.585525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:45.685963 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:45.685905 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:46.202694 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:46.202659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:56.270731 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:56.270630 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:56.356754 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:56.356714 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:56.467060 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:56.467018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:56.574324 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:56.574229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:56.881350 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:56.881241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:57:59.977857 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:57:59.977822 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.078521 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:00.078492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.284681 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:00.284603 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.416033 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:00.415983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.550884 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:00.550797 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:04.279932 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:04.279895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:28.768826 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:28.768792 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:28.825759 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:28.825720 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:28.933677 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:28.933629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:57.130329 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:57.130289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:57.728239 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:58:57.728202 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:02.544124 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:02.544085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:04.606684 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:04.606645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:04.719276 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:04.719238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:05.544104 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:05.544060 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:06.373582 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:06.373541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:08.536323 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:08.536286 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:09.006569 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:09.006526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:12.227319 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:12.227280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:14.145858 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:14.145820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:14.247872 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:14.247831 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:14.554844 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:14.554813 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:14.659687 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:14.659621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:17.939667 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:17.939623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:17.992968 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:17.992927 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:20.194032 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.194000 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf"] Jun 06 20:59:20.197287 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.197266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.199639 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.199614 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 06 20:59:20.199874 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.199859 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 20:59:20.200769 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.200747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gcflb\"" Jun 06 20:59:20.200840 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.200785 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 06 20:59:20.200908 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.200790 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 20:59:20.205447 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.205414 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf"] Jun 06 20:59:20.208005 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.207982 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:20.305337 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.305306 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:20.328750 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.328717 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qgf\" (UniqueName: \"kubernetes.io/projected/a6ce0f59-0cb4-4002-abcd-59ab8a216866-kube-api-access-22qgf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.328972 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.328779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ce0f59-0cb4-4002-abcd-59ab8a216866-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.328972 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.328859 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6ce0f59-0cb4-4002-abcd-59ab8a216866-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.430289 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.430257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ce0f59-0cb4-4002-abcd-59ab8a216866-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.430505 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.430296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6ce0f59-0cb4-4002-abcd-59ab8a216866-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.430505 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.430355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qgf\" (UniqueName: \"kubernetes.io/projected/a6ce0f59-0cb4-4002-abcd-59ab8a216866-kube-api-access-22qgf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.431036 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.431014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6ce0f59-0cb4-4002-abcd-59ab8a216866-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.432673 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.432654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ce0f59-0cb4-4002-abcd-59ab8a216866-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.439393 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.439371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qgf\" (UniqueName: \"kubernetes.io/projected/a6ce0f59-0cb4-4002-abcd-59ab8a216866-kube-api-access-22qgf\") pod \"kuadrant-console-plugin-66b5774985-z8ptf\" (UID: \"a6ce0f59-0cb4-4002-abcd-59ab8a216866\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.507643 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.507610 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" Jun 06 20:59:20.639320 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:20.639245 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf"] Jun 06 20:59:20.642022 ip-10-0-133-247 kubenswrapper[2555]: W0606 20:59:20.641995 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6ce0f59_0cb4_4002_abcd_59ab8a216866.slice/crio-763df133b79e9e879f357380d958ae36fc0d43fba9ba8fa34a43878261dad484 WatchSource:0}: Error finding container 763df133b79e9e879f357380d958ae36fc0d43fba9ba8fa34a43878261dad484: Status 404 returned error can't find the container with id 763df133b79e9e879f357380d958ae36fc0d43fba9ba8fa34a43878261dad484 Jun 06 20:59:21.413807 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:21.413765 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" event={"ID":"a6ce0f59-0cb4-4002-abcd-59ab8a216866","Type":"ContainerStarted","Data":"763df133b79e9e879f357380d958ae36fc0d43fba9ba8fa34a43878261dad484"} Jun 06 20:59:22.143944 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:22.143904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:22.247516 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:22.247480 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:25.327317 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:25.327266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:25.418537 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:25.418497 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:25.556082 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:25.556015 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:33.126499 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:33.126400 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:33.226683 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:33.226636 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:33.531010 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:33.530971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:33.638239 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:33.638201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:36.120010 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:36.119968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:36.219412 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:36.219373 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:41.322344 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:41.322306 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:41.423762 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:41.423723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:42.531670 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:42.531638 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" event={"ID":"a6ce0f59-0cb4-4002-abcd-59ab8a216866","Type":"ContainerStarted","Data":"5826f78db94a996a71398dec7df13cdcd3af6c5d687f6ae0887a4e47de1ccec7"} Jun 06 20:59:42.548242 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:42.548194 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z8ptf" podStartSLOduration=1.288732543 podStartE2EDuration="22.548178388s" totalImagesPullingTime="21.259445845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:42.547108553 +0000 UTC m=+813.074859707" watchObservedRunningTime="2026-06-06 20:59:42.548178388 +0000 UTC m=+813.075929542" Jun 06 20:59:44.729657 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:44.729620 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:44.835567 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:44.835535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:47.798318 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:47.798274 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:59.586968 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:59.583833 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:59.684120 ip-10-0-133-247 kubenswrapper[2555]: I0606 20:59:59.684082 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:01.721965 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:01.721913 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:03.201120 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:03.201081 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:16.062562 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.062519 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:16.161582 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.161551 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:16.213992 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.213953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:16.450874 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.450793 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:00:16.520223 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.520186 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:00:16.520223 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.520232 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:00:16.520454 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.520303 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.522855 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.522835 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 21:00:16.643358 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.643320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/310a2189-d983-4efa-a3ec-8ef9825f9ef2-config-file\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.643559 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.643370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzmv\" (UniqueName: \"kubernetes.io/projected/310a2189-d983-4efa-a3ec-8ef9825f9ef2-kube-api-access-vkzmv\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.744267 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.744234 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/310a2189-d983-4efa-a3ec-8ef9825f9ef2-config-file\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.744444 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.744276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzmv\" (UniqueName: \"kubernetes.io/projected/310a2189-d983-4efa-a3ec-8ef9825f9ef2-kube-api-access-vkzmv\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.744998 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.744979 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/310a2189-d983-4efa-a3ec-8ef9825f9ef2-config-file\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.752982 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.752959 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzmv\" (UniqueName: \"kubernetes.io/projected/310a2189-d983-4efa-a3ec-8ef9825f9ef2-kube-api-access-vkzmv\") pod \"limitador-limitador-54d6d988d5-pn6rs\" (UID: \"310a2189-d983-4efa-a3ec-8ef9825f9ef2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.830107 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.830072 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:16.857148 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.857122 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:16.860803 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.860780 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:16.863589 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.863570 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8tf5s\"" Jun 06 21:00:16.870141 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.870108 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:16.888180 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.888142 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:16.946153 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.946123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6qls\" (UniqueName: \"kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls\") pod \"authorino-58cd955675-svk48\" (UID: \"b0a7a2a0-0af5-409f-a965-d7aaf247a163\") " pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:16.962507 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.962436 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:00:16.965070 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:00:16.965041 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310a2189_d983_4efa_a3ec_8ef9825f9ef2.slice/crio-1f7332e0b66eb797d386fd74244c808bd2c37258441bbbe794de8abb8ceb81ee WatchSource:0}: Error finding container 1f7332e0b66eb797d386fd74244c808bd2c37258441bbbe794de8abb8ceb81ee: Status 404 returned error can't find the container with id 1f7332e0b66eb797d386fd74244c808bd2c37258441bbbe794de8abb8ceb81ee Jun 06 21:00:16.965759 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:16.965673 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:17.047169 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.047082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6qls\" (UniqueName: \"kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls\") pod \"authorino-58cd955675-svk48\" (UID: \"b0a7a2a0-0af5-409f-a965-d7aaf247a163\") " pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:17.055971 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.055943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6qls\" (UniqueName: \"kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls\") pod \"authorino-58cd955675-svk48\" (UID: \"b0a7a2a0-0af5-409f-a965-d7aaf247a163\") " pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:17.171899 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.171870 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:17.298889 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.298843 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:17.301014 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:00:17.300987 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0a7a2a0_0af5_409f_a965_d7aaf247a163.slice/crio-d97f5e6430b651492857b4fc7fd445269257f8ba3ddf8d331cddb5a55bf86674 WatchSource:0}: Error finding container d97f5e6430b651492857b4fc7fd445269257f8ba3ddf8d331cddb5a55bf86674: Status 404 returned error can't find the container with id d97f5e6430b651492857b4fc7fd445269257f8ba3ddf8d331cddb5a55bf86674 Jun 06 21:00:17.704001 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.703914 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-svk48" event={"ID":"b0a7a2a0-0af5-409f-a965-d7aaf247a163","Type":"ContainerStarted","Data":"d97f5e6430b651492857b4fc7fd445269257f8ba3ddf8d331cddb5a55bf86674"} Jun 06 21:00:17.705401 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:17.705371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" event={"ID":"310a2189-d983-4efa-a3ec-8ef9825f9ef2","Type":"ContainerStarted","Data":"1f7332e0b66eb797d386fd74244c808bd2c37258441bbbe794de8abb8ceb81ee"} Jun 06 21:00:20.496752 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:20.496713 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:21.732806 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.732773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" event={"ID":"310a2189-d983-4efa-a3ec-8ef9825f9ef2","Type":"ContainerStarted","Data":"0a1f3fe7c345711ed752671321515d07b7be1247f7e8730eef955b7a6ea10ef4"} Jun 06 21:00:21.733270 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.732869 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:21.734181 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.734159 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-svk48" event={"ID":"b0a7a2a0-0af5-409f-a965-d7aaf247a163","Type":"ContainerStarted","Data":"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371"} Jun 06 21:00:21.734291 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.734210 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-svk48" podUID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" containerName="authorino" containerID="cri-o://b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371" gracePeriod=30 Jun 06 21:00:21.750831 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.750788 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" podStartSLOduration=1.4412931119999999 podStartE2EDuration="5.75077295s" totalImagesPullingTime="4.309479838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:21.7483057 +0000 UTC m=+852.276056855" watchObservedRunningTime="2026-06-06 21:00:21.75077295 +0000 UTC m=+852.278524105" Jun 06 21:00:21.762526 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.762487 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-svk48" podStartSLOduration=1.777630408 podStartE2EDuration="5.762473806s" totalImagesPullingTime="3.984843398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:21.761217533 +0000 UTC m=+852.288968696" watchObservedRunningTime="2026-06-06 21:00:21.762473806 +0000 UTC m=+852.290224994" Jun 06 21:00:21.990202 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:21.990145 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:22.096761 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.096720 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6qls\" (UniqueName: \"kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls\") pod \"b0a7a2a0-0af5-409f-a965-d7aaf247a163\" (UID: \"b0a7a2a0-0af5-409f-a965-d7aaf247a163\") " Jun 06 21:00:22.098887 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.098864 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls" (OuterVolumeSpecName: "kube-api-access-h6qls") pod "b0a7a2a0-0af5-409f-a965-d7aaf247a163" (UID: "b0a7a2a0-0af5-409f-a965-d7aaf247a163"). InnerVolumeSpecName "kube-api-access-h6qls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:00:22.197681 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.197645 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6qls\" (UniqueName: \"kubernetes.io/projected/b0a7a2a0-0af5-409f-a965-d7aaf247a163-kube-api-access-h6qls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:00:22.739501 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.739467 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" containerID="b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371" exitCode=0 Jun 06 21:00:22.739928 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.739505 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-svk48" Jun 06 21:00:22.739928 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.739544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-svk48" event={"ID":"b0a7a2a0-0af5-409f-a965-d7aaf247a163","Type":"ContainerDied","Data":"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371"} Jun 06 21:00:22.739928 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.739583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-svk48" event={"ID":"b0a7a2a0-0af5-409f-a965-d7aaf247a163","Type":"ContainerDied","Data":"d97f5e6430b651492857b4fc7fd445269257f8ba3ddf8d331cddb5a55bf86674"} Jun 06 21:00:22.739928 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.739601 2555 scope.go:117] "RemoveContainer" containerID="b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371" Jun 06 21:00:22.748211 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.748194 2555 scope.go:117] "RemoveContainer" containerID="b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371" Jun 06 21:00:22.748485 ip-10-0-133-247 kubenswrapper[2555]: E0606 21:00:22.748466 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371\": container with ID starting with b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371 not found: ID does not exist" containerID="b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371" Jun 06 21:00:22.748557 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.748493 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371"} err="failed to get container status \"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371\": rpc error: code = NotFound desc = could not find container \"b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371\": container with ID starting with b832af9aeb68a71bbdfb66ab4a29267bf38b5778707b703c8b6821336f07c371 not found: ID does not exist" Jun 06 21:00:22.760692 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.760670 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:22.764909 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.764888 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-svk48"] Jun 06 21:00:22.802122 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.802094 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:22.855182 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:22.855158 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:23.973332 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:23.973302 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" path="/var/lib/kubelet/pods/b0a7a2a0-0af5-409f-a965-d7aaf247a163/volumes" Jun 06 21:00:32.740465 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:32.740434 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pn6rs" Jun 06 21:00:35.019221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:35.019192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:45.825322 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:45.825288 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:45.981335 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:45.981296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:46.081908 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:46.081822 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:46.280663 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:00:46.280629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:09.080863 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.080825 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:09.180004 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.179967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:09.972477 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.972452 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:01:09.973605 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.973577 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:01:09.976780 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.976756 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:01:09.977936 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:09.977915 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:01:38.597989 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.597925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:38.818302 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.818266 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:38.818805 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.818778 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" containerName="authorino" Jun 06 21:01:38.818805 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.818804 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" containerName="authorino" Jun 06 21:01:38.819027 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.818917 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a7a2a0-0af5-409f-a965-d7aaf247a163" containerName="authorino" Jun 06 21:01:38.821789 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.821772 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:38.824096 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.824076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8tf5s\"" Jun 06 21:01:38.828338 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.828314 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:38.862233 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.862148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn28l\" (UniqueName: \"kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l\") pod \"authorino-5d4b67c446-7dg7r\" (UID: \"8ee4769a-1b47-4d98-85bb-10818c021b98\") " pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:38.963512 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.963477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn28l\" (UniqueName: \"kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l\") pod \"authorino-5d4b67c446-7dg7r\" (UID: \"8ee4769a-1b47-4d98-85bb-10818c021b98\") " pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:38.971538 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:38.971513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn28l\" (UniqueName: \"kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l\") pod \"authorino-5d4b67c446-7dg7r\" (UID: \"8ee4769a-1b47-4d98-85bb-10818c021b98\") " pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:39.067460 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.067411 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:39.067680 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.067667 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:39.087797 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.087764 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5986c44b7c-8qvd9"] Jun 06 21:01:39.091909 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.091886 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:39.097775 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.097745 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5986c44b7c-8qvd9"] Jun 06 21:01:39.160041 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.159638 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5986c44b7c-8qvd9"] Jun 06 21:01:39.160041 ip-10-0-133-247 kubenswrapper[2555]: E0606 21:01:39.159988 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bsrgt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5986c44b7c-8qvd9" podUID="e41822b4-d30b-4a90-b1f2-42561ec81e91" Jun 06 21:01:39.164375 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.164345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrgt\" (UniqueName: \"kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt\") pod \"authorino-5986c44b7c-8qvd9\" (UID: \"e41822b4-d30b-4a90-b1f2-42561ec81e91\") " pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:39.189482 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.189450 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:01:39.192866 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.192844 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.195028 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.195007 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 06 21:01:39.199071 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.199048 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:01:39.210396 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.210373 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:39.212393 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:01:39.212364 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ee4769a_1b47_4d98_85bb_10818c021b98.slice/crio-748fc0910900a9a516df722aed18d7fc2cfead76a01e6f13c80c79d57177a199 WatchSource:0}: Error finding container 748fc0910900a9a516df722aed18d7fc2cfead76a01e6f13c80c79d57177a199: Status 404 returned error can't find the container with id 748fc0910900a9a516df722aed18d7fc2cfead76a01e6f13c80c79d57177a199 Jun 06 21:01:39.213919 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.213898 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 21:01:39.265006 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.264973 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mqt\" (UniqueName: \"kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.265182 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.265049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.265182 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.265079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrgt\" (UniqueName: \"kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt\") pod \"authorino-5986c44b7c-8qvd9\" (UID: \"e41822b4-d30b-4a90-b1f2-42561ec81e91\") " pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:39.272895 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.272866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrgt\" (UniqueName: \"kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt\") pod \"authorino-5986c44b7c-8qvd9\" (UID: \"e41822b4-d30b-4a90-b1f2-42561ec81e91\") " pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:39.365524 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.365483 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mqt\" (UniqueName: \"kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.365702 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.365558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.368008 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.367985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.373569 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.373543 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mqt\" (UniqueName: \"kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt\") pod \"authorino-5685c68789-rrbbb\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.503106 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.503073 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:01:39.632742 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.632718 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:01:39.646617 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:01:39.646593 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5348436_aa98_47a2_ba4d_0cdb8772ad4d.slice/crio-8baf8b92610dc1bb2eaba4f7a0a0e93d89af327d850c6e0c775c81d7031ab35a WatchSource:0}: Error finding container 8baf8b92610dc1bb2eaba4f7a0a0e93d89af327d850c6e0c775c81d7031ab35a: Status 404 returned error can't find the container with id 8baf8b92610dc1bb2eaba4f7a0a0e93d89af327d850c6e0c775c81d7031ab35a Jun 06 21:01:39.748647 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:39.748612 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:40.119835 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.119803 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5685c68789-rrbbb" event={"ID":"f5348436-aa98-47a2-ba4d-0cdb8772ad4d","Type":"ContainerStarted","Data":"8baf8b92610dc1bb2eaba4f7a0a0e93d89af327d850c6e0c775c81d7031ab35a"} Jun 06 21:01:40.121273 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.121253 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:40.121369 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.121275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" event={"ID":"8ee4769a-1b47-4d98-85bb-10818c021b98","Type":"ContainerStarted","Data":"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0"} Jun 06 21:01:40.121369 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.121305 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" podUID="8ee4769a-1b47-4d98-85bb-10818c021b98" containerName="authorino" containerID="cri-o://6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0" gracePeriod=30 Jun 06 21:01:40.121369 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.121312 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" event={"ID":"8ee4769a-1b47-4d98-85bb-10818c021b98","Type":"ContainerStarted","Data":"748fc0910900a9a516df722aed18d7fc2cfead76a01e6f13c80c79d57177a199"} Jun 06 21:01:40.129223 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.129203 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:40.149925 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.149878 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" podStartSLOduration=1.75227741 podStartE2EDuration="2.149862679s" totalImagesPullingTime="397.585269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:40.136193691 +0000 UTC m=+930.663944847" watchObservedRunningTime="2026-06-06 21:01:40.149862679 +0000 UTC m=+930.677613847" Jun 06 21:01:40.171809 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.171776 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsrgt\" (UniqueName: \"kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt\") pod \"e41822b4-d30b-4a90-b1f2-42561ec81e91\" (UID: \"e41822b4-d30b-4a90-b1f2-42561ec81e91\") " Jun 06 21:01:40.174122 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.174086 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt" (OuterVolumeSpecName: "kube-api-access-bsrgt") pod "e41822b4-d30b-4a90-b1f2-42561ec81e91" (UID: "e41822b4-d30b-4a90-b1f2-42561ec81e91"). InnerVolumeSpecName "kube-api-access-bsrgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:01:40.273506 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.273463 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsrgt\" (UniqueName: \"kubernetes.io/projected/e41822b4-d30b-4a90-b1f2-42561ec81e91-kube-api-access-bsrgt\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:01:40.356784 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.356757 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:40.475284 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.475247 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn28l\" (UniqueName: \"kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l\") pod \"8ee4769a-1b47-4d98-85bb-10818c021b98\" (UID: \"8ee4769a-1b47-4d98-85bb-10818c021b98\") " Jun 06 21:01:40.477348 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.477320 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l" (OuterVolumeSpecName: "kube-api-access-tn28l") pod "8ee4769a-1b47-4d98-85bb-10818c021b98" (UID: "8ee4769a-1b47-4d98-85bb-10818c021b98"). InnerVolumeSpecName "kube-api-access-tn28l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:01:40.576925 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:40.576884 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn28l\" (UniqueName: \"kubernetes.io/projected/8ee4769a-1b47-4d98-85bb-10818c021b98-kube-api-access-tn28l\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:01:41.128389 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.128347 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5685c68789-rrbbb" event={"ID":"f5348436-aa98-47a2-ba4d-0cdb8772ad4d","Type":"ContainerStarted","Data":"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c"} Jun 06 21:01:41.129599 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129574 2555 generic.go:356] "Generic (PLEG): container finished" podID="8ee4769a-1b47-4d98-85bb-10818c021b98" containerID="6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0" exitCode=0 Jun 06 21:01:41.129709 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129610 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" Jun 06 21:01:41.129709 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129640 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" event={"ID":"8ee4769a-1b47-4d98-85bb-10818c021b98","Type":"ContainerDied","Data":"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0"} Jun 06 21:01:41.129709 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129664 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7dg7r" event={"ID":"8ee4769a-1b47-4d98-85bb-10818c021b98","Type":"ContainerDied","Data":"748fc0910900a9a516df722aed18d7fc2cfead76a01e6f13c80c79d57177a199"} Jun 06 21:01:41.129815 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129796 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5986c44b7c-8qvd9" Jun 06 21:01:41.130475 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.129680 2555 scope.go:117] "RemoveContainer" containerID="6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0" Jun 06 21:01:41.139665 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.139640 2555 scope.go:117] "RemoveContainer" containerID="6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0" Jun 06 21:01:41.139966 ip-10-0-133-247 kubenswrapper[2555]: E0606 21:01:41.139948 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0\": container with ID starting with 6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0 not found: ID does not exist" containerID="6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0" Jun 06 21:01:41.140044 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.139975 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0"} err="failed to get container status \"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0\": rpc error: code = NotFound desc = could not find container \"6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0\": container with ID starting with 6ed4a63d541c399ae86ff1ffc5c88de088c22444ff7e106044345994154324f0 not found: ID does not exist" Jun 06 21:01:41.143557 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.143510 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5685c68789-rrbbb" podStartSLOduration=1.7375254789999999 podStartE2EDuration="2.143496515s" totalImagesPullingTime="405.971036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:41.142754762 +0000 UTC m=+931.670505917" watchObservedRunningTime="2026-06-06 21:01:41.143496515 +0000 UTC m=+931.671247670" Jun 06 21:01:41.160856 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.160819 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:41.167075 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.167024 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7dg7r"] Jun 06 21:01:41.193967 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.193927 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5986c44b7c-8qvd9"] Jun 06 21:01:41.195529 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.195504 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5986c44b7c-8qvd9"] Jun 06 21:01:41.973742 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.973706 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee4769a-1b47-4d98-85bb-10818c021b98" path="/var/lib/kubelet/pods/8ee4769a-1b47-4d98-85bb-10818c021b98/volumes" Jun 06 21:01:41.974066 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:41.974053 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41822b4-d30b-4a90-b1f2-42561ec81e91" path="/var/lib/kubelet/pods/e41822b4-d30b-4a90-b1f2-42561ec81e91/volumes" Jun 06 21:01:44.657389 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:44.657360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:44.757919 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:44.757869 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:44.812900 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:44.812864 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:45.029891 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:45.029859 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:48.099787 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:48.099750 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:48.198644 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:48.198611 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:52.516350 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:52.516318 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:01:52.610373 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:01:52.610336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:02:19.821192 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:02:19.821153 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:02:20.030598 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:02:20.030537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:02:20.226076 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:02:20.226043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:02:20.310343 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:02:20.310304 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:02:20.476157 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:02:20.476073 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:03:07.291587 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.291553 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:03:07.292042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.291910 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee4769a-1b47-4d98-85bb-10818c021b98" containerName="authorino" Jun 06 21:03:07.292042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.291923 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee4769a-1b47-4d98-85bb-10818c021b98" containerName="authorino" Jun 06 21:03:07.292042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.292008 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee4769a-1b47-4d98-85bb-10818c021b98" containerName="authorino" Jun 06 21:03:07.294796 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.294778 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.297252 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.297233 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 06 21:03:07.303432 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.303390 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:03:07.366640 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.366597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzkh\" (UniqueName: \"kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.366825 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.366649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.366825 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.366685 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.467975 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.467934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzkh\" (UniqueName: \"kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.468144 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.467985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.468144 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.468109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.468758 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.468734 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.470412 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.470384 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.476386 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.476362 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzkh\" (UniqueName: \"kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh\") pod \"authorino-69b547c785-86p5c\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.605169 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.605077 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:03:07.647001 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.646951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:07.748965 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:07.748937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:03:07.751704 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:03:07.751673 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f0d35c_7f37_4140_a281_246b688ed3f7.slice/crio-a51fcf6c0849d537f85a3b6d1ca7d115cf0ad0f2bd19f5c1d31684b944c4cffe WatchSource:0}: Error finding container a51fcf6c0849d537f85a3b6d1ca7d115cf0ad0f2bd19f5c1d31684b944c4cffe: Status 404 returned error can't find the container with id a51fcf6c0849d537f85a3b6d1ca7d115cf0ad0f2bd19f5c1d31684b944c4cffe Jun 06 21:03:08.554007 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.553968 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b547c785-86p5c" event={"ID":"d2f0d35c-7f37-4140-a281-246b688ed3f7","Type":"ContainerStarted","Data":"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962"} Jun 06 21:03:08.554007 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.554014 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b547c785-86p5c" event={"ID":"d2f0d35c-7f37-4140-a281-246b688ed3f7","Type":"ContainerStarted","Data":"a51fcf6c0849d537f85a3b6d1ca7d115cf0ad0f2bd19f5c1d31684b944c4cffe"} Jun 06 21:03:08.571825 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.571776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69b547c785-86p5c" podStartSLOduration=1.134704598 podStartE2EDuration="1.571760929s" totalImagesPullingTime="437.056331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:03:08.569875969 +0000 UTC m=+1019.097627137" watchObservedRunningTime="2026-06-06 21:03:08.571760929 +0000 UTC m=+1019.099512110" Jun 06 21:03:08.601240 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.601202 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:03:08.601449 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.601401 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5685c68789-rrbbb" podUID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" containerName="authorino" containerID="cri-o://9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c" gracePeriod=30 Jun 06 21:03:08.856530 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.856505 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:03:08.982673 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.982639 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert\") pod \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " Jun 06 21:03:08.982832 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.982698 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98mqt\" (UniqueName: \"kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt\") pod \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\" (UID: \"f5348436-aa98-47a2-ba4d-0cdb8772ad4d\") " Jun 06 21:03:08.984820 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.984787 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt" (OuterVolumeSpecName: "kube-api-access-98mqt") pod "f5348436-aa98-47a2-ba4d-0cdb8772ad4d" (UID: "f5348436-aa98-47a2-ba4d-0cdb8772ad4d"). InnerVolumeSpecName "kube-api-access-98mqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:03:08.993126 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:08.993093 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f5348436-aa98-47a2-ba4d-0cdb8772ad4d" (UID: "f5348436-aa98-47a2-ba4d-0cdb8772ad4d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 21:03:09.010641 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.010601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:09.084250 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.084216 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-tls-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:03:09.084250 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.084244 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98mqt\" (UniqueName: \"kubernetes.io/projected/f5348436-aa98-47a2-ba4d-0cdb8772ad4d-kube-api-access-98mqt\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:03:09.146014 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.145915 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:09.559737 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.559700 2555 generic.go:356] "Generic (PLEG): container finished" podID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" containerID="9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c" exitCode=0 Jun 06 21:03:09.560171 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.559743 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5685c68789-rrbbb" Jun 06 21:03:09.560171 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.559784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5685c68789-rrbbb" event={"ID":"f5348436-aa98-47a2-ba4d-0cdb8772ad4d","Type":"ContainerDied","Data":"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c"} Jun 06 21:03:09.560171 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.559824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5685c68789-rrbbb" event={"ID":"f5348436-aa98-47a2-ba4d-0cdb8772ad4d","Type":"ContainerDied","Data":"8baf8b92610dc1bb2eaba4f7a0a0e93d89af327d850c6e0c775c81d7031ab35a"} Jun 06 21:03:09.560171 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.559842 2555 scope.go:117] "RemoveContainer" containerID="9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c" Jun 06 21:03:09.570761 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.570737 2555 scope.go:117] "RemoveContainer" containerID="9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c" Jun 06 21:03:09.571164 ip-10-0-133-247 kubenswrapper[2555]: E0606 21:03:09.571142 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c\": container with ID starting with 9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c not found: ID does not exist" containerID="9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c" Jun 06 21:03:09.571243 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.571170 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c"} err="failed to get container status \"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c\": rpc error: code = NotFound desc = could not find container \"9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c\": container with ID starting with 9fbcd58aec656bde563186bfe6a5d430fc5ca22dd14aa4860a64ab4b7dfc122c not found: ID does not exist" Jun 06 21:03:09.582579 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.582544 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:03:09.586221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.586200 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5685c68789-rrbbb"] Jun 06 21:03:09.974041 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:09.974016 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" path="/var/lib/kubelet/pods/f5348436-aa98-47a2-ba4d-0cdb8772ad4d/volumes" Jun 06 21:03:21.614708 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.614670 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp"] Jun 06 21:03:21.615224 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.615074 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" containerName="authorino" Jun 06 21:03:21.615224 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.615091 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" containerName="authorino" Jun 06 21:03:21.615224 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.615175 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5348436-aa98-47a2-ba4d-0cdb8772ad4d" containerName="authorino" Jun 06 21:03:21.619762 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.619735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.622611 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.622570 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 21:03:21.623520 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.623496 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 06 21:03:21.623636 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.623525 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zx5s\"" Jun 06 21:03:21.623636 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.623495 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 21:03:21.629834 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.629810 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp"] Jun 06 21:03:21.658159 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.658123 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:21.698719 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.698719 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.698983 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698798 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a765c680-4203-4319-8c13-97eabf0fa1cb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.698983 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.698983 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.698983 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.698951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zftn\" (UniqueName: \"kubernetes.io/projected/a765c680-4203-4319-8c13-97eabf0fa1cb-kube-api-access-8zftn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.799839 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.799796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zftn\" (UniqueName: \"kubernetes.io/projected/a765c680-4203-4319-8c13-97eabf0fa1cb-kube-api-access-8zftn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800053 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.799863 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800053 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.799941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800053 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a765c680-4203-4319-8c13-97eabf0fa1cb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800230 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800230 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800101 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800482 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800458 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800612 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.800612 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.800552 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.802291 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.802271 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a765c680-4203-4319-8c13-97eabf0fa1cb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.802642 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.802623 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a765c680-4203-4319-8c13-97eabf0fa1cb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.807777 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.807753 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zftn\" (UniqueName: \"kubernetes.io/projected/a765c680-4203-4319-8c13-97eabf0fa1cb-kube-api-access-8zftn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp\" (UID: \"a765c680-4203-4319-8c13-97eabf0fa1cb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.931889 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.931793 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:21.991413 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:21.991379 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:03:22.079925 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:22.079898 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp"] Jun 06 21:03:22.082291 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:03:22.082259 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda765c680_4203_4319_8c13_97eabf0fa1cb.slice/crio-c5f3ab43fab40328f3194d8241d75477f173c23bd17c5e1795b4cc4f8dd1c379 WatchSource:0}: Error finding container c5f3ab43fab40328f3194d8241d75477f173c23bd17c5e1795b4cc4f8dd1c379: Status 404 returned error can't find the container with id c5f3ab43fab40328f3194d8241d75477f173c23bd17c5e1795b4cc4f8dd1c379 Jun 06 21:03:22.626821 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:22.626787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" event={"ID":"a765c680-4203-4319-8c13-97eabf0fa1cb","Type":"ContainerStarted","Data":"c5f3ab43fab40328f3194d8241d75477f173c23bd17c5e1795b4cc4f8dd1c379"} Jun 06 21:03:25.642521 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:25.642413 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" event={"ID":"a765c680-4203-4319-8c13-97eabf0fa1cb","Type":"ContainerStarted","Data":"b05a3d986ee5591f3ef23071e3b8e6788bdda67ad4ec74f8371e0a364871b674"} Jun 06 21:03:30.309365 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:30.309327 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:30.667678 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:30.667588 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:03:33.684181 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:33.684151 2555 generic.go:356] "Generic (PLEG): container finished" podID="a765c680-4203-4319-8c13-97eabf0fa1cb" containerID="b05a3d986ee5591f3ef23071e3b8e6788bdda67ad4ec74f8371e0a364871b674" exitCode=0 Jun 06 21:03:33.684585 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:33.684234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" event={"ID":"a765c680-4203-4319-8c13-97eabf0fa1cb","Type":"ContainerDied","Data":"b05a3d986ee5591f3ef23071e3b8e6788bdda67ad4ec74f8371e0a364871b674"} Jun 06 21:03:35.704728 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:35.704694 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" event={"ID":"a765c680-4203-4319-8c13-97eabf0fa1cb","Type":"ContainerStarted","Data":"32ccb6ebeebfe299370c71121bdf15a8d50cf56a1ab08e3895d86c828c95ed38"} Jun 06 21:03:35.723429 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:35.723363 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" podStartSLOduration=2.224432045 podStartE2EDuration="14.723347114s" totalImagesPullingTime="4.357028644s" totalInitContainerRuntime="8.141886425s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:03:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:03:35.721139673 +0000 UTC m=+1046.248890830" watchObservedRunningTime="2026-06-06 21:03:35.723347114 +0000 UTC m=+1046.251098270" Jun 06 21:03:41.932210 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:41.932161 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:41.932650 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:41.932294 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:41.944839 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:41.944817 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:42.414640 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:42.414607 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:42.751011 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:42.750979 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp" Jun 06 21:03:42.887590 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:42.887547 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:03:55.582115 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.581354 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk"] Jun 06 21:03:55.586231 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.586208 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.588667 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.588643 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 06 21:03:55.594010 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.593989 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk"] Jun 06 21:03:55.610524 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.610492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:03:55.705828 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.705784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2b6q\" (UniqueName: \"kubernetes.io/projected/2861d580-06d5-4160-b8ac-2836c60b5672-kube-api-access-r2b6q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.706021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.705842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.706021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.705885 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.706021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.705924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.706021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.705958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2861d580-06d5-4160-b8ac-2836c60b5672-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.706021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.706001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807304 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807534 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807534 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2861d580-06d5-4160-b8ac-2836c60b5672-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807534 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807534 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2b6q\" (UniqueName: \"kubernetes.io/projected/2861d580-06d5-4160-b8ac-2836c60b5672-kube-api-access-r2b6q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807759 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807565 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807823 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807752 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807823 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.807904 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.807821 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.809754 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.809728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2861d580-06d5-4160-b8ac-2836c60b5672-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.810030 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.810008 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2861d580-06d5-4160-b8ac-2836c60b5672-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.815057 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.815034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2b6q\" (UniqueName: \"kubernetes.io/projected/2861d580-06d5-4160-b8ac-2836c60b5672-kube-api-access-r2b6q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk\" (UID: \"2861d580-06d5-4160-b8ac-2836c60b5672\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:55.898120 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:55.898040 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:03:56.036264 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:56.036235 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk"] Jun 06 21:03:56.038036 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:03:56.038001 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2861d580_06d5_4160_b8ac_2836c60b5672.slice/crio-d0a5dc3f752f1a8a792f74c2e202d3a99b12d868724ac06472c7abbcabaf072a WatchSource:0}: Error finding container d0a5dc3f752f1a8a792f74c2e202d3a99b12d868724ac06472c7abbcabaf072a: Status 404 returned error can't find the container with id d0a5dc3f752f1a8a792f74c2e202d3a99b12d868724ac06472c7abbcabaf072a Jun 06 21:03:56.167157 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:56.167032 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:03:56.808526 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:56.808492 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" event={"ID":"2861d580-06d5-4160-b8ac-2836c60b5672","Type":"ContainerStarted","Data":"3ff07c89e55fea82da6628d96b34c7f820d190abf7f3b484b4c50fd270a28c87"} Jun 06 21:03:56.808973 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:03:56.808544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" event={"ID":"2861d580-06d5-4160-b8ac-2836c60b5672","Type":"ContainerStarted","Data":"d0a5dc3f752f1a8a792f74c2e202d3a99b12d868724ac06472c7abbcabaf072a"} Jun 06 21:04:18.923051 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:18.923012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:04:19.677492 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:19.677450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:04:31.521011 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:31.520974 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:04:32.428698 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:32.428656 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:04:38.369166 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:38.369135 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:04:38.516567 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:04:38.516537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:31.126780 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.126689 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-96996cf6d-pkwlt"] Jun 06 21:05:31.129102 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.129083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.137130 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.137098 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96996cf6d-pkwlt"] Jun 06 21:05:31.169830 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.169788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9bd4e819-fbef-49c0-a30f-4773266ba62a-oidc-ca\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.170014 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.169845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bd4e819-fbef-49c0-a30f-4773266ba62a-tls-cert\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.170014 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.169912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnfh\" (UniqueName: \"kubernetes.io/projected/9bd4e819-fbef-49c0-a30f-4773266ba62a-kube-api-access-fpnfh\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.270613 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.270558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bd4e819-fbef-49c0-a30f-4773266ba62a-tls-cert\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.270806 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.270640 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnfh\" (UniqueName: \"kubernetes.io/projected/9bd4e819-fbef-49c0-a30f-4773266ba62a-kube-api-access-fpnfh\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.270806 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.270703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9bd4e819-fbef-49c0-a30f-4773266ba62a-oidc-ca\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.271294 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.271269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9bd4e819-fbef-49c0-a30f-4773266ba62a-oidc-ca\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.272938 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.272920 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bd4e819-fbef-49c0-a30f-4773266ba62a-tls-cert\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.278335 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.278311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnfh\" (UniqueName: \"kubernetes.io/projected/9bd4e819-fbef-49c0-a30f-4773266ba62a-kube-api-access-fpnfh\") pod \"authorino-96996cf6d-pkwlt\" (UID: \"9bd4e819-fbef-49c0-a30f-4773266ba62a\") " pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.439305 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.439221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96996cf6d-pkwlt" Jun 06 21:05:31.574058 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:31.574034 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96996cf6d-pkwlt"] Jun 06 21:05:31.576303 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:05:31.576272 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bd4e819_fbef_49c0_a30f_4773266ba62a.slice/crio-9ea55f08bda73e32ab9daf745a2d2c019b53a13d2ed94d36cb9068fe2f33f3ac WatchSource:0}: Error finding container 9ea55f08bda73e32ab9daf745a2d2c019b53a13d2ed94d36cb9068fe2f33f3ac: Status 404 returned error can't find the container with id 9ea55f08bda73e32ab9daf745a2d2c019b53a13d2ed94d36cb9068fe2f33f3ac Jun 06 21:05:32.287278 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.287237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96996cf6d-pkwlt" event={"ID":"9bd4e819-fbef-49c0-a30f-4773266ba62a","Type":"ContainerStarted","Data":"8dfcdc6b2272080af2f9347741258f74fb4d1955e7277d6937f4e0f855cb3e08"} Jun 06 21:05:32.287715 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.287293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96996cf6d-pkwlt" event={"ID":"9bd4e819-fbef-49c0-a30f-4773266ba62a","Type":"ContainerStarted","Data":"9ea55f08bda73e32ab9daf745a2d2c019b53a13d2ed94d36cb9068fe2f33f3ac"} Jun 06 21:05:32.305673 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.305607 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-96996cf6d-pkwlt" podStartSLOduration=0.95094922 podStartE2EDuration="1.305582009s" totalImagesPullingTime="354.632789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:05:32.304555015 +0000 UTC m=+1162.832306172" watchObservedRunningTime="2026-06-06 21:05:32.305582009 +0000 UTC m=+1162.833333164" Jun 06 21:05:32.335574 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.335535 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:05:32.335768 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.335732 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-69b547c785-86p5c" podUID="d2f0d35c-7f37-4140-a281-246b688ed3f7" containerName="authorino" containerID="cri-o://ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962" gracePeriod=30 Jun 06 21:05:32.587818 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.587792 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:05:32.684894 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.684849 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert\") pod \"d2f0d35c-7f37-4140-a281-246b688ed3f7\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " Jun 06 21:05:32.685072 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.684907 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hzkh\" (UniqueName: \"kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh\") pod \"d2f0d35c-7f37-4140-a281-246b688ed3f7\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " Jun 06 21:05:32.685072 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.684963 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca\") pod \"d2f0d35c-7f37-4140-a281-246b688ed3f7\" (UID: \"d2f0d35c-7f37-4140-a281-246b688ed3f7\") " Jun 06 21:05:32.687125 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.687083 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh" (OuterVolumeSpecName: "kube-api-access-9hzkh") pod "d2f0d35c-7f37-4140-a281-246b688ed3f7" (UID: "d2f0d35c-7f37-4140-a281-246b688ed3f7"). InnerVolumeSpecName "kube-api-access-9hzkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:05:32.689990 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.689964 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d2f0d35c-7f37-4140-a281-246b688ed3f7" (UID: "d2f0d35c-7f37-4140-a281-246b688ed3f7"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 21:05:32.695570 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.695544 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d2f0d35c-7f37-4140-a281-246b688ed3f7" (UID: "d2f0d35c-7f37-4140-a281-246b688ed3f7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 21:05:32.785904 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.785863 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2f0d35c-7f37-4140-a281-246b688ed3f7-tls-cert\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:05:32.785904 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.785898 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hzkh\" (UniqueName: \"kubernetes.io/projected/d2f0d35c-7f37-4140-a281-246b688ed3f7-kube-api-access-9hzkh\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:05:32.785904 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.785908 2555 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0d35c-7f37-4140-a281-246b688ed3f7-oidc-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 06 21:05:32.967594 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:32.967503 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:33.065501 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.065459 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:33.293907 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.293872 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2f0d35c-7f37-4140-a281-246b688ed3f7" containerID="ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962" exitCode=0 Jun 06 21:05:33.294282 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.293934 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b547c785-86p5c" Jun 06 21:05:33.294282 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.293953 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b547c785-86p5c" event={"ID":"d2f0d35c-7f37-4140-a281-246b688ed3f7","Type":"ContainerDied","Data":"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962"} Jun 06 21:05:33.294282 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.293999 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b547c785-86p5c" event={"ID":"d2f0d35c-7f37-4140-a281-246b688ed3f7","Type":"ContainerDied","Data":"a51fcf6c0849d537f85a3b6d1ca7d115cf0ad0f2bd19f5c1d31684b944c4cffe"} Jun 06 21:05:33.294282 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.294020 2555 scope.go:117] "RemoveContainer" containerID="ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962" Jun 06 21:05:33.303512 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.303486 2555 scope.go:117] "RemoveContainer" containerID="ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962" Jun 06 21:05:33.303797 ip-10-0-133-247 kubenswrapper[2555]: E0606 21:05:33.303775 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962\": container with ID starting with ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962 not found: ID does not exist" containerID="ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962" Jun 06 21:05:33.303855 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.303807 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962"} err="failed to get container status \"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962\": rpc error: code = NotFound desc = could not find container \"ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962\": container with ID starting with ce07e574d899643f8ca7d191ba5fd4e33fb51295ff52f57a022afd01d1257962 not found: ID does not exist" Jun 06 21:05:33.316229 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.316188 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:05:33.322726 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.322691 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69b547c785-86p5c"] Jun 06 21:05:33.973581 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:33.973544 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f0d35c-7f37-4140-a281-246b688ed3f7" path="/var/lib/kubelet/pods/d2f0d35c-7f37-4140-a281-246b688ed3f7/volumes" Jun 06 21:05:34.035367 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:34.035331 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:34.136092 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:34.136054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:45.353439 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:45.353391 2555 generic.go:356] "Generic (PLEG): container finished" podID="2861d580-06d5-4160-b8ac-2836c60b5672" containerID="3ff07c89e55fea82da6628d96b34c7f820d190abf7f3b484b4c50fd270a28c87" exitCode=0 Jun 06 21:05:45.353921 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:45.353470 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" event={"ID":"2861d580-06d5-4160-b8ac-2836c60b5672","Type":"ContainerDied","Data":"3ff07c89e55fea82da6628d96b34c7f820d190abf7f3b484b4c50fd270a28c87"} Jun 06 21:05:46.360654 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:46.360621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" event={"ID":"2861d580-06d5-4160-b8ac-2836c60b5672","Type":"ContainerStarted","Data":"24d9fae448998c3395c8ff71d35912ce5daf939b27ccc693b51213f097a4e6f0"} Jun 06 21:05:46.380536 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:46.380488 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" podStartSLOduration=2.930114056 podStartE2EDuration="1m51.3804747s" totalImagesPullingTime="172.077354ms" totalInitContainerRuntime="1m48.27828329s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:05:46.377736207 +0000 UTC m=+1176.905487363" watchObservedRunningTime="2026-06-06 21:05:46.3804747 +0000 UTC m=+1176.908225854" Jun 06 21:05:55.673923 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:55.673888 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:05:55.898774 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:55.898740 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:05:55.899114 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:55.899090 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:05:55.914667 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:55.914634 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:05:56.097873 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:56.097839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:05:56.420891 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:56.420805 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk" Jun 06 21:05:59.268662 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:05:59.268624 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:05.679092 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:05.679049 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:10.002398 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:10.002364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:06:10.005250 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:10.005223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:06:10.006939 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:10.006919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:06:10.009723 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:10.009708 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:06:15.615187 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:15.615149 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:24.876929 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:24.876890 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:34.974755 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:34.974712 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:44.284465 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:44.284411 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:54.474331 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:54.474288 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:06:59.427526 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:06:59.427466 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:00.584037 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:00.583997 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:02.027270 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:02.027238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:03.091470 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:03.091435 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:26.272550 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:26.272508 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:07:29.472524 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:29.472487 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:07:42.894387 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:42.894335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:42.993735 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:42.993696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:51.371220 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:51.371172 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:56.917241 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:56.917198 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:07:57.015869 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:07:57.015832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:05.974056 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:05.974024 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:08:10.269501 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:10.269464 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:21.974401 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:21.974369 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:08:29.042840 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:29.042749 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:29.141935 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:29.141895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:53.012967 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:53.012923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:58.695364 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:58.695324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:58.801291 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:58.801225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:58.895611 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:58.895572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:59.044963 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:59.044924 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:08:59.145848 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:08:59.145784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:00.171125 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:00.171090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:09:15.679042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:15.679005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:15.761325 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:15.761290 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:15.861152 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:15.861100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:17.182628 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:17.182580 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:09:22.415918 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:22.415867 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:22.512629 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:22.512595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:29.530186 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:29.530097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:29.631823 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:29.631791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:29.727586 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:29.727547 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:29.828315 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:29.828223 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:30.989561 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:30.989527 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:09:46.276531 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:46.276492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:46.390786 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:46.390747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:46.490928 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:46.490889 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:47.172084 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:47.172045 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:09:52.207691 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:52.207659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:09:52.259660 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:09:52.259622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:12.588270 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:12.588231 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:12.689743 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:12.689704 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:12.789270 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:12.789211 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:18.358460 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:18.358413 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:18.420231 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:18.420192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:18.482906 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:18.482873 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:18.583862 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:18.583826 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:18.684221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:18.684123 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:24.298219 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:24.298181 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:24.395633 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:24.395595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:10:25.174707 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:25.174669 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:10:28.286118 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:28.286073 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:10:50.482658 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:50.482605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:10:59.870846 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:10:59.870807 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:11:10.032831 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:10.032800 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:11:10.037177 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:10.036923 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:11:10.043781 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:10.043747 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:11:10.048049 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:10.048025 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:11:16.171655 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:16.171602 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:11:24.682234 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:24.682194 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:11:41.879059 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:41.879019 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:11:50.975735 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:11:50.975696 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:12:23.086827 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:12:23.086788 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:12:31.669586 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:12:31.669543 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:12:40.869451 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:12:40.869399 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:12:48.170394 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:12:48.170350 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:12:56.675397 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:12:56.675311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:13:04.766092 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:13:04.766047 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:13:07.576756 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:13:07.576718 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:13:13.770801 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:13:13.770761 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:13:25.468023 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:13:25.467983 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:12.174359 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:12.174321 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:17.269530 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:17.269493 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:24.370008 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:24.369971 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:32.075241 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:32.075152 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:42.485021 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:42.484985 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:50.867367 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:50.867330 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:14:58.285798 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:14:58.285763 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:01.274405 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:01.274364 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:04.565873 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:04.565831 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:15:05.574167 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:05.574131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:15:07.474707 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:07.474666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:16.180897 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:16.180854 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:24.974235 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:24.974196 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:35.077995 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:35.077943 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:42.675395 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:42.675357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:15:52.086335 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:15:52.086290 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:16:00.071617 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:00.071577 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:16:09.370457 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:09.370398 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:16:10.069985 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:10.069953 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:16:10.074610 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:10.074586 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:16:10.075980 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:10.075960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:16:10.080377 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:10.080357 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:16:16.771060 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:16.771020 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:16:26.872212 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:26.872174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:16:34.869129 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:16:34.869090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:18:54.376036 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:18:54.376000 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:18:59.175228 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:18:59.175185 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:19:25.288160 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:19:25.288122 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:19:29.576706 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:19:29.576672 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:19:39.377454 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:19:39.377401 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:19:49.373022 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:19:49.372984 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:19:58.706882 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:19:58.706844 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:08.573437 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:08.573376 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:18.176604 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:18.176565 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:27.371628 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:27.371536 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:37.273918 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:37.273879 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:46.986371 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:46.986329 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:20:56.882822 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:20:56.882776 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:21:00.767242 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:00.767203 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:21:10.101889 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:10.101859 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:21:10.106859 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:10.106823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:21:10.109055 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:10.109027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:21:10.114136 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:10.114114 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:21:29.478395 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:29.478356 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:21:44.751498 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:44.751458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:21:45.709187 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:21:45.709147 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:22:12.676940 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:12.676905 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:22:21.171192 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:21.171155 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:22:25.698287 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:25.698246 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:22:30.068723 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:30.068688 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:22:37.974627 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:37.974591 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:22:47.381972 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:47.381935 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:22:57.478805 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:22:57.478765 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:07.277131 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:07.277092 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:13.675736 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:13.675701 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:23.265927 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:23.265891 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:31.569855 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:31.569760 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:39.240751 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:39.240709 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:23:45.381177 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:45.381129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:23:49.575346 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:23:49.575297 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:07.977789 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:07.977753 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:15.775435 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:15.775385 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:25.174062 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:25.174029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:33.570189 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:33.570151 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:50.579817 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:50.579783 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:24:59.175653 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:24:59.175621 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:08.169211 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:08.169169 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:16.374214 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:16.374174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:25.869324 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:25.869276 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:33.573157 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:33.573118 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:43.974041 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:43.974013 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:25:55.973942 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:25:55.973909 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:06.471050 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:06.471014 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:10.139280 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:10.139253 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:26:10.146166 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:10.146139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:26:10.149894 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:10.149867 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:26:10.154578 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:10.154559 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:26:18.380116 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:18.380081 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:28.872971 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:28.872888 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:35.173095 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:35.173059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:45.376829 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:45.376788 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:26:51.669828 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:26:51.669789 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:27:08.170968 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:08.170929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:27:16.971029 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:16.970995 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:27:24.707860 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:24.707820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:27:25.685331 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:25.685291 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:27:30.068017 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:30.067979 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:27:31.380450 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:31.380398 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:27:54.320106 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:54.320069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:27:55.283843 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:27:55.283802 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:28:07.389046 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:07.388992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:08.570539 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:08.570502 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:28:09.000962 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:09.000934 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:09.104106 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:09.104072 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:09.220486 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:09.220402 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:09.337905 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:09.337799 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:12.378887 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:12.378845 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pn6rs"] Jun 06 21:28:12.566065 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:12.566033 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:15.224483 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:15.224443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:15.417154 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:15.417117 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:15.517109 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:15.517009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:17.234758 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:17.234723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.415042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.415004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.463455 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.463406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.610723 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.610689 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.711673 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.711587 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.810565 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.810535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:21.877247 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:21.877215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:25.003708 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:25.003658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:27.849092 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:27.849051 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:29.054512 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:29.054476 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:29.151887 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:29.151832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:32.238584 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:32.238549 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:34.890260 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:34.890229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:34.990824 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:34.990784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:41.257429 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:41.257399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96996cf6d-pkwlt_9bd4e819-fbef-49c0-a30f-4773266ba62a/authorino/0.log" Jun 06 21:28:49.016267 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:49.016234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-mhnhn_b6c594ea-7eb1-486d-9b01-831699ed005e/copy-manifests/0.log" Jun 06 21:28:49.022016 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:49.021971 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-mhnhn_b6c594ea-7eb1-486d-9b01-831699ed005e/manager/0.log" Jun 06 21:28:50.644598 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:50.644568 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96996cf6d-pkwlt_9bd4e819-fbef-49c0-a30f-4773266ba62a/authorino/0.log" Jun 06 21:28:50.999865 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:50.999840 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z8ptf_a6ce0f59-0cb4-4002-abcd-59ab8a216866/kuadrant-console-plugin/0.log" Jun 06 21:28:51.345256 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:51.345182 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pn6rs_310a2189-d983-4efa-a3ec-8ef9825f9ef2/limitador/0.log" Jun 06 21:28:52.087443 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:52.087398 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:28:53.082822 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:53.082791 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp_a765c680-4203-4319-8c13-97eabf0fa1cb/storage-initializer/0.log" Jun 06 21:28:53.088597 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:53.088579 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5jgqp_a765c680-4203-4319-8c13-97eabf0fa1cb/main/0.log" Jun 06 21:28:53.608884 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:53.608853 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk_2861d580-06d5-4160-b8ac-2836c60b5672/storage-initializer/0.log" Jun 06 21:28:53.615259 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:53.615237 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csjhqk_2861d580-06d5-4160-b8ac-2836c60b5672/main/0.log" Jun 06 21:28:58.635398 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.635365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:58.738701 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.738671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:28:58.784980 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.784948 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnh9t/must-gather-rj2fc"] Jun 06 21:28:58.791440 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.785999 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f0d35c-7f37-4140-a281-246b688ed3f7" containerName="authorino" Jun 06 21:28:58.791440 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.786029 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f0d35c-7f37-4140-a281-246b688ed3f7" containerName="authorino" Jun 06 21:28:58.791440 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.786298 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f0d35c-7f37-4140-a281-246b688ed3f7" containerName="authorino" Jun 06 21:28:58.791440 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.790760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.794180 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.793979 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jnh9t\"/\"default-dockercfg-6728j\"" Jun 06 21:28:58.794180 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.794017 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"kube-root-ca.crt\"" Jun 06 21:28:58.794180 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.794027 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"openshift-service-ca.crt\"" Jun 06 21:28:58.795516 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.795489 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/must-gather-rj2fc"] Jun 06 21:28:58.881656 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.881622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6f637f9d-08fd-48b5-a597-035bb8910210-must-gather-output\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.881836 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.881681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4wj6\" (UniqueName: \"kubernetes.io/projected/6f637f9d-08fd-48b5-a597-035bb8910210-kube-api-access-q4wj6\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.982892 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.982849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6f637f9d-08fd-48b5-a597-035bb8910210-must-gather-output\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.983083 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.982917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4wj6\" (UniqueName: \"kubernetes.io/projected/6f637f9d-08fd-48b5-a597-035bb8910210-kube-api-access-q4wj6\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.983245 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.983223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6f637f9d-08fd-48b5-a597-035bb8910210-must-gather-output\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:58.993292 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:58.993262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4wj6\" (UniqueName: \"kubernetes.io/projected/6f637f9d-08fd-48b5-a597-035bb8910210-kube-api-access-q4wj6\") pod \"must-gather-rj2fc\" (UID: \"6f637f9d-08fd-48b5-a597-035bb8910210\") " pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:59.102228 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:59.102194 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" Jun 06 21:28:59.251582 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:59.251496 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/must-gather-rj2fc"] Jun 06 21:28:59.257970 ip-10-0-133-247 kubenswrapper[2555]: W0606 21:28:59.256532 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f637f9d_08fd_48b5_a597_035bb8910210.slice/crio-8ae31df887a1b1ad65eb800e46b115ed3f7cccd2b7d68d2e7828123ca2b827bd WatchSource:0}: Error finding container 8ae31df887a1b1ad65eb800e46b115ed3f7cccd2b7d68d2e7828123ca2b827bd: Status 404 returned error can't find the container with id 8ae31df887a1b1ad65eb800e46b115ed3f7cccd2b7d68d2e7828123ca2b827bd Jun 06 21:28:59.260814 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:59.260793 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 21:28:59.367011 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:28:59.366974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" event={"ID":"6f637f9d-08fd-48b5-a597-035bb8910210","Type":"ContainerStarted","Data":"8ae31df887a1b1ad65eb800e46b115ed3f7cccd2b7d68d2e7828123ca2b827bd"} Jun 06 21:29:00.375286 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:00.375194 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" event={"ID":"6f637f9d-08fd-48b5-a597-035bb8910210","Type":"ContainerStarted","Data":"759d399016533f559f18bdf209653f5d40a3fa300ded7e42d611136625806158"} Jun 06 21:29:00.375286 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:00.375241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" event={"ID":"6f637f9d-08fd-48b5-a597-035bb8910210","Type":"ContainerStarted","Data":"e221f64b822c02a9a7a8d462f8f72377462a9e8f8a4b1ef9c7b63a562b78f8a6"} Jun 06 21:29:00.390716 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:00.390660 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnh9t/must-gather-rj2fc" podStartSLOduration=1.5502228040000001 podStartE2EDuration="2.390640983s" totalImagesPullingTime="840.418179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:29:00.389855804 +0000 UTC m=+2570.917606961" watchObservedRunningTime="2026-06-06 21:29:00.390640983 +0000 UTC m=+2570.918392137" Jun 06 21:29:01.779813 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:01.779763 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d8mxb_21592303-e9e5-4c36-a0cd-78c9ab9524e0/global-pull-secret-syncer/0.log" Jun 06 21:29:01.891888 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:01.891855 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" Jun 06 21:29:01.998757 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:01.998721 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-247.ec2.internal_0313b76425dedbbdaa2ce42744a43bc4/haproxy/0.log" Jun 06 21:29:06.577209 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:06.577045 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96996cf6d-pkwlt_9bd4e819-fbef-49c0-a30f-4773266ba62a/authorino/0.log" Jun 06 21:29:06.645533 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:06.645504 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z8ptf_a6ce0f59-0cb4-4002-abcd-59ab8a216866/kuadrant-console-plugin/0.log" Jun 06 21:29:06.778043 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:06.778012 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pn6rs_310a2189-d983-4efa-a3ec-8ef9825f9ef2/limitador/0.log" Jun 06 21:29:08.318073 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.318032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qv28n_1ca4f77f-beb0-404f-98c0-cd1146d4b18e/konnectivity-agent/0.log" limit=1024 Jun 06 21:29:08.537593 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.537561 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/alertmanager/0.log" Jun 06 21:29:08.555279 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.555233 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/config-reloader/0.log" Jun 06 21:29:08.575375 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.575295 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/kube-rbac-proxy-web/0.log" Jun 06 21:29:08.594661 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.594630 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/kube-rbac-proxy/0.log" Jun 06 21:29:08.611700 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.611645 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/kube-rbac-proxy-metric/0.log" Jun 06 21:29:08.628687 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.628659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/prom-label-proxy/0.log" Jun 06 21:29:08.644580 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.644543 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6489331-320c-499c-aba6-1f0c041dbf66/init-config-reloader/0.log" Jun 06 21:29:08.705735 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.705701 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-state-metrics/0.log" Jun 06 21:29:08.722221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.722184 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-rbac-proxy-main/0.log" Jun 06 21:29:08.739961 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.739855 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qwm48_651ea8bc-42c3-4717-a2e0-b93298102411/kube-rbac-proxy-self/0.log" Jun 06 21:29:08.764268 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.764238 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7ffbf6cf77-g7nl6_5cd8f068-6a94-4f3d-a9ef-3f8bff57a364/metrics-server/0.log" Jun 06 21:29:08.825136 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.825097 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/node-exporter/0.log" Jun 06 21:29:08.842435 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.842306 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/kube-rbac-proxy/0.log" Jun 06 21:29:08.863645 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:08.863619 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cw2wh_363c95b1-55c4-4fb0-ab88-b15cdb3e98e3/init-textfile/0.log" Jun 06 21:29:09.020321 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.020291 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/kube-rbac-proxy-main/0.log" Jun 06 21:29:09.038553 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.038517 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/kube-rbac-proxy-self/0.log" Jun 06 21:29:09.063046 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.063015 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-h28jg_45174c93-232c-4c94-880e-a48f97275dbc/openshift-state-metrics/0.log" Jun 06 21:29:09.225609 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.225576 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ht7k6_ef89db86-2e2f-4b06-a085-9901c5cf0d06/prometheus-operator/0.log" Jun 06 21:29:09.239679 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.239655 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ht7k6_ef89db86-2e2f-4b06-a085-9901c5cf0d06/kube-rbac-proxy/0.log" Jun 06 21:29:09.262194 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:09.262161 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kkv6p_db6e8abc-d549-4847-a0e9-df50da301441/prometheus-operator-admission-webhook/0.log" Jun 06 21:29:11.958091 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:11.958052 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/1.log" Jun 06 21:29:11.966829 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:11.966797 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4bfk_9d87d741-4114-42cc-afae-75e6e8f12cf4/console-operator/2.log" Jun 06 21:29:12.576183 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:12.576151 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845b84d97c-bl548_21554051-8eb7-45d9-aa4c-a544a6d5c85c/console/0.log" Jun 06 21:29:13.462758 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:13.462673 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-jh2zt_49866fc0-6ee7-47f4-8f1d-6c0a43d76dc5/volume-data-source-validator/0.log" Jun 06 21:29:14.210155 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.210093 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c"] Jun 06 21:29:14.216896 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.216863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.227830 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.227795 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c"] Jun 06 21:29:14.255023 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.254983 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-lib-modules\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.255221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.255055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfb6\" (UniqueName: \"kubernetes.io/projected/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-kube-api-access-jsfb6\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.255221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.255146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-podres\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.255221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.255210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-proc\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.255374 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.255254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-sys\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356287 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-proc\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356497 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-sys\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356497 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-lib-modules\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356497 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356368 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-proc\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356497 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356370 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfb6\" (UniqueName: \"kubernetes.io/projected/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-kube-api-access-jsfb6\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356497 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356457 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-sys\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356746 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-podres\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356746 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356519 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-lib-modules\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.356746 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.356655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-podres\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.365396 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.365362 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfb6\" (UniqueName: \"kubernetes.io/projected/8e6b59ef-b5b4-4bff-afdc-f7f699864dea-kube-api-access-jsfb6\") pod \"perf-node-gather-daemonset-q8l5c\" (UID: \"8e6b59ef-b5b4-4bff-afdc-f7f699864dea\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.531693 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.531652 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:14.628681 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.628639 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdvtj_5dade9e8-8977-459f-8d99-f13617a0b79b/dns/0.log" Jun 06 21:29:14.656110 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.656047 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdvtj_5dade9e8-8977-459f-8d99-f13617a0b79b/kube-rbac-proxy/0.log" Jun 06 21:29:14.699030 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.698983 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c"] Jun 06 21:29:14.781506 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:14.781484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4rsf5_0fe59e50-b461-40b4-8a99-4f08c8e73cdc/dns-node-resolver/0.log" Jun 06 21:29:15.376246 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:15.376222 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvqkq_929b0159-6839-4fdb-b86a-817a3486228f/node-ca/0.log" Jun 06 21:29:15.513042 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:15.513001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" event={"ID":"8e6b59ef-b5b4-4bff-afdc-f7f699864dea","Type":"ContainerStarted","Data":"b6485b75837f66deba5667dba5978ee1e98e314938c5b3ad21c7399af237e0b4"} Jun 06 21:29:15.513221 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:15.513070 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" event={"ID":"8e6b59ef-b5b4-4bff-afdc-f7f699864dea","Type":"ContainerStarted","Data":"fe083f0e4ab4059cd5a0d46797b27777af93dfc84e863ed78fc45c0a9fb8760b"} Jun 06 21:29:15.513947 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:15.513919 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:15.532015 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:15.531953 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" podStartSLOduration=1.531933853 podStartE2EDuration="1.531933853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 21:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:29:15.530052814 +0000 UTC m=+2586.057803982" watchObservedRunningTime="2026-06-06 21:29:15.531933853 +0000 UTC m=+2586.059685009" Jun 06 21:29:16.407141 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:16.407117 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:29:17.227029 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.226975 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxbwn_5e3e53f1-5dbf-4388-b5c1-61598ad415c7/serve-healthcheck-canary/0.log" Jun 06 21:29:17.695054 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.694947 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-zxdzz_2deea783-5dd3-47f6-8a5b-91edc5758641/insights-operator/0.log" Jun 06 21:29:17.697489 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.697464 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-zxdzz_2deea783-5dd3-47f6-8a5b-91edc5758641/insights-operator/1.log" Jun 06 21:29:17.824376 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.824344 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgrbg_3d7be57c-f31c-453f-8975-0a63a42daa16/kube-rbac-proxy/0.log" Jun 06 21:29:17.839968 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.839937 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgrbg_3d7be57c-f31c-453f-8975-0a63a42daa16/exporter/0.log" Jun 06 21:29:17.858084 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:17.858036 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgrbg_3d7be57c-f31c-453f-8975-0a63a42daa16/extractor/0.log" Jun 06 21:29:20.274656 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:20.274631 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-mhnhn_b6c594ea-7eb1-486d-9b01-831699ed005e/manager/0.log" Jun 06 21:29:20.292463 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:20.292413 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-mhnhn_b6c594ea-7eb1-486d-9b01-831699ed005e/copy-manifests/0.log" Jun 06 21:29:21.953630 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:21.953588 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68d9b98c67-n9gc8_e13f4f32-1d5c-4599-a586-8c4dd5f7f993/manager/0.log" Jun 06 21:29:22.539593 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:22.539567 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-q8l5c" Jun 06 21:29:26.826038 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:26.826016 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:29:27.415359 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:27.415328 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st8hw_977bd5be-39e2-4579-a828-00bb54cfae57/migrator/0.log" Jun 06 21:29:27.433630 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:27.433597 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st8hw_977bd5be-39e2-4579-a828-00bb54cfae57/graceful-termination/0.log" Jun 06 21:29:27.827382 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:27.827330 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xz7nf_15db359d-ea49-41a7-9e62-1c8bdff096e5/kube-storage-version-migrator-operator/1.log" Jun 06 21:29:27.828831 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:27.828804 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xz7nf_15db359d-ea49-41a7-9e62-1c8bdff096e5/kube-storage-version-migrator-operator/0.log" Jun 06 21:29:28.131330 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:28.131211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:29:29.158076 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.158049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/kube-multus-additional-cni-plugins/0.log" Jun 06 21:29:29.174073 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.174038 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/egress-router-binary-copy/0.log" Jun 06 21:29:29.189066 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.189042 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/cni-plugins/0.log" Jun 06 21:29:29.204519 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.204498 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/bond-cni-plugin/0.log" Jun 06 21:29:29.224616 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.224579 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/routeoverride-cni/0.log" Jun 06 21:29:29.245863 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.245836 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/whereabouts-cni-bincopy/0.log" Jun 06 21:29:29.261919 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.261896 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpr4w_f697b1bb-4110-4cb3-96dd-9f7a233ad34c/whereabouts-cni/0.log" Jun 06 21:29:29.438402 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.438328 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gnp9m_3e138941-1db3-4911-bf8e-2faf5d8a20d4/kube-multus/0.log" Jun 06 21:29:29.588323 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.588295 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hdrrk_7ab0d8d5-e060-4c58-bdc4-b2ef89b76792/network-metrics-daemon/0.log" Jun 06 21:29:29.673109 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.673074 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hdrrk_7ab0d8d5-e060-4c58-bdc4-b2ef89b76792/kube-rbac-proxy/0.log" Jun 06 21:29:29.923703 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:29.923676 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:29:31.064927 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.064895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-controller/0.log" Jun 06 21:29:31.078945 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.078899 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/1.log" Jun 06 21:29:31.079127 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.078983 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovn-acl-logging/0.log" Jun 06 21:29:31.096658 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.096626 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/kube-rbac-proxy-node/0.log" Jun 06 21:29:31.113473 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.113441 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/kube-rbac-proxy-ovn-metrics/0.log" Jun 06 21:29:31.127005 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.126976 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/northd/0.log" Jun 06 21:29:31.143254 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.143226 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/nbdb/0.log" Jun 06 21:29:31.158887 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.158858 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/sbdb/0.log" Jun 06 21:29:31.205922 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:31.205890 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h2496_43654bee-0264-4364-9aaf-895fb9c241a7/ovnkube-controller/0.log" Jun 06 21:29:32.169846 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:32.169808 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-d8kc2_7ddff439-c968-4505-b897-ccc1ec947853/kube-auth-proxy/0.log" Jun 06 21:29:32.366975 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:32.366944 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-8nrhl_ea4d2f6b-23a7-420d-8847-cfbdd133fe0c/check-endpoints/0.log" Jun 06 21:29:32.432207 ip-10-0-133-247 kubenswrapper[2555]: I0606 21:29:32.432123 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-z2rl6_14ce3737-36d3-4a37-922e-b7749ee3dbee/network-check-target-container/0.log"