Jun 06 13:01:01.014323 ip-10-0-131-83 systemd[1]: Starting Kubernetes Kubelet... Jun 06 13:01:01.450539 ip-10-0-131-83 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:01.450539 ip-10-0-131-83 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 13:01:01.450539 ip-10-0-131-83 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:01.450539 ip-10-0-131-83 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 13:01:01.450539 ip-10-0-131-83 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:01.452728 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.452641 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 13:01:01.456575 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456560 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.456575 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456575 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456579 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456582 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456585 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456588 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456591 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456595 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456599 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456603 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456607 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456610 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456619 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456622 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456625 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456628 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456630 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456633 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456636 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456639 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.456639 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456641 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456644 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456647 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456650 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456653 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456655 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456658 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456660 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456663 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456666 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456668 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456671 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456674 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456676 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456679 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456681 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456684 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456686 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456689 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456691 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.457101 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456695 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456698 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456700 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456702 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456705 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456708 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456710 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456713 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456715 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456718 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456720 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456723 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456725 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456728 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456733 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456736 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456739 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456742 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456744 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.457644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456747 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456750 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456752 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456755 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456757 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456760 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456763 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456765 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456767 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456770 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456772 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456775 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456777 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456780 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456782 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456786 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456789 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456791 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456794 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456797 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.458394 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456799 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456802 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456804 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456807 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456809 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456812 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456814 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456818 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456821 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456825 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456829 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456832 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456834 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456837 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456839 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456842 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456844 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456847 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456850 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.456852 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.458939 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458636 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458741 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458747 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458750 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458753 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458756 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458759 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458762 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458765 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458768 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458770 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458773 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458775 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458778 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458780 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458783 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458785 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458788 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458790 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458793 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.459459 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458796 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458798 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458801 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458804 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458806 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458809 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458812 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458814 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458817 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458819 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458822 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458824 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458828 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458832 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458834 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458837 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458839 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458842 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458844 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.459957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458849 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458853 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458856 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458859 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458862 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458864 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458867 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458872 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458876 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458879 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458882 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458884 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458887 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458890 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458893 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458895 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458898 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458901 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458904 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.460485 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458906 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458909 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458911 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458914 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458917 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458921 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458924 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458927 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458930 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458933 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458935 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458938 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458940 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458943 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458946 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458948 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458951 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458954 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458956 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458959 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.460951 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458961 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458964 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458966 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458969 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.458971 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459000 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459005 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459009 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459012 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459014 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459017 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459020 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459022 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459026 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459030 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459033 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459035 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459038 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459041 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.461465 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459044 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459047 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459467 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459473 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459476 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459479 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459482 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459484 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459487 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459490 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459492 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459495 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459498 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459500 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459503 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459505 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459508 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459510 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459513 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459516 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.461924 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459519 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459521 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459525 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459527 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459530 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459533 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459535 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459538 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459540 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459543 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459545 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459548 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459551 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459553 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459556 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459559 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459562 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459565 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459567 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459570 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.462425 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459572 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459575 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459579 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459583 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459586 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459588 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459591 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459594 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459596 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459599 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459601 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459604 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459607 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459609 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459613 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459615 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459618 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459620 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459623 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459625 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.462899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459628 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459630 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459633 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459636 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459639 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459642 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459645 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459647 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459650 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459654 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459656 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459660 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459664 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459667 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459670 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459673 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459675 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459677 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459680 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459683 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.463401 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459686 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459688 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459690 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459693 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459697 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459699 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459702 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459704 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459707 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459709 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459712 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459715 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459717 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459720 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459722 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459725 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459728 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459731 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459734 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.463890 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459738 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.459741 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459806 2550 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459813 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459819 2550 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459823 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459827 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459830 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459834 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459839 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459843 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459846 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459850 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459853 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459856 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459859 2550 flags.go:64] FLAG: --cgroup-root="" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459862 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459865 2550 flags.go:64] FLAG: --client-ca-file="" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459869 2550 flags.go:64] FLAG: --cloud-provider="external" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459872 2550 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459877 2550 flags.go:64] FLAG: --cluster-domain="" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459880 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459883 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459887 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 13:01:01.464364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459890 2550 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459900 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459903 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459906 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459909 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459912 2550 flags.go:64] FLAG: --contention-profiling="false" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459915 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459918 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459921 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459924 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459928 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459931 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459934 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459936 2550 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459939 2550 flags.go:64] FLAG: --enable-server="true" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459942 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459946 2550 flags.go:64] FLAG: --event-burst="100" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459950 2550 flags.go:64] FLAG: --event-qps="50" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459953 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459956 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459959 2550 flags.go:64] FLAG: --eviction-hard="" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459963 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459966 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459969 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459972 2550 flags.go:64] FLAG: --eviction-soft="" Jun 06 13:01:01.464937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459975 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459978 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459995 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.459999 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460002 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460005 2550 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460009 2550 flags.go:64] FLAG: --feature-gates="" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460012 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460016 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460019 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460022 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460025 2550 flags.go:64] FLAG: --healthz-port="10248" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460028 2550 flags.go:64] FLAG: --help="false" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460031 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460034 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460037 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460039 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460043 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460046 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460049 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460052 2550 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460055 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460057 2550 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 13:01:01.465549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460060 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460063 2550 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460066 2550 flags.go:64] FLAG: --kube-reserved="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460069 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460072 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460075 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460078 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460081 2550 flags.go:64] FLAG: --lock-file="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460084 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460096 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460099 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460104 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460108 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460111 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460114 2550 flags.go:64] FLAG: --logging-format="text" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460117 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460120 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460123 2550 flags.go:64] FLAG: --manifest-url="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460126 2550 flags.go:64] FLAG: --manifest-url-header="" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460131 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460134 2550 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460138 2550 flags.go:64] FLAG: --max-pods="110" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460141 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460144 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460147 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 13:01:01.466188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460150 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460153 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460156 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460159 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460166 2550 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460170 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460178 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460181 2550 flags.go:64] FLAG: --pod-cidr="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460184 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460190 2550 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460193 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460196 2550 flags.go:64] FLAG: --pods-per-core="0" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460199 2550 flags.go:64] FLAG: --port="10250" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460202 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460204 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f5291047976a598c" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460208 2550 flags.go:64] FLAG: --qos-reserved="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460211 2550 flags.go:64] FLAG: --read-only-port="10255" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460213 2550 flags.go:64] FLAG: --register-node="true" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460216 2550 flags.go:64] FLAG: --register-with-taints="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460220 2550 flags.go:64] FLAG: --registry-burst="10" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460223 2550 flags.go:64] FLAG: --registry-qps="5" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460226 2550 flags.go:64] FLAG: --reserved-cpus="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460229 2550 flags.go:64] FLAG: --reserved-memory="" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460233 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460236 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 13:01:01.466804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460239 2550 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460242 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460245 2550 flags.go:64] FLAG: --runonce="false" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460247 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460251 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460254 2550 flags.go:64] FLAG: --seccomp-default="false" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460257 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460260 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460263 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460266 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460269 2550 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460272 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460274 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460277 2550 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460282 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460285 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460288 2550 flags.go:64] FLAG: --system-cgroups="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460290 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460295 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460298 2550 flags.go:64] FLAG: --tls-cert-file="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460301 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460306 2550 flags.go:64] FLAG: --tls-min-version="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460308 2550 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460311 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460314 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 13:01:01.467508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460318 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460321 2550 flags.go:64] FLAG: --v="2" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460325 2550 flags.go:64] FLAG: --version="false" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460329 2550 flags.go:64] FLAG: --vmodule="" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460333 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.460336 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460450 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460454 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460457 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460460 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460463 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460466 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460469 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460472 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460475 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460478 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460480 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460483 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460486 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460488 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460491 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460495 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.468147 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460498 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460501 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460503 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460506 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460509 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460511 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460514 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460516 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460519 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460521 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460529 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460532 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460534 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460537 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460541 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460545 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460549 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460551 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460554 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.468701 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460557 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460560 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460563 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460566 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460568 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460571 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460573 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460576 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460578 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460581 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460583 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460586 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460590 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460593 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460596 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460599 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460602 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460605 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460608 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.469176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460611 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460613 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460616 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460619 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460622 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460625 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460627 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460630 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460633 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460636 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460638 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460641 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460644 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460646 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460649 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460651 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460655 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460659 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460662 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460665 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.469645 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460668 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460670 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460673 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460676 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460679 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460684 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460687 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460689 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460692 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460695 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460697 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460700 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460702 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460705 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460707 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460710 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460713 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460716 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460718 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.470153 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460721 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460724 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460726 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460735 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460738 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.460740 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.461396 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.468295 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.468403 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.468422 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.468440 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468497 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468502 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468505 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468508 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.470628 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468511 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468513 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468517 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468519 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468522 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468525 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468527 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468530 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468533 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468535 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468538 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468541 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468543 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468546 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468548 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468551 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468553 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468556 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468559 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468561 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468569 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.471030 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468572 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468574 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468577 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468579 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468583 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468586 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468588 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468592 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468596 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468599 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468602 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468605 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468608 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468611 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468614 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468616 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468619 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468621 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468624 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.471536 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468627 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468629 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468632 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468634 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468637 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468639 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468642 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468644 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468647 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468649 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468652 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468654 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468657 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468660 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468663 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468665 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468668 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468671 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468673 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468676 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.472071 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468679 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468681 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468684 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468686 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468690 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468693 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468696 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468699 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468702 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468706 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468711 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468714 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468717 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468719 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468722 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468725 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468728 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468730 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.472562 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468733 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468735 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468738 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468740 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468743 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468745 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468748 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468750 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468754 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468756 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468760 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468762 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468765 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468768 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468770 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468773 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.473051 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468776 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.468781 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468906 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468911 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468916 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468919 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468922 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468926 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468929 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468932 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468935 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468938 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468941 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468944 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:01.473502 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468947 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468949 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468952 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468955 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468958 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468961 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468963 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468966 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468969 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468971 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468974 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.468977 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469001 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469005 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469008 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469011 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469014 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469016 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469019 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469021 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:01.473843 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469024 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469026 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469029 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469031 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469034 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469037 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469039 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469041 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469044 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469047 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469049 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469051 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469054 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469056 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469059 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469061 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469064 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469066 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469069 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469071 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:01.474359 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469074 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469077 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469079 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469081 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469085 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469089 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469091 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469094 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469096 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469099 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469101 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469104 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469107 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469111 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469114 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469117 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469119 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469122 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469124 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:01.474844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469127 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469129 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469132 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469134 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469137 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469139 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469142 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469144 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469147 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469150 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469152 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469155 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469157 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469160 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469164 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469167 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469170 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469173 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469177 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469179 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:01.475329 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469182 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469185 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469187 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469190 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469193 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469195 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469198 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:01.469200 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.469205 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.469301 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.471553 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.473159 2550 server.go:1019] "Starting client certificate rotation" Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.473258 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:01:01.475812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.473291 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:01:01.476160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.476096 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:01:01.477220 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.477185 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:01:01.488804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.488785 2550 log.go:25] "Validated CRI v1 runtime API" Jun 06 13:01:01.493850 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.493834 2550 log.go:25] "Validated CRI v1 image API" Jun 06 13:01:01.494586 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.494573 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 13:01:01.497034 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.497017 2550 fs.go:135] Filesystem UUIDs: map[1034c049-d80e-4698-a45e-7215f5f791f0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c35d4507-4383-4935-92ab-ba1398b1092a:/dev/nvme0n1p4] Jun 06 13:01:01.497079 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.497035 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 13:01:01.503633 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.503529 2550 manager.go:216] Machine: {Timestamp:2026-06-06 13:01:01.502274232 +0000 UTC m=+0.362356644 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099724 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25925c16005f724dbf981c8ed2ecb2 SystemUUID:ec25925c-1600-5f72-4dbf-981c8ed2ecb2 BootID:fdc0a8ca-c86f-477a-91cb-d03fd826d34c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:99:c1:36:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:99:c1:36:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:1f:41:b6:fb:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 13:01:01.503633 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.503631 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 13:01:01.503742 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.503710 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 13:01:01.504861 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.504839 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 13:01:01.505010 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.504862 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 13:01:01.505258 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.505243 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:01:01.505703 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.505693 2550 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 13:01:01.505740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.505706 2550 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 13:01:01.505740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.505718 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:01:01.505740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.505732 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:01:01.506891 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.506882 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 13:01:01.511267 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511257 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:01:01.511377 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511368 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 13:01:01.511409 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511396 2550 kubelet.go:486] "Attempting to sync node with API server" Jun 06 13:01:01.511409 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511406 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 13:01:01.511459 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511420 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 13:01:01.511459 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511432 2550 kubelet.go:398] "Adding apiserver pod source" Jun 06 13:01:01.511459 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511441 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 13:01:01.511782 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511771 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:01:01.511828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.511788 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:01:01.514250 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.514232 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 13:01:01.516040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.516024 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 13:01:01.516129 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.516063 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 13:01:01.517563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517549 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 13:01:01.517563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517570 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517579 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517587 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517599 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517608 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517619 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517627 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517637 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517647 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517676 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 13:01:01.517694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.517686 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 13:01:01.518565 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.518554 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 13:01:01.518613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.518567 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 13:01:01.521697 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.521682 2550 server.go:1268] "Started kubelet" Jun 06 13:01:01.521799 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.521771 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 13:01:01.522290 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.522232 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 13:01:01.522361 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.522313 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 13:01:01.522657 ip-10-0-131-83 systemd[1]: Started Kubernetes Kubelet. Jun 06 13:01:01.524070 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.524049 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 13:01:01.524408 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.524391 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 13:01:01.524592 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.524581 2550 server.go:310] "Adding debug handlers to kubelet server" Jun 06 13:01:01.524793 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.524761 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 13:01:01.524793 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.524764 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 13:01:01.530130 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.530103 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 13:01:01.532599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.532571 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 13:01:01.532691 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.532597 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 13:01:01.532691 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.532661 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:01.533070 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.531650 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18b67f7946782ff1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-06-06 13:01:01.521661937 +0000 UTC m=+0.381744337,LastTimestamp:2026-06-06 13:01:01.521661937 +0000 UTC m=+0.381744337,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}" Jun 06 13:01:01.533450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.533433 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 13:01:01.533539 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.533453 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 13:01:01.533539 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.533433 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 13:01:01.533648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.533541 2550 reconstruct.go:97] "Volume reconstruction finished" Jun 06 13:01:01.533648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.533549 2550 reconciler.go:29] "Reconciler: start to sync state" Jun 06 13:01:01.534457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534440 2550 factory.go:153] Registering CRI-O factory Jun 06 13:01:01.534457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534456 2550 factory.go:223] Registration of the crio container factory successfully Jun 06 13:01:01.534613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534499 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 13:01:01.534613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534516 2550 factory.go:55] Registering systemd factory Jun 06 13:01:01.534613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534524 2550 factory.go:223] Registration of the systemd container factory successfully Jun 06 13:01:01.534613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534543 2550 factory.go:103] Registering Raw factory Jun 06 13:01:01.534613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534553 2550 manager.go:1196] Started watching for new ooms in manager Jun 06 13:01:01.534955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.534943 2550 manager.go:349] Starting recovery of all containers Jun 06 13:01:01.538376 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.538353 2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 13:01:01.538477 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.538448 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 13:01:01.544946 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.544932 2550 manager.go:354] Recovery completed Jun 06 13:01:01.549052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.549039 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.551532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.551509 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.551611 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.551544 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.551611 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.551554 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.552120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.552104 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 13:01:01.552120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.552117 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 13:01:01.552237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.552132 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:01:01.552237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.552154 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.554147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554131 2550 policy_none.go:49] "None policy: Start" Jun 06 13:01:01.554225 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554161 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 13:01:01.554225 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.554095 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18b67f79483ff5a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-83.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-06-06 13:01:01.551531424 +0000 UTC m=+0.411613825,LastTimestamp:2026-06-06 13:01:01.551531424 +0000 UTC m=+0.411613825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}" Jun 06 13:01:01.554225 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554218 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.554396 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554172 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 13:01:01.554396 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554258 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.554396 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.554275 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.556186 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.556174 2550 policy_none.go:47] "Start" Jun 06 13:01:01.564057 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.563996 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18b67f794840398e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-83.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-06-06 13:01:01.551548814 +0000 UTC m=+0.411631214,LastTimestamp:2026-06-06 13:01:01.551548814 +0000 UTC m=+0.411631214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}" Jun 06 13:01:01.566523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.566507 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fwlw" Jun 06 13:01:01.574402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.574328 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fwlw" Jun 06 13:01:01.576377 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.576300 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18b67f7948405ef5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-83.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-06-06 13:01:01.551558389 +0000 UTC m=+0.411640790,LastTimestamp:2026-06-06 13:01:01.551558389 +0000 UTC m=+0.411640790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}" Jun 06 13:01:01.598667 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.598651 2550 manager.go:337] "Starting Device Plugin manager" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.598684 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.598694 2550 server.go:87] "Starting device plugin registration server" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.598947 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.598957 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.599060 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.599139 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.599147 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.600141 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.600191 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.602061 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.603317 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.603345 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.603364 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.603439 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 13:01:01.612894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.605645 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:01.699363 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.699332 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.700332 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.700314 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.700447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.700348 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.700447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.700361 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.700447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.700388 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.703921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.703873 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"] Jun 06 13:01:01.703977 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.703937 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.704698 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.704677 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.704776 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.704705 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.704776 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.704719 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.707080 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707068 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.707192 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707179 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.707258 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707208 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.707741 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707724 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.707811 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707751 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.707811 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707761 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.707811 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707724 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.707905 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707827 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.707905 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.707847 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.709963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.709948 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.710043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.709971 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:01.710227 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.710204 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.710290 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.710228 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-83.ec2.internal\": node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:01.710609 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.710596 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:01.710672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.710621 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:01.710672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.710635 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:01.737474 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.737446 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:01.738811 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.738793 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-83.ec2.internal\" not found" node="ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.743212 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.743191 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-83.ec2.internal\" not found" node="ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.835003 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.834949 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.835003 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.834998 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf10e953d29a0f873f55d3801011922b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"bf10e953d29a0f873f55d3801011922b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.835187 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.835018 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.838059 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.838042 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:01.935443 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935404 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.935443 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935451 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.935589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935478 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf10e953d29a0f873f55d3801011922b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"bf10e953d29a0f873f55d3801011922b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.935589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935514 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.935589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935529 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833357b11920ae9dbcd4511ba1a256b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"833357b11920ae9dbcd4511ba1a256b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.935589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:01.935520 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf10e953d29a0f873f55d3801011922b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"bf10e953d29a0f873f55d3801011922b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:01.938524 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:01.938509 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.039345 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.039279 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.045446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.045423 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:02.050344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.050040 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:02.139908 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.139865 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.240409 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.240383 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.340948 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.340877 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.441587 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.441529 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.472709 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.472685 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 13:01:02.473314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.472822 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 13:01:02.541841 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.541813 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.578931 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.578892 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 12:56:01 +0000 UTC" deadline="2028-01-04 15:42:52.808268069 +0000 UTC" Jun 06 13:01:02.579122 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.578937 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13850h41m50.229348574s" Jun 06 13:01:02.597223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.597177 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:02.642428 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.642401 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.672546 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.672523 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:02.673552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.673533 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:02.673646 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.673563 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:02.673646 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.673573 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:02.715211 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:02.715177 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833357b11920ae9dbcd4511ba1a256b0.slice/crio-89768a7a08d40c13e1b106faace044949f4cbb03ca9c9a499bc3d968e8037dd7 WatchSource:0}: Error finding container 89768a7a08d40c13e1b106faace044949f4cbb03ca9c9a499bc3d968e8037dd7: Status 404 returned error can't find the container with id 89768a7a08d40c13e1b106faace044949f4cbb03ca9c9a499bc3d968e8037dd7 Jun 06 13:01:02.715568 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:02.715547 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf10e953d29a0f873f55d3801011922b.slice/crio-638ea1ef67f61f5b63933bc585c0429e47cafe0120b72706fca966fea743232f WatchSource:0}: Error finding container 638ea1ef67f61f5b63933bc585c0429e47cafe0120b72706fca966fea743232f: Status 404 returned error can't find the container with id 638ea1ef67f61f5b63933bc585c0429e47cafe0120b72706fca966fea743232f Jun 06 13:01:02.720869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.720854 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:01:02.742755 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.742729 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.813094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.813068 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:02.843826 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:02.843793 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found" Jun 06 13:01:02.859387 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.859316 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:02.933334 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.933304 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" Jun 06 13:01:02.945594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.945568 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:01:02.946837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.946822 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" Jun 06 13:01:02.954954 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:02.954938 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:01:03.512420 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.512385 2550 apiserver.go:52] "Watching apiserver" Jun 06 13:01:03.520124 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.520101 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 13:01:03.522596 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.521709 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9lb5w","kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7","openshift-cluster-node-tuning-operator/tuned-9rc4b","openshift-image-registry/node-ca-sxqt8","openshift-multus/multus-s8b82","openshift-multus/network-metrics-daemon-2l27h","openshift-network-diagnostics/network-check-target-jgv9t","kube-system/konnectivity-agent-n7m48","openshift-dns/node-resolver-kn46z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal","openshift-multus/multus-additional-cni-plugins-lkk7d","openshift-network-operator/iptables-alerter-kd4d2","openshift-ovn-kubernetes/ovnkube-node-6lldq"] Jun 06 13:01:03.524685 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.524664 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.524802 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.524754 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:03.526918 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.526895 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.528999 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.528965 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.529690 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529623 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.529690 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529636 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.529832 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529723 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p6rjm\"" Jun 06 13:01:03.529832 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529639 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 13:01:03.529933 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529742 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 13:01:03.529933 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.529896 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 13:01:03.531044 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.531023 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.531251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.531235 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 13:01:03.531349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.531236 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.531417 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.531349 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.531694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.531677 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-25n9j\"" Jun 06 13:01:03.532890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.532792 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 13:01:03.533447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.533424 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.533549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.533481 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6pjp\"" Jun 06 13:01:03.533549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.533535 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.533696 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.533676 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.535509 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.535491 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.535816 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.535797 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.535904 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.535799 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 13:01:03.535904 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.535896 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2t4v7\"" Jun 06 13:01:03.536676 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.536663 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.538561 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.538542 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 13:01:03.538780 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.538766 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6sg8w\"" Jun 06 13:01:03.539058 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.539043 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.541292 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.541272 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.541406 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.541391 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 13:01:03.541598 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.541539 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:01:03.541954 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.541817 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vzk6b\"" Jun 06 13:01:03.541954 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.541851 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 13:01:03.543457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.543435 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 13:01:03.543741 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.543636 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.543741 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.543711 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wp7cq\"" Jun 06 13:01:03.543741 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.543739 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.543926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.543902 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.545055 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545035 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-745pq\" (UniqueName: \"kubernetes.io/projected/ab5b8420-d2a4-449b-ae91-72a21e6eec29-kube-api-access-745pq\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.545143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-socket-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.545143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545079 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-device-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.545143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545094 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-sys-fs\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.545143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545135 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8kh7\" (UniqueName: \"kubernetes.io/projected/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-kube-api-access-g8kh7\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545164 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-cni-binary-copy\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545215 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cnibin\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545238 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545262 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrc27\" (UniqueName: \"kubernetes.io/projected/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kube-api-access-nrc27\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.545314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545292 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-modprobe-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545335 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545379 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-registration-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545404 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-kubernetes\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545426 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-systemd\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545448 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-run\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545469 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-host\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545507 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-tmp\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545544 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-k8s-cni-cncf-io\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545566 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-netns\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545588 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-bin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545613 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-kubelet\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545647 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-etc-kubernetes\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.545674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545674 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cthpj\" (UniqueName: \"kubernetes.io/projected/6e4f884b-e9c1-48cf-9567-31550adbb472-kube-api-access-cthpj\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545699 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545724 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdm9\" (UniqueName: \"kubernetes.io/projected/c0adce35-ec50-4eba-89ba-88fde6e1ea16-kube-api-access-zrdm9\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545746 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-lib-modules\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545767 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-os-release\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545813 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-socket-dir-parent\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-daemon-config\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545866 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-sys\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545888 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545913 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545938 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.545960 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysconfig\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546038 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-var-lib-kubelet\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-etc-tuned\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546086 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-system-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546112 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-system-cni-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546157 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-os-release\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.546243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546199 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546219 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546244 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546269 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-cnibin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546332 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-conf-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546365 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-conf\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546394 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfvch\" (UniqueName: \"kubernetes.io/projected/4cb7f619-4064-4b96-9ea9-198868767200-kube-api-access-rfvch\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546424 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-host\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546445 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-serviceca\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546479 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-multus\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546508 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-hostroot\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546569 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-multus-certs\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546590 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2wf5m\"" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546594 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.546912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.546846 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.547506 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.547017 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:03.549331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.549311 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:03.549425 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.549400 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:03.551951 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.551933 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.554349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.554332 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wwp5m\"" Jun 06 13:01:03.554742 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.554698 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 13:01:03.554742 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.554711 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 13:01:03.555247 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.555042 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 13:01:03.555247 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.555050 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 13:01:03.555247 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.555049 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 13:01:03.555942 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.555924 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 13:01:03.565265 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.565240 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgxlj" Jun 06 13:01:03.572564 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.572542 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgxlj" Jun 06 13:01:03.607912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.607860 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" event={"ID":"bf10e953d29a0f873f55d3801011922b","Type":"ContainerStarted","Data":"638ea1ef67f61f5b63933bc585c0429e47cafe0120b72706fca966fea743232f"} Jun 06 13:01:03.609009 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.608969 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"833357b11920ae9dbcd4511ba1a256b0","Type":"ContainerStarted","Data":"89768a7a08d40c13e1b106faace044949f4cbb03ca9c9a499bc3d968e8037dd7"} Jun 06 13:01:03.634888 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.634647 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 13:01:03.647083 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647050 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-hostroot\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647083 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647093 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-multus-certs\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647083 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647122 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/812616d7-e431-4994-9d41-36a329a8aa27-tmp-dir\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647154 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-log-socket\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647175 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-hostroot\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647218 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-device-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647239 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-multus-certs\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647252 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-sys-fs\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647278 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-device-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647295 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-cni-binary-copy\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647346 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-sys-fs\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647464 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csjs9\" (UniqueName: \"kubernetes.io/projected/812616d7-e431-4994-9d41-36a329a8aa27-kube-api-access-csjs9\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647524 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647549 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxt4\" (UniqueName: \"kubernetes.io/projected/f062a081-814a-4807-bbfe-8ce70227ee56-kube-api-access-jtxt4\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647590 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-script-lib\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647618 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.647693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647643 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.647965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647815 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.647965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647836 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrc27\" (UniqueName: \"kubernetes.io/projected/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kube-api-access-nrc27\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.647965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647886 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-cni-binary-copy\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.647965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647900 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ace926ca-223f-40fa-b0c8-eb86c9118d76-konnectivity-ca\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.647965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647941 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-node-log\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.647965 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4b5b\" (UniqueName: \"kubernetes.io/projected/2f08586d-6a3f-4256-9ab4-30beab43d1af-kube-api-access-v4b5b\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648028 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648068 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-registration-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648096 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-kubernetes\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648131 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-run\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648153 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-kubelet\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648178 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-systemd-units\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.648239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648220 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-k8s-cni-cncf-io\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648247 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/812616d7-e431-4994-9d41-36a329a8aa27-hosts-file\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648271 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-var-lib-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648283 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-kubernetes\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648294 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f062a081-814a-4807-bbfe-8ce70227ee56-host-slash\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648248 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-run\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648327 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-registration-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648334 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648369 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-config\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648411 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-k8s-cni-cncf-io\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648415 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648442 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648449 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648457 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-kubelet\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648514 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648546 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-etc-tuned\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648574 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.648612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648605 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648614 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-system-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648642 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-kubelet\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648667 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-systemd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648676 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-system-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648691 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-os-release\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648749 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-os-release\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648754 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648789 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ace926ca-223f-40fa-b0c8-eb86c9118d76-agent-certs\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648802 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-env-overrides\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648843 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-conf\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648840 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648870 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-multus\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648903 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648927 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-etc-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648951 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.649447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648961 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b8420-d2a4-449b-ae91-72a21e6eec29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648975 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-bin\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.648976 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-multus\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649019 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysctl-conf\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649034 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-745pq\" (UniqueName: \"kubernetes.io/projected/ab5b8420-d2a4-449b-ae91-72a21e6eec29-kube-api-access-745pq\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649066 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-socket-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649095 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8kh7\" (UniqueName: \"kubernetes.io/projected/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-kube-api-access-g8kh7\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649134 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f062a081-814a-4807-bbfe-8ce70227ee56-iptables-alerter-script\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649187 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-kubelet-config\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cnibin\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649240 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-modprobe-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649254 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a41e1b71-3298-4f81-9eb4-401701bd8f9e-socket-dir\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649267 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-cnibin\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649335 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-modprobe-d\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649334 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-netns\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649370 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-systemd\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649421 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-host\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.650309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649447 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-tmp\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649450 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-systemd\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649470 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-slash\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649493 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649505 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-host\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649547 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-netns\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649568 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-bin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649599 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-etc-kubernetes\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649604 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-run-netns\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649621 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cthpj\" (UniqueName: \"kubernetes.io/projected/6e4f884b-e9c1-48cf-9567-31550adbb472-kube-api-access-cthpj\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649633 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-host-var-lib-cni-bin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649644 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-etc-kubernetes\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649647 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-ovn\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649675 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649710 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdm9\" (UniqueName: \"kubernetes.io/projected/c0adce35-ec50-4eba-89ba-88fde6e1ea16-kube-api-access-zrdm9\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-lib-modules\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649755 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-os-release\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649778 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-socket-dir-parent\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651067 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.649794 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649800 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-daemon-config\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649822 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-dbus\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649847 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-sys\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649870 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-lib-modules\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.649885 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:04.149853062 +0000 UTC m=+3.009935472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649899 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-sys\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.649937 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-socket-dir-parent\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650021 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-os-release\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650060 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysconfig\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650091 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-var-lib-kubelet\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650128 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650169 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-netd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650174 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-cni-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650163 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-var-lib-kubelet\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650132 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb7f619-4064-4b96-9ea9-198868767200-etc-sysconfig\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650199 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-system-cni-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.651952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650224 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-cnibin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650259 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-cnibin\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650258 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-conf-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650293 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-conf-dir\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovn-node-metrics-cert\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650225 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab5b8420-d2a4-449b-ae91-72a21e6eec29-system-cni-dir\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650364 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfvch\" (UniqueName: \"kubernetes.io/projected/4cb7f619-4064-4b96-9ea9-198868767200-kube-api-access-rfvch\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650385 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-host\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650403 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-serviceca\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650353 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e4f884b-e9c1-48cf-9567-31550adbb472-multus-daemon-config\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650476 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-host\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.650847 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-serviceca\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.651883 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-etc-tuned\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.652800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.652598 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb7f619-4064-4b96-9ea9-198868767200-tmp\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.657037 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.656638 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrc27\" (UniqueName: \"kubernetes.io/projected/a41e1b71-3298-4f81-9eb4-401701bd8f9e-kube-api-access-nrc27\") pod \"aws-ebs-csi-driver-node-8g5r7\" (UID: \"a41e1b71-3298-4f81-9eb4-401701bd8f9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.659700 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.659671 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8kh7\" (UniqueName: \"kubernetes.io/projected/04ab0a67-e8b2-4b52-a2ad-89af7fbd9185-kube-api-access-g8kh7\") pod \"node-ca-sxqt8\" (UID: \"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185\") " pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.660148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.660125 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdm9\" (UniqueName: \"kubernetes.io/projected/c0adce35-ec50-4eba-89ba-88fde6e1ea16-kube-api-access-zrdm9\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:03.660682 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.660656 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cthpj\" (UniqueName: \"kubernetes.io/projected/6e4f884b-e9c1-48cf-9567-31550adbb472-kube-api-access-cthpj\") pod \"multus-s8b82\" (UID: \"6e4f884b-e9c1-48cf-9567-31550adbb472\") " pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.661614 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.661592 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfvch\" (UniqueName: \"kubernetes.io/projected/4cb7f619-4064-4b96-9ea9-198868767200-kube-api-access-rfvch\") pod \"tuned-9rc4b\" (UID: \"4cb7f619-4064-4b96-9ea9-198868767200\") " pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.662182 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.662161 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-745pq\" (UniqueName: \"kubernetes.io/projected/ab5b8420-d2a4-449b-ae91-72a21e6eec29-kube-api-access-745pq\") pod \"multus-additional-cni-plugins-lkk7d\" (UID: \"ab5b8420-d2a4-449b-ae91-72a21e6eec29\") " pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.743677 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.743633 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:03.751696 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751662 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-node-log\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751713 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4b5b\" (UniqueName: \"kubernetes.io/projected/2f08586d-6a3f-4256-9ab4-30beab43d1af-kube-api-access-v4b5b\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751739 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-systemd-units\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751745 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-node-log\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751765 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/812616d7-e431-4994-9d41-36a329a8aa27-hosts-file\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751792 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-var-lib-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751807 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-systemd-units\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.751840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f062a081-814a-4807-bbfe-8ce70227ee56-host-slash\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751847 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-config\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751852 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f062a081-814a-4807-bbfe-8ce70227ee56-host-slash\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751921 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/812616d7-e431-4994-9d41-36a329a8aa27-hosts-file\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751923 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-kubelet\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751971 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-var-lib-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751970 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-kubelet\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.751976 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-systemd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752035 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ace926ca-223f-40fa-b0c8-eb86c9118d76-agent-certs\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752040 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-systemd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752062 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-env-overrides\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752181 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752207 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-etc-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752224 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752243 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-bin\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752270 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f062a081-814a-4807-bbfe-8ce70227ee56-iptables-alerter-script\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-kubelet-config\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752341 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752354 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-kubelet-config\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752381 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-netns\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752409 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-slash\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.752432 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752425 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-etc-openvswitch\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752474 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-bin\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752485 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.752493 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:04.252476813 +0000 UTC m=+3.112559214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752434 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752505 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-env-overrides\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752528 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-ovn\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752563 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-run-netns\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752569 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-dbus\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752529 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-config\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.752940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752567 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-run-ovn\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752600 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-slash\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752604 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-netd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752638 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-cni-netd\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752640 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovn-node-metrics-cert\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752680 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/812616d7-e431-4994-9d41-36a329a8aa27-tmp-dir\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752690 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4fce606-ff59-486c-aa72-d0b19bfa48b1-dbus\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752703 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-log-socket\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752728 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752761 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csjs9\" (UniqueName: \"kubernetes.io/projected/812616d7-e431-4994-9d41-36a329a8aa27-kube-api-access-csjs9\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752778 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-log-socket\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752788 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752821 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxt4\" (UniqueName: \"kubernetes.io/projected/f062a081-814a-4807-bbfe-8ce70227ee56-kube-api-access-jtxt4\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752848 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-script-lib\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.752875 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ace926ca-223f-40fa-b0c8-eb86c9118d76-konnectivity-ca\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.753006 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/812616d7-e431-4994-9d41-36a329a8aa27-tmp-dir\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.753006 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f08586d-6a3f-4256-9ab4-30beab43d1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.753764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.753407 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ace926ca-223f-40fa-b0c8-eb86c9118d76-konnectivity-ca\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.754607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.753496 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovnkube-script-lib\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.754607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.753883 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f062a081-814a-4807-bbfe-8ce70227ee56-iptables-alerter-script\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.754902 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.754883 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ace926ca-223f-40fa-b0c8-eb86c9118d76-agent-certs\") pod \"konnectivity-agent-n7m48\" (UID: \"ace926ca-223f-40fa-b0c8-eb86c9118d76\") " pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.755498 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.755469 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f08586d-6a3f-4256-9ab4-30beab43d1af-ovn-node-metrics-cert\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.760287 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.760249 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:03.760287 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.760272 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:03.760287 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.760282 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:03.760499 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:03.760347 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:04.260330821 +0000 UTC m=+3.120413227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:03.762215 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.762173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4b5b\" (UniqueName: \"kubernetes.io/projected/2f08586d-6a3f-4256-9ab4-30beab43d1af-kube-api-access-v4b5b\") pod \"ovnkube-node-6lldq\" (UID: \"2f08586d-6a3f-4256-9ab4-30beab43d1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:03.763812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.763765 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csjs9\" (UniqueName: \"kubernetes.io/projected/812616d7-e431-4994-9d41-36a329a8aa27-kube-api-access-csjs9\") pod \"node-resolver-kn46z\" (UID: \"812616d7-e431-4994-9d41-36a329a8aa27\") " pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.763968 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.763952 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxt4\" (UniqueName: \"kubernetes.io/projected/f062a081-814a-4807-bbfe-8ce70227ee56-kube-api-access-jtxt4\") pod \"iptables-alerter-kd4d2\" (UID: \"f062a081-814a-4807-bbfe-8ce70227ee56\") " pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.838795 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.838759 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" Jun 06 13:01:03.846364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.846340 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" Jun 06 13:01:03.855958 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.855936 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" Jun 06 13:01:03.861293 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.861274 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxqt8" Jun 06 13:01:03.867854 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.867832 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8b82" Jun 06 13:01:03.876516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.876496 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:03.884975 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.884956 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kd4d2" Jun 06 13:01:03.892528 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.892510 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kn46z" Jun 06 13:01:03.899075 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:03.899056 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:04.155696 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.155659 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:04.155870 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.155813 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:04.155924 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.155890 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:05.155870394 +0000 UTC m=+4.015952805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:04.256733 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.256693 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:04.256894 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.256870 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:04.256961 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.256954 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:05.25693234 +0000 UTC m=+4.117014731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:04.357421 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.357341 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:04.357543 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.357490 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:04.357543 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.357507 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:04.357543 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.357516 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:04.357654 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.357567 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:05.357553033 +0000 UTC m=+4.217635427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:04.576698 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.576660 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 12:56:03 +0000 UTC" deadline="2027-11-10 11:16:53.133194127 +0000 UTC" Jun 06 13:01:04.576698 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.576694 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12526h15m48.55650367s" Jun 06 13:01:04.604071 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:04.604043 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:04.604225 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:04.604156 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:04.677221 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.677192 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf062a081_814a_4807_bbfe_8ce70227ee56.slice/crio-ee4c646942c77965cd6da73b76cb962210fdd9045dc662a8ade5afcc625fd021 WatchSource:0}: Error finding container ee4c646942c77965cd6da73b76cb962210fdd9045dc662a8ade5afcc625fd021: Status 404 returned error can't find the container with id ee4c646942c77965cd6da73b76cb962210fdd9045dc662a8ade5afcc625fd021 Jun 06 13:01:04.678370 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.678344 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4f884b_e9c1_48cf_9567_31550adbb472.slice/crio-ed89f896240a7cb3334da92ff12b93c3ff62ca29bd675c224fb365cdffebfe7c WatchSource:0}: Error finding container ed89f896240a7cb3334da92ff12b93c3ff62ca29bd675c224fb365cdffebfe7c: Status 404 returned error can't find the container with id ed89f896240a7cb3334da92ff12b93c3ff62ca29bd675c224fb365cdffebfe7c Jun 06 13:01:04.679180 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.679157 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41e1b71_3298_4f81_9eb4_401701bd8f9e.slice/crio-7d321f97792d9cb57b85b236df00ff8f8219c7576706b5cffb43130664da7de0 WatchSource:0}: Error finding container 7d321f97792d9cb57b85b236df00ff8f8219c7576706b5cffb43130664da7de0: Status 404 returned error can't find the container with id 7d321f97792d9cb57b85b236df00ff8f8219c7576706b5cffb43130664da7de0 Jun 06 13:01:04.703426 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.703398 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f08586d_6a3f_4256_9ab4_30beab43d1af.slice/crio-f4f20681b01e58c6457067b66b02e033317021c570b35ce14daa88d123959911 WatchSource:0}: Error finding container f4f20681b01e58c6457067b66b02e033317021c570b35ce14daa88d123959911: Status 404 returned error can't find the container with id f4f20681b01e58c6457067b66b02e033317021c570b35ce14daa88d123959911 Jun 06 13:01:04.704164 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.704124 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ab0a67_e8b2_4b52_a2ad_89af7fbd9185.slice/crio-f15a68363d619f222f5f66e83290ac5cae1869421e011110f1e844d4076676dd WatchSource:0}: Error finding container f15a68363d619f222f5f66e83290ac5cae1869421e011110f1e844d4076676dd: Status 404 returned error can't find the container with id f15a68363d619f222f5f66e83290ac5cae1869421e011110f1e844d4076676dd Jun 06 13:01:04.705480 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.705457 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5b8420_d2a4_449b_ae91_72a21e6eec29.slice/crio-7ae773a694189e89ed8a3b83abc672e7c644f23879b44a13e4a4eb43a97e9034 WatchSource:0}: Error finding container 7ae773a694189e89ed8a3b83abc672e7c644f23879b44a13e4a4eb43a97e9034: Status 404 returned error can't find the container with id 7ae773a694189e89ed8a3b83abc672e7c644f23879b44a13e4a4eb43a97e9034 Jun 06 13:01:04.707245 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:04.707220 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb7f619_4064_4b96_9ea9_198868767200.slice/crio-811fefd041747b996a5a170898ccb17531c1cd1db9c6b5956bb0ede96279966b WatchSource:0}: Error finding container 811fefd041747b996a5a170898ccb17531c1cd1db9c6b5956bb0ede96279966b: Status 404 returned error can't find the container with id 811fefd041747b996a5a170898ccb17531c1cd1db9c6b5956bb0ede96279966b Jun 06 13:01:05.164642 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.164599 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:05.164801 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.164773 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:05.164904 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.164823 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:07.164811053 +0000 UTC m=+6.024893441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:05.265448 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.265360 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:05.265603 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.265506 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:05.265603 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.265571 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:07.265553936 +0000 UTC m=+6.125636330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:05.365718 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.365680 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:05.365906 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.365890 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:05.365964 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.365917 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:05.365964 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.365945 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:05.366117 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.366071 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:07.366040378 +0000 UTC m=+6.226122783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:05.577068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.576963 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 12:56:03 +0000 UTC" deadline="2028-02-08 08:41:40.949223109 +0000 UTC" Jun 06 13:01:05.577068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.577019 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14683h40m35.372209612s" Jun 06 13:01:05.610143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.609164 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:05.610143 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.609302 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:05.610143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.609751 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:05.610143 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:05.609880 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:05.625630 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.625595 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxqt8" event={"ID":"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185","Type":"ContainerStarted","Data":"f15a68363d619f222f5f66e83290ac5cae1869421e011110f1e844d4076676dd"} Jun 06 13:01:05.633390 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.633259 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8b82" event={"ID":"6e4f884b-e9c1-48cf-9567-31550adbb472","Type":"ContainerStarted","Data":"ed89f896240a7cb3334da92ff12b93c3ff62ca29bd675c224fb365cdffebfe7c"} Jun 06 13:01:05.639905 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.639774 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" event={"ID":"a41e1b71-3298-4f81-9eb4-401701bd8f9e","Type":"ContainerStarted","Data":"7d321f97792d9cb57b85b236df00ff8f8219c7576706b5cffb43130664da7de0"} Jun 06 13:01:05.642715 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.642511 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kd4d2" event={"ID":"f062a081-814a-4807-bbfe-8ce70227ee56","Type":"ContainerStarted","Data":"ee4c646942c77965cd6da73b76cb962210fdd9045dc662a8ade5afcc625fd021"} Jun 06 13:01:05.648863 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.648242 2550 generic.go:356] "Generic (PLEG): container finished" podID="833357b11920ae9dbcd4511ba1a256b0" containerID="25287e2d8e25e50ae68d6e74d07c53fb7044ced6aa3e3d1cfb386153297f31dd" exitCode=0 Jun 06 13:01:05.648863 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.648371 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"833357b11920ae9dbcd4511ba1a256b0","Type":"ContainerDied","Data":"25287e2d8e25e50ae68d6e74d07c53fb7044ced6aa3e3d1cfb386153297f31dd"} Jun 06 13:01:05.664693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.664632 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" event={"ID":"4cb7f619-4064-4b96-9ea9-198868767200","Type":"ContainerStarted","Data":"811fefd041747b996a5a170898ccb17531c1cd1db9c6b5956bb0ede96279966b"} Jun 06 13:01:05.691123 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.691087 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerStarted","Data":"7ae773a694189e89ed8a3b83abc672e7c644f23879b44a13e4a4eb43a97e9034"} Jun 06 13:01:05.696047 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.695915 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"f4f20681b01e58c6457067b66b02e033317021c570b35ce14daa88d123959911"} Jun 06 13:01:05.718511 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.718474 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" event={"ID":"bf10e953d29a0f873f55d3801011922b","Type":"ContainerStarted","Data":"ef7d58484d1c4f79fcc26e0c42230f1862f31bb53b29109cfc769626748a87bb"} Jun 06 13:01:05.734011 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.733960 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kn46z" event={"ID":"812616d7-e431-4994-9d41-36a329a8aa27","Type":"ContainerStarted","Data":"92ffcbfee4a8898ddd743be0f23c1afa9f05ba5b7707dc1e26a2046f14e8fa09"} Jun 06 13:01:05.745301 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:05.742977 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7m48" event={"ID":"ace926ca-223f-40fa-b0c8-eb86c9118d76","Type":"ContainerStarted","Data":"5ed0f9afad02e32ef5c033f55d568a4633d2ce1bc023e5f781a47bbb3b6c295d"} Jun 06 13:01:06.604326 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:06.603830 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:06.604326 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:06.603968 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:06.751700 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:06.751604 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"833357b11920ae9dbcd4511ba1a256b0","Type":"ContainerStarted","Data":"701292c504d45dc601679432b60bebb8c7fa59c998c6c1f19d2675c9e9369b37"} Jun 06 13:01:06.766171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:06.765053 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" podStartSLOduration=4.765035539 podStartE2EDuration="4.765035539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:05.737523358 +0000 UTC m=+4.597605767" watchObservedRunningTime="2026-06-06 13:01:06.765035539 +0000 UTC m=+5.625117949" Jun 06 13:01:07.182926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:07.182743 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:07.182926 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.182890 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:07.183192 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.182966 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:11.182933405 +0000 UTC m=+10.043015797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:07.283835 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:07.283798 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:07.284019 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.283948 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:07.284078 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.284033 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:11.284009236 +0000 UTC m=+10.144091623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:07.385019 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:07.384850 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:07.385194 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.385084 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:07.385194 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.385111 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:07.385194 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.385123 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:07.385194 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.385178 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:11.385161761 +0000 UTC m=+10.245244163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:07.603935 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:07.603836 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:07.604106 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.604006 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:07.604106 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:07.604024 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:07.604216 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:07.604139 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:08.603581 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:08.603545 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:08.604054 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:08.603687 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:09.609828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:09.606850 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:09.609828 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:09.607060 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:09.609828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:09.607259 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:09.609828 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:09.607396 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:10.604085 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:10.603916 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:10.604085 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:10.604061 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:11.219943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:11.219877 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:11.220405 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.220034 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:11.220405 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.220103 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:19.22008016 +0000 UTC m=+18.080162550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:11.321137 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:11.321103 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:11.321314 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.321267 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:11.321379 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.321333 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:19.321314981 +0000 UTC m=+18.181397384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:11.422621 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:11.421873 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:11.422621 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.422162 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:11.422621 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.422186 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:11.422621 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.422199 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:11.422621 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.422256 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:19.422235956 +0000 UTC m=+18.282318350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:11.607402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:11.607325 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:11.607552 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.607445 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:11.607841 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:11.607820 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:11.607957 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:11.607936 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:12.604022 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:12.603538 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:12.604022 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:12.603669 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:13.604358 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:13.604321 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:13.604799 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:13.604321 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:13.604799 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:13.604475 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:13.604799 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:13.604543 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:14.604454 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:14.604421 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:14.604907 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:14.604551 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:15.604345 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:15.604317 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:15.604528 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:15.604440 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:15.604528 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:15.604475 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:15.604918 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:15.604534 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:16.603704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:16.603678 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:16.603895 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:16.603795 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:17.604226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:17.604188 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:17.604687 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:17.604321 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:17.604687 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:17.604382 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:17.604687 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:17.604480 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:18.604519 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:18.604486 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:18.604880 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:18.604590 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:19.287999 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:19.287713 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:19.288265 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.287868 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:19.288265 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.288101 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:35.288075334 +0000 UTC m=+34.148157726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:19.388486 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:19.388449 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:19.388654 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.388619 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:19.388714 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.388694 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:35.388674974 +0000 UTC m=+34.248757369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:19.488862 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:19.488819 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:19.489055 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.489032 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:19.489113 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.489062 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:19.489113 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.489073 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:19.489192 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.489135 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:01:35.489116174 +0000 UTC m=+34.349198566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:19.603673 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:19.603598 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:19.603825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:19.603601 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:19.603825 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.603730 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:19.603825 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:19.603809 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:20.603892 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:20.603855 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:20.604376 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:20.603975 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:21.605233 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:21.605198 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:21.605674 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:21.605319 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:21.605674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:21.605375 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:21.605674 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:21.605451 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:22.603618 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:22.603586 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:22.603787 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:22.603696 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:23.604412 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.604367 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:23.605138 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:23.604519 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:23.605138 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.604792 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:23.605138 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:23.604881 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:23.785460 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.785287 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kn46z" event={"ID":"812616d7-e431-4994-9d41-36a329a8aa27","Type":"ContainerStarted","Data":"b4fa75f6180468095aa387c2a5b8c6996d28c3897c7ea679a2d4c1a640229cc3"} Jun 06 13:01:23.786565 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.786545 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7m48" event={"ID":"ace926ca-223f-40fa-b0c8-eb86c9118d76","Type":"ContainerStarted","Data":"507ee65af671e80cdd1e45e4dd4f3c6cfdbb4398dbfe2e74c0f4dfe74777446e"} Jun 06 13:01:23.787749 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.787728 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxqt8" event={"ID":"04ab0a67-e8b2-4b52-a2ad-89af7fbd9185","Type":"ContainerStarted","Data":"5036bd4d1f14a4e41e06723e13daea2c31fd69237f0a657afbc3e9bc5ecae17b"} Jun 06 13:01:23.788847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.788827 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8b82" event={"ID":"6e4f884b-e9c1-48cf-9567-31550adbb472","Type":"ContainerStarted","Data":"d06efb58bcd7ea61d9a2494d529308e4ed5f9c45728e06f8771ff1e01b70a0db"} Jun 06 13:01:23.790113 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.790095 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" event={"ID":"a41e1b71-3298-4f81-9eb4-401701bd8f9e","Type":"ContainerStarted","Data":"5e2e30958256081cab479d0efa1449a2753544fb7bc49ca49b62c86f89565e60"} Jun 06 13:01:23.791345 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.791326 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" event={"ID":"4cb7f619-4064-4b96-9ea9-198868767200","Type":"ContainerStarted","Data":"99e9292c3b0f8f69ed2f6d2a118bf56c7d4af3ddaa4408ab74077f810647c4e5"} Jun 06 13:01:23.792834 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.792813 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="85b8c7e7e3c22fa5e5b2e58b3ab45817c44ea40b59c76b72089fab19f8da9095" exitCode=0 Jun 06 13:01:23.792925 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.792874 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"85b8c7e7e3c22fa5e5b2e58b3ab45817c44ea40b59c76b72089fab19f8da9095"} Jun 06 13:01:23.796446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.794489 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:01:23.796446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.795756 2550 generic.go:356] "Generic (PLEG): container finished" podID="2f08586d-6a3f-4256-9ab4-30beab43d1af" containerID="f0335b293d9f6415123eb749ed59f4b907a61ddd85b15a0e0cab6271f83fc328" exitCode=1 Jun 06 13:01:23.796446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.795789 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerDied","Data":"f0335b293d9f6415123eb749ed59f4b907a61ddd85b15a0e0cab6271f83fc328"} Jun 06 13:01:23.796446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.795855 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"4eb8a536fad4fd6949b3d2b9df15f89b606bcc74d17eb3714a3de7ca4564a867"} Jun 06 13:01:23.806563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.806528 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" podStartSLOduration=21.806514413 podStartE2EDuration="21.806514413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:06.766138596 +0000 UTC m=+5.626221009" watchObservedRunningTime="2026-06-06 13:01:23.806514413 +0000 UTC m=+22.666596824" Jun 06 13:01:23.820253 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.820215 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sxqt8" podStartSLOduration=4.286450209 podStartE2EDuration="22.820203518s" totalImagesPullingTime="18.533753309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:23.820136149 +0000 UTC m=+22.680218560" watchObservedRunningTime="2026-06-06 13:01:23.820203518 +0000 UTC m=+22.680285928" Jun 06 13:01:23.820441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.820416 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kn46z" podStartSLOduration=3.292336612 podStartE2EDuration="21.820411795s" totalImagesPullingTime="18.528075183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:23.80658533 +0000 UTC m=+22.666667777" watchObservedRunningTime="2026-06-06 13:01:23.820411795 +0000 UTC m=+22.680494204" Jun 06 13:01:23.835278 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.835242 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9rc4b" podStartSLOduration=4.28785848 podStartE2EDuration="22.835229165s" totalImagesPullingTime="18.547370685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:23.835021878 +0000 UTC m=+22.695104305" watchObservedRunningTime="2026-06-06 13:01:23.835229165 +0000 UTC m=+22.695311597" Jun 06 13:01:23.868246 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.868197 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s8b82" podStartSLOduration=4.288582187 podStartE2EDuration="22.86817715s" totalImagesPullingTime="18.579594963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:23.850693318 +0000 UTC m=+22.710775727" watchObservedRunningTime="2026-06-06 13:01:23.86817715 +0000 UTC m=+22.728259561" Jun 06 13:01:23.894020 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:23.893963 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n7m48" podStartSLOduration=4.364547187 podStartE2EDuration="22.89394586s" totalImagesPullingTime="18.529398673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:23.868470879 +0000 UTC m=+22.728553309" watchObservedRunningTime="2026-06-06 13:01:23.89394586 +0000 UTC m=+22.754028269" Jun 06 13:01:24.345088 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.344977 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:24.345744 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.345721 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:24.604151 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.604077 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:24.604300 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:24.604215 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:24.791766 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.791619 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 13:01:24.799563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.799542 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" event={"ID":"a41e1b71-3298-4f81-9eb4-401701bd8f9e","Type":"ContainerStarted","Data":"95b743f610606b2ab2fa5166dc93e244ae1811e50751d164826189737b6ea4e8"} Jun 06 13:01:24.800872 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.800849 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kd4d2" event={"ID":"f062a081-814a-4807-bbfe-8ce70227ee56","Type":"ContainerStarted","Data":"4ed1f49f6f7437dc11e19055bc5c0f1da3e5880baeafb831b93b90830243d512"} Jun 06 13:01:24.803378 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.803364 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:01:24.803694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.803672 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"ba40376f67cfb98d98854e87954e9ada33df39d50ecf8ca2b3ec6f8206565338"} Jun 06 13:01:24.803777 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.803744 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"f2b571c825c64140d3c4a02a3521e93636756bfdd1889c3306fe4c9b4b6dba01"} Jun 06 13:01:24.803834 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.803777 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"81316a77d9ae548e7cdeef2cbd31cf740000dfccf4f2a796da0f923338435d84"} Jun 06 13:01:24.803834 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.803813 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"e3435c8a40f1ba3902f7c595c8be4e1b1bfa34232558cead442f51e521c6eea1"} Jun 06 13:01:24.817082 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:24.817047 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kd4d2" podStartSLOduration=4.044314385 podStartE2EDuration="22.817034405s" totalImagesPullingTime="18.77272002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:24.816624681 +0000 UTC m=+23.676707101" watchObservedRunningTime="2026-06-06 13:01:24.817034405 +0000 UTC m=+23.677116815" Jun 06 13:01:25.603752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.603719 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:25.603949 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:25.603847 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:25.603949 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.603898 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:25.604089 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:25.604029 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:25.617301 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.617219 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T13:01:24.791762322Z","UUID":"87188dbe-d1c1-4f8f-b829-453b03f9beef","Handler":null,"Name":"","Endpoint":""} Jun 06 13:01:25.618766 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.618746 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 13:01:25.618882 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.618785 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 13:01:25.806334 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:25.806310 2550 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 13:01:26.603755 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:26.603674 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:26.603906 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:26.603800 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:26.813015 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:26.812965 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" event={"ID":"a41e1b71-3298-4f81-9eb4-401701bd8f9e","Type":"ContainerStarted","Data":"41731ceab6d593297dbeee266b7c333711317b4d951ad17702875df6cab1bd12"} Jun 06 13:01:26.816865 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:26.816835 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:01:26.817310 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:26.817282 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"9101d7580eee093bd5729b9a08f6892a4ba74d0ff625d26dcc322e3fbd6f9b5e"} Jun 06 13:01:26.829880 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:26.829839 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g5r7" podStartSLOduration=5.111881653 podStartE2EDuration="25.829825714s" totalImagesPullingTime="20.717944061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:26.829243505 +0000 UTC m=+25.689325941" watchObservedRunningTime="2026-06-06 13:01:26.829825714 +0000 UTC m=+25.689908141" Jun 06 13:01:27.603913 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:27.603881 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:27.604112 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:27.603923 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:27.604112 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:27.604047 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:27.604231 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:27.604162 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:28.603881 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.603702 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:28.604508 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:28.603966 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:28.823498 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.823407 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="9089b889aeacc9df67f48821ec3dbf0c8b3e02eb02c8397bdfb81637df793186" exitCode=0 Jun 06 13:01:28.823663 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.823472 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"9089b889aeacc9df67f48821ec3dbf0c8b3e02eb02c8397bdfb81637df793186"} Jun 06 13:01:28.826969 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.826951 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:01:28.827348 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.827325 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"6237f140d15e5f9a8e1e117cc8b4e3a9f9e2ef3032f64a043488aee94efd20f7"} Jun 06 13:01:28.827638 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.827610 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:28.827729 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.827681 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:28.827831 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.827815 2550 scope.go:117] "RemoveContainer" containerID="f0335b293d9f6415123eb749ed59f4b907a61ddd85b15a0e0cab6271f83fc328" Jun 06 13:01:28.844255 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:28.844218 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:29.604629 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.604152 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:29.604629 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.604160 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:29.604629 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:29.604277 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:29.604629 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:29.604361 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:29.835758 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.835720 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="d11c60fdbd47dcd5da6bac8f9f9a2827d3cbfd9c614f401c82e4844c06e11ddd" exitCode=0 Jun 06 13:01:29.835758 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.835761 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"d11c60fdbd47dcd5da6bac8f9f9a2827d3cbfd9c614f401c82e4844c06e11ddd"} Jun 06 13:01:29.839797 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.839783 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:01:29.840192 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.840168 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" event={"ID":"2f08586d-6a3f-4256-9ab4-30beab43d1af","Type":"ContainerStarted","Data":"74ae79da914fee72d6fbb339b26e28190b595950c28bf3230e7da907eb2fa292"} Jun 06 13:01:29.840451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.840427 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:29.855145 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.855123 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:01:29.885177 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.885130 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" podStartSLOduration=9.055903932 podStartE2EDuration="27.885115409s" totalImagesPullingTime="18.829211477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:29.883582745 +0000 UTC m=+28.743665156" watchObservedRunningTime="2026-06-06 13:01:29.885115409 +0000 UTC m=+28.745197819" Jun 06 13:01:29.940438 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.940405 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:29.940574 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.940558 2550 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 13:01:29.941000 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:29.940962 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n7m48" Jun 06 13:01:30.292532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.292240 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9lb5w"] Jun 06 13:01:30.292681 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.292626 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:30.292766 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:30.292739 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:30.295093 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.295068 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2l27h"] Jun 06 13:01:30.295208 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.295182 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:30.295300 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:30.295257 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:30.295771 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.295749 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jgv9t"] Jun 06 13:01:30.295870 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.295849 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:30.295960 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:30.295935 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:30.844957 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.844918 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="3b51c39ca0ecadef42c02339218a1cdbb628adc3e422313a278cc9a415a43e36" exitCode=0 Jun 06 13:01:30.845409 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:30.845011 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"3b51c39ca0ecadef42c02339218a1cdbb628adc3e422313a278cc9a415a43e36"} Jun 06 13:01:31.605852 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:31.605822 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:31.606034 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:31.606012 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:31.606446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:31.606428 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:31.606571 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:31.606553 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:31.606623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:31.606600 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:31.606704 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:31.606685 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:33.604575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:33.604544 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:33.604575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:33.604576 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:33.605441 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:33.604675 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:33.605441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:33.604726 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:33.605441 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:33.604825 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:33.605441 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:33.604918 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:35.315657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.315618 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:35.316052 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.315761 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:35.316052 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.315837 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:07.315822866 +0000 UTC m=+66.175905254 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:35.416585 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.416560 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:35.416674 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.416662 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:35.416723 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.416713 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret podName:f4fce606-ff59-486c-aa72-d0b19bfa48b1 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:07.416698767 +0000 UTC m=+66.276781157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret") pod "global-pull-secret-syncer-9lb5w" (UID: "f4fce606-ff59-486c-aa72-d0b19bfa48b1") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:35.517197 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.517168 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:35.517337 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.517318 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:35.517387 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.517341 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:35.517387 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.517351 2550 projected.go:196] Error preparing data for projected volume kube-api-access-7fl2t for pod openshift-network-diagnostics/network-check-target-jgv9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:35.517459 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.517400 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t podName:e10c1903-61c8-46dc-ad06-0fd710da6fbb nodeName:}" failed. No retries permitted until 2026-06-06 13:02:07.517384648 +0000 UTC m=+66.377467041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fl2t" (UniqueName: "kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t") pod "network-check-target-jgv9t" (UID: "e10c1903-61c8-46dc-ad06-0fd710da6fbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:35.604395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.604157 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:35.604482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.604170 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:35.604526 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.604507 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jgv9t" podUID="e10c1903-61c8-46dc-ad06-0fd710da6fbb" Jun 06 13:01:35.604575 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.604557 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9lb5w" podUID="f4fce606-ff59-486c-aa72-d0b19bfa48b1" Jun 06 13:01:35.604624 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.604202 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:35.604677 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:35.604640 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:01:35.859653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.859579 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="1e11c8a533004a9b538ae4060733f9813a42243df3e224085705dadb45517552" exitCode=0 Jun 06 13:01:35.859653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.859625 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"1e11c8a533004a9b538ae4060733f9813a42243df3e224085705dadb45517552"} Jun 06 13:01:35.984948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.984926 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeReady" Jun 06 13:01:35.985088 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:35.985077 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 13:01:36.015354 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.015326 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:01:36.028456 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.028437 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.028635 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.028440 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bstc6"] Jun 06 13:01:36.030855 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.030833 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 13:01:36.031091 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.031059 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 13:01:36.031212 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.031112 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b82xj\"" Jun 06 13:01:36.031212 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.031156 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 13:01:36.037116 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.037099 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 13:01:36.038155 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.038137 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:01:36.038256 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.038173 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-56skw"] Jun 06 13:01:36.038312 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.038262 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.041146 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.040861 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 13:01:36.041146 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.041125 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9w2\"" Jun 06 13:01:36.041348 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.041332 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 13:01:36.044995 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.044965 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bstc6"] Jun 06 13:01:36.045073 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.045019 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56skw"] Jun 06 13:01:36.045073 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.045064 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.047444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.047426 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 13:01:36.047544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.047430 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 13:01:36.047544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.047520 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jgnwh\"" Jun 06 13:01:36.047544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.047522 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 13:01:36.122188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122109 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122140 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122160 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122176 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122234 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122279 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824sl\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122301 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.122376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.122324 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223401 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223368 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-824sl\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223401 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223401 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c058b0-a11a-450b-997e-78810d873a47-config-volume\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.223599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223418 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223438 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223489 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b934b99-dced-4990-a1bf-2f906fe62350-cert\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.223599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223515 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mb7\" (UniqueName: \"kubernetes.io/projected/5b934b99-dced-4990-a1bf-2f906fe62350-kube-api-access-t8mb7\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.223599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223583 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.223787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223712 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223857 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.223926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223887 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c058b0-a11a-450b-997e-78810d873a47-tmp-dir\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.223926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223909 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwcst\" (UniqueName: \"kubernetes.io/projected/b6c058b0-a11a-450b-997e-78810d873a47-kube-api-access-lwcst\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.224147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.223938 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.224147 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.224066 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:36.224147 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.224081 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:36.224147 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.224133 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:01:36.724117094 +0000 UTC m=+35.584199483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:36.224328 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.224250 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.224425 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.224400 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.224579 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.224562 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.227724 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.227704 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.227830 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.227726 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.231596 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.231577 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.231720 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.231686 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-824sl\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.324771 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.324733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b934b99-dced-4990-a1bf-2f906fe62350-cert\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.324771 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.324778 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mb7\" (UniqueName: \"kubernetes.io/projected/5b934b99-dced-4990-a1bf-2f906fe62350-kube-api-access-t8mb7\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.324825 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.324915 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c058b0-a11a-450b-997e-78810d873a47-tmp-dir\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.324954 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwcst\" (UniqueName: \"kubernetes.io/projected/b6c058b0-a11a-450b-997e-78810d873a47-kube-api-access-lwcst\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.325034 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.325055 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c058b0-a11a-450b-997e-78810d873a47-config-volume\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.325095 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:36.82507641 +0000 UTC m=+35.685158801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:36.325329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.325259 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c058b0-a11a-450b-997e-78810d873a47-tmp-dir\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.325586 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.325568 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c058b0-a11a-450b-997e-78810d873a47-config-volume\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.327228 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.327208 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b934b99-dced-4990-a1bf-2f906fe62350-cert\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.332578 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.332552 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwcst\" (UniqueName: \"kubernetes.io/projected/b6c058b0-a11a-450b-997e-78810d873a47-kube-api-access-lwcst\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.332671 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.332595 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mb7\" (UniqueName: \"kubernetes.io/projected/5b934b99-dced-4990-a1bf-2f906fe62350-kube-api-access-t8mb7\") pod \"ingress-canary-56skw\" (UID: \"5b934b99-dced-4990-a1bf-2f906fe62350\") " pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.391306 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.391245 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56skw" Jun 06 13:01:36.549826 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.549795 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56skw"] Jun 06 13:01:36.553570 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:01:36.553540 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b934b99_dced_4990_a1bf_2f906fe62350.slice/crio-777bab1177133115afcf8ca2b723a89ccc009aa3eb4d97d18d3c72872b1769f6 WatchSource:0}: Error finding container 777bab1177133115afcf8ca2b723a89ccc009aa3eb4d97d18d3c72872b1769f6: Status 404 returned error can't find the container with id 777bab1177133115afcf8ca2b723a89ccc009aa3eb4d97d18d3c72872b1769f6 Jun 06 13:01:36.561275 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.561250 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:36.650561 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.650459 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:36.727816 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.727784 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:36.727968 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.727901 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:36.727968 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.727912 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:36.727968 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.727956 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:01:37.727943899 +0000 UTC m=+36.588026287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:36.828616 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.828582 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:36.828770 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.828731 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:36.828820 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:36.828789 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:37.828774227 +0000 UTC m=+36.688856615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:36.865364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.865327 2550 generic.go:356] "Generic (PLEG): container finished" podID="ab5b8420-d2a4-449b-ae91-72a21e6eec29" containerID="61eeb028ae47efed7ac0576a2a7167a41d5c376daf31cf77ad2f44c8bfe3ce50" exitCode=0 Jun 06 13:01:36.865494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.865358 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerDied","Data":"61eeb028ae47efed7ac0576a2a7167a41d5c376daf31cf77ad2f44c8bfe3ce50"} Jun 06 13:01:36.866488 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.866465 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56skw" event={"ID":"5b934b99-dced-4990-a1bf-2f906fe62350","Type":"ContainerStarted","Data":"777bab1177133115afcf8ca2b723a89ccc009aa3eb4d97d18d3c72872b1769f6"} Jun 06 13:01:36.939569 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.939536 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:36.990369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:36.990220 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:37.604012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.603968 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:01:37.604575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.603968 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:01:37.604575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.603969 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:01:37.606930 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.606899 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.607070 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.606899 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.607934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.607913 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcwkx\"" Jun 06 13:01:37.608062 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.607965 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-brfnl\"" Jun 06 13:01:37.608062 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.607978 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:01:37.608173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.608063 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:01:37.736834 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.736806 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:37.737012 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:37.736914 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:37.737012 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:37.736926 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:37.737012 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:37.736972 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:01:39.736959557 +0000 UTC m=+38.597041945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:37.837787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.837745 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:37.837959 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:37.837899 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:37.838041 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:37.837963 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:39.837944208 +0000 UTC m=+38.698026596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:37.873030 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.872936 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" event={"ID":"ab5b8420-d2a4-449b-ae91-72a21e6eec29","Type":"ContainerStarted","Data":"22d40c98c55b497af3881a3f1d0b4602352d05633641147d6f3ab12ba8739466"} Jun 06 13:01:37.896306 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:37.896248 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lkk7d" podStartSLOduration=8.070405147 podStartE2EDuration="36.896228506s" totalImagesPullingTime="28.825823359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:37.89467757 +0000 UTC m=+36.754759999" watchObservedRunningTime="2026-06-06 13:01:37.896228506 +0000 UTC m=+36.756310917" Jun 06 13:01:38.013150 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:38.013119 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:38.113404 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:38.113371 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:38.213293 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:38.213205 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:39.752782 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:39.752746 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:39.753365 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:39.752890 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:39.753365 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:39.752907 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:39.753365 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:39.752965 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:01:43.752948209 +0000 UTC m=+42.613030597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:39.853081 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:39.853052 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:39.853209 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:39.853181 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:39.853247 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:39.853242 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:43.853227694 +0000 UTC m=+42.713310092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:39.879221 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:39.879191 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56skw" event={"ID":"5b934b99-dced-4990-a1bf-2f906fe62350","Type":"ContainerStarted","Data":"d379b72b0920d94eb6948ea9c977647e2e998914f64b927ae55ee18eae9d0135"} Jun 06 13:01:39.894168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:39.894117 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-56skw" podStartSLOduration=1.158365691 podStartE2EDuration="3.894102174s" totalImagesPullingTime="2.735736483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:39.892952753 +0000 UTC m=+38.753035184" watchObservedRunningTime="2026-06-06 13:01:39.894102174 +0000 UTC m=+38.754184585" Jun 06 13:01:41.852769 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:41.852731 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:41.901081 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:41.901048 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:43.258005 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:43.257959 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:43.304735 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:43.304704 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:43.776941 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:43.776898 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:43.777150 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:43.777048 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:43.777150 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:43.777062 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:43.777150 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:43.777126 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:01:51.777108784 +0000 UTC m=+50.637191189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:43.878097 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:43.878056 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:43.878257 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:43.878232 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:43.878327 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:43.878316 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:51.87829632 +0000 UTC m=+50.738378713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:51.051229 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:51.051196 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:51.100626 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:51.100566 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:51.830618 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:51.830579 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:01:51.830805 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:51.830698 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:01:51.830805 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:51.830711 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:01:51.830805 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:51.830758 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:02:07.830745784 +0000 UTC m=+66.690828171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:01:51.931251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:51.931210 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:01:51.931414 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:51.931332 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:01:51.931414 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:01:51.931384 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:07.931371387 +0000 UTC m=+66.791453775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:01:52.073571 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:52.073530 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:52.128671 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:52.128585 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:56.037845 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:56.037801 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:57.626728 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:57.626695 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:57.672739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:57.672715 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:58.618961 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:58.618925 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:01:58.665827 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:01:58.665792 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:01.857012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:01.856967 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lldq" Jun 06 13:02:02.005522 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:02.005482 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:02.109767 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:02.109692 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:03.315916 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:03.315879 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:03.416589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:03.416556 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:07.335976 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.335931 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:02:07.338931 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.338904 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:02:07.346755 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.346739 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:02:07.346814 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.346795 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:03:11.346779495 +0000 UTC m=+130.206861883 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : secret "metrics-daemon-secret" not found Jun 06 13:02:07.436906 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.436873 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:02:07.439265 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.439249 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:02:07.451242 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.451218 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4fce606-ff59-486c-aa72-d0b19bfa48b1-original-pull-secret\") pod \"global-pull-secret-syncer-9lb5w\" (UID: \"f4fce606-ff59-486c-aa72-d0b19bfa48b1\") " pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:02:07.537827 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.537792 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:02:07.540095 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.540073 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:02:07.550759 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.550733 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:02:07.561803 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.561772 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fl2t\" (UniqueName: \"kubernetes.io/projected/e10c1903-61c8-46dc-ad06-0fd710da6fbb-kube-api-access-7fl2t\") pod \"network-check-target-jgv9t\" (UID: \"e10c1903-61c8-46dc-ad06-0fd710da6fbb\") " pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:02:07.625281 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.625205 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-brfnl\"" Jun 06 13:02:07.629043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.629028 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9lb5w" Jun 06 13:02:07.633546 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.633530 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:02:07.774677 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.774647 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jgv9t"] Jun 06 13:02:07.777732 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:02:07.777708 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10c1903_61c8_46dc_ad06_0fd710da6fbb.slice/crio-074de2c0fa1cf187ce9fb3307d7617ca4b0f8da1f32e7dc87a26206900a755c8 WatchSource:0}: Error finding container 074de2c0fa1cf187ce9fb3307d7617ca4b0f8da1f32e7dc87a26206900a755c8: Status 404 returned error can't find the container with id 074de2c0fa1cf187ce9fb3307d7617ca4b0f8da1f32e7dc87a26206900a755c8 Jun 06 13:02:07.789013 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.788966 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9lb5w"] Jun 06 13:02:07.792850 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:02:07.792829 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fce606_ff59_486c_aa72_d0b19bfa48b1.slice/crio-dfcbb5203bab0dd7efa5014e3eebf175bb00a931322af636a0913fc2bf786629 WatchSource:0}: Error finding container dfcbb5203bab0dd7efa5014e3eebf175bb00a931322af636a0913fc2bf786629: Status 404 returned error can't find the container with id dfcbb5203bab0dd7efa5014e3eebf175bb00a931322af636a0913fc2bf786629 Jun 06 13:02:07.840237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.840212 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:02:07.840350 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.840326 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:02:07.840350 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.840339 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:02:07.840428 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.840418 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:02:39.840400783 +0000 UTC m=+98.700483172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:02:07.842955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.842929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:07.940670 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.940599 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:02:07.940795 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.940737 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:07.940839 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:07.940795 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:39.940779814 +0000 UTC m=+98.800862203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:02:07.944148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.944122 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:07.946890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.946860 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9lb5w" event={"ID":"f4fce606-ff59-486c-aa72-d0b19bfa48b1","Type":"ContainerStarted","Data":"dfcbb5203bab0dd7efa5014e3eebf175bb00a931322af636a0913fc2bf786629"} Jun 06 13:02:07.947893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:07.947876 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jgv9t" event={"ID":"e10c1903-61c8-46dc-ad06-0fd710da6fbb","Type":"ContainerStarted","Data":"074de2c0fa1cf187ce9fb3307d7617ca4b0f8da1f32e7dc87a26206900a755c8"} Jun 06 13:02:09.157232 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:09.157197 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:09.257137 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:09.257089 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:09.893367 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:09.893329 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:09.942603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:09.942565 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:12.962692 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:12.962645 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9lb5w" event={"ID":"f4fce606-ff59-486c-aa72-d0b19bfa48b1","Type":"ContainerStarted","Data":"82108fa76adaf6fab1738bce98675059bff22a7e5e2f9b69201752d51f4ac922"} Jun 06 13:02:12.964061 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:12.964039 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jgv9t" event={"ID":"e10c1903-61c8-46dc-ad06-0fd710da6fbb","Type":"ContainerStarted","Data":"b75982df0477ac7d3465cd8ffce0da6d1fce0357cf11563c81edda74576e5b54"} Jun 06 13:02:12.964169 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:12.964158 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:02:12.977259 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:12.977216 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9lb5w" podStartSLOduration=66.711796632 podStartE2EDuration="1m10.977203699s" totalImagesPullingTime="4.265407067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:12.975932952 +0000 UTC m=+71.836015373" watchObservedRunningTime="2026-06-06 13:02:12.977203699 +0000 UTC m=+71.837286109" Jun 06 13:02:12.988571 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:12.988530 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jgv9t" podStartSLOduration=66.711907382 podStartE2EDuration="1m10.988516427s" totalImagesPullingTime="4.276609045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:12.987971416 +0000 UTC m=+71.848053826" watchObservedRunningTime="2026-06-06 13:02:12.988516427 +0000 UTC m=+71.848598836" Jun 06 13:02:13.701594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:13.701557 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:13.753435 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:13.753400 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:14.212419 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:14.212389 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:14.314144 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:14.314098 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:29.143034 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:29.142887 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:29.197678 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:29.197649 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:35.629090 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:35.629045 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:35.679399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:35.679368 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:35.728440 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:35.728414 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:02:39.866503 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:39.866477 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:02:39.866860 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:39.866587 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:02:39.866860 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:39.866597 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:02:39.866860 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:39.866643 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:03:43.866630087 +0000 UTC m=+162.726712474 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:02:39.966888 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:39.966845 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:02:39.967065 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:39.967028 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:39.967136 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:02:39.967125 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:03:43.967103004 +0000 UTC m=+162.827185395 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:02:43.969112 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:02:43.969085 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jgv9t" Jun 06 13:03:11.385739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:11.385686 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:03:11.386285 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:11.385808 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:03:11.386285 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:11.385860 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs podName:c0adce35-ec50-4eba-89ba-88fde6e1ea16 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:13.385846727 +0000 UTC m=+252.245929115 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs") pod "network-metrics-daemon-2l27h" (UID: "c0adce35-ec50-4eba-89ba-88fde6e1ea16") : secret "metrics-daemon-secret" not found Jun 06 13:03:39.081577 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:39.081538 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" podUID="7a83b9db-3de2-4638-947a-567751343ebe" Jun 06 13:03:39.086833 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:39.086801 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bstc6" podUID="b6c058b0-a11a-450b-997e-78810d873a47" Jun 06 13:03:39.165770 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:39.165742 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bstc6" Jun 06 13:03:39.165893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:39.165743 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:03:40.615385 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:40.615345 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2l27h" podUID="c0adce35-ec50-4eba-89ba-88fde6e1ea16" Jun 06 13:03:43.917310 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:43.917265 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:03:43.917764 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:43.917427 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:03:43.917764 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:43.917446 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g: secret "image-registry-tls" not found Jun 06 13:03:43.917764 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:43.917524 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls podName:7a83b9db-3de2-4638-947a-567751343ebe nodeName:}" failed. No retries permitted until 2026-06-06 13:05:45.917506806 +0000 UTC m=+284.777589193 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls") pod "image-registry-6bdbc7c8cf-2pn6g" (UID: "7a83b9db-3de2-4638-947a-567751343ebe") : secret "image-registry-tls" not found Jun 06 13:03:44.018518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:44.018478 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:03:44.018688 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:44.018590 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:03:44.018688 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:03:44.018637 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls podName:b6c058b0-a11a-450b-997e-78810d873a47 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:46.018625259 +0000 UTC m=+284.878707648 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls") pod "dns-default-bstc6" (UID: "b6c058b0-a11a-450b-997e-78810d873a47") : secret "dns-default-metrics-tls" not found Jun 06 13:03:55.604051 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:03:55.603951 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:04:20.768675 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:20.768641 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:40.686644 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.686613 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s"] Jun 06 13:04:40.689457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.689435 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b"] Jun 06 13:04:40.689578 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.689558 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.692305 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.692285 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.693222 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.693109 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 06 13:04:40.694226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694198 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9bw9p\"" Jun 06 13:04:40.694226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694213 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.694378 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694317 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 06 13:04:40.694455 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694436 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 13:04:40.694505 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694464 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.694551 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.694543 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.695193 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.695175 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-wlpwq"] Jun 06 13:04:40.695438 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.695405 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.695438 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.695418 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z7sr7\"" Jun 06 13:04:40.697763 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.697748 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9"] Jun 06 13:04:40.697885 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.697869 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.700277 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700257 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 13:04:40.700529 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700504 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8"] Jun 06 13:04:40.700627 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700594 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-56wch\"" Jun 06 13:04:40.700627 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700595 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.700736 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700677 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.700736 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700594 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 13:04:40.700898 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.700886 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.703752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.703334 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s"] Jun 06 13:04:40.703752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.703419 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" Jun 06 13:04:40.703752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.703513 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 06 13:04:40.703752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.703590 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 06 13:04:40.704019 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.703965 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-94pd4\"" Jun 06 13:04:40.704090 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.704059 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.704169 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.704127 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.704593 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.704574 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b"] Jun 06 13:04:40.706446 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.706428 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wwtm6\"" Jun 06 13:04:40.706844 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.706824 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 13:04:40.707327 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.707311 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wlpwq"] Jun 06 13:04:40.712691 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.712670 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9"] Jun 06 13:04:40.715322 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.715302 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8"] Jun 06 13:04:40.790458 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790426 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w"] Jun 06 13:04:40.790668 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790644 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f72p\" (UniqueName: \"kubernetes.io/projected/a91a650a-da4f-48f1-a1bf-4a6b4600e94b-kube-api-access-2f72p\") pod \"network-check-source-dbd9cf844-f5mh8\" (UID: \"a91a650a-da4f-48f1-a1bf-4a6b4600e94b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" Jun 06 13:04:40.790733 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790696 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xmtz\" (UniqueName: \"kubernetes.io/projected/46fe47ac-f3fb-415a-aa34-bdef9aac279c-kube-api-access-7xmtz\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.790793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790751 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46fe47ac-f3fb-415a-aa34-bdef9aac279c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.790843 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790802 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad949d75-ea87-4266-a0db-3b853235aedf-serving-cert\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.790886 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790848 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-trusted-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.790946 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790907 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g85m\" (UniqueName: \"kubernetes.io/projected/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-kube-api-access-4g85m\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.791019 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.790942 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-tmp\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.791079 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791035 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.791079 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-service-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.791153 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791109 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdv9p\" (UniqueName: \"kubernetes.io/projected/ad949d75-ea87-4266-a0db-3b853235aedf-kube-api-access-mdv9p\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.791153 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791139 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fe47ac-f3fb-415a-aa34-bdef9aac279c-config\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.791223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791191 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.791265 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791221 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-snapshots\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.791299 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791272 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp4mz\" (UniqueName: \"kubernetes.io/projected/3cdae424-db3e-4271-8444-e3725e89086f-kube-api-access-wp4mz\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.791339 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.791298 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.793528 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.793514 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.796076 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.796053 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 06 13:04:40.796076 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.796066 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-95msc\"" Jun 06 13:04:40.796597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.796580 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.796672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.796583 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 06 13:04:40.796851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.796836 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.808174 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.808154 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w"] Jun 06 13:04:40.892649 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892613 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.892649 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892648 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-service-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892671 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdv9p\" (UniqueName: \"kubernetes.io/projected/ad949d75-ea87-4266-a0db-3b853235aedf-kube-api-access-mdv9p\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892687 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fe47ac-f3fb-415a-aa34-bdef9aac279c-config\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892706 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:40.892776 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:40.892857 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls podName:3cdae424-db3e-4271-8444-e3725e89086f nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.392839572 +0000 UTC m=+220.252921979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qgp6b" (UID: "3cdae424-db3e-4271-8444-e3725e89086f") : secret "samples-operator-tls" not found Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.892907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892902 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-snapshots\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.892959 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp4mz\" (UniqueName: \"kubernetes.io/projected/3cdae424-db3e-4271-8444-e3725e89086f-kube-api-access-wp4mz\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:40.892998 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893024 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:40.893060 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls podName:a19efd4e-8f57-4585-ba4e-a1b8f8d88331 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.393045418 +0000 UTC m=+220.253127808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcn7s" (UID: "a19efd4e-8f57-4585-ba4e-a1b8f8d88331") : secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893080 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd72\" (UniqueName: \"kubernetes.io/projected/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-kube-api-access-brd72\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893127 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f72p\" (UniqueName: \"kubernetes.io/projected/a91a650a-da4f-48f1-a1bf-4a6b4600e94b-kube-api-access-2f72p\") pod \"network-check-source-dbd9cf844-f5mh8\" (UID: \"a91a650a-da4f-48f1-a1bf-4a6b4600e94b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893152 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893182 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xmtz\" (UniqueName: \"kubernetes.io/projected/46fe47ac-f3fb-415a-aa34-bdef9aac279c-kube-api-access-7xmtz\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893208 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46fe47ac-f3fb-415a-aa34-bdef9aac279c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893247 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad949d75-ea87-4266-a0db-3b853235aedf-serving-cert\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893274 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-trusted-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893315 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g85m\" (UniqueName: \"kubernetes.io/projected/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-kube-api-access-4g85m\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893333 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-service-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893342 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-tmp\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.893380 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893331 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fe47ac-f3fb-415a-aa34-bdef9aac279c-config\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.894198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893597 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-snapshots\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.894198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893616 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad949d75-ea87-4266-a0db-3b853235aedf-tmp\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.894198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.893773 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.894198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.894128 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad949d75-ea87-4266-a0db-3b853235aedf-trusted-ca-bundle\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.895533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.895515 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46fe47ac-f3fb-415a-aa34-bdef9aac279c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.895580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.895531 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad949d75-ea87-4266-a0db-3b853235aedf-serving-cert\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.907267 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.907239 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp4mz\" (UniqueName: \"kubernetes.io/projected/3cdae424-db3e-4271-8444-e3725e89086f-kube-api-access-wp4mz\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:40.909900 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.909879 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xmtz\" (UniqueName: \"kubernetes.io/projected/46fe47ac-f3fb-415a-aa34-bdef9aac279c-kube-api-access-7xmtz\") pod \"service-ca-operator-6bc5ff68f5-54xm9\" (UID: \"46fe47ac-f3fb-415a-aa34-bdef9aac279c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:40.910232 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.910207 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdv9p\" (UniqueName: \"kubernetes.io/projected/ad949d75-ea87-4266-a0db-3b853235aedf-kube-api-access-mdv9p\") pod \"insights-operator-896549976-wlpwq\" (UID: \"ad949d75-ea87-4266-a0db-3b853235aedf\") " pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:40.910427 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.910401 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f72p\" (UniqueName: \"kubernetes.io/projected/a91a650a-da4f-48f1-a1bf-4a6b4600e94b-kube-api-access-2f72p\") pod \"network-check-source-dbd9cf844-f5mh8\" (UID: \"a91a650a-da4f-48f1-a1bf-4a6b4600e94b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" Jun 06 13:04:40.910530 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.910407 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g85m\" (UniqueName: \"kubernetes.io/projected/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-kube-api-access-4g85m\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:40.924420 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.924398 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:40.976414 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.976336 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:40.994490 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.994460 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.994609 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.994529 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brd72\" (UniqueName: \"kubernetes.io/projected/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-kube-api-access-brd72\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.994609 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.994575 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.995152 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.995132 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:40.996696 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:40.996679 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:41.003341 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.003321 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd72\" (UniqueName: \"kubernetes.io/projected/6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb-kube-api-access-brd72\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7d55w\" (UID: \"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:41.015541 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.015511 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" Jun 06 13:04:41.023812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.023796 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wlpwq" Jun 06 13:04:41.027563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.027544 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" Jun 06 13:04:41.106447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.106413 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" Jun 06 13:04:41.163294 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.163267 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9"] Jun 06 13:04:41.166041 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:41.165994 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fe47ac_f3fb_415a_aa34_bdef9aac279c.slice/crio-421aa3a60f3cb20be0e6ae76f87eca980820d02a62aa35405d414ebd2cbdbde6 WatchSource:0}: Error finding container 421aa3a60f3cb20be0e6ae76f87eca980820d02a62aa35405d414ebd2cbdbde6: Status 404 returned error can't find the container with id 421aa3a60f3cb20be0e6ae76f87eca980820d02a62aa35405d414ebd2cbdbde6 Jun 06 13:04:41.232782 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.232715 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w"] Jun 06 13:04:41.235478 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:41.235451 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a230fb2_9d92_4f8d_bf56_a9ac5a4338cb.slice/crio-494932e0c3bc809815f3834bf53d0912baf2e322a9d749281e375a8bd6a81a6f WatchSource:0}: Error finding container 494932e0c3bc809815f3834bf53d0912baf2e322a9d749281e375a8bd6a81a6f: Status 404 returned error can't find the container with id 494932e0c3bc809815f3834bf53d0912baf2e322a9d749281e375a8bd6a81a6f Jun 06 13:04:41.310423 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.310380 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" event={"ID":"46fe47ac-f3fb-415a-aa34-bdef9aac279c","Type":"ContainerStarted","Data":"421aa3a60f3cb20be0e6ae76f87eca980820d02a62aa35405d414ebd2cbdbde6"} Jun 06 13:04:41.311341 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.311320 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" event={"ID":"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb","Type":"ContainerStarted","Data":"494932e0c3bc809815f3834bf53d0912baf2e322a9d749281e375a8bd6a81a6f"} Jun 06 13:04:41.383802 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.383723 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8"] Jun 06 13:04:41.384912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.384800 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wlpwq"] Jun 06 13:04:41.387181 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:41.387156 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad949d75_ea87_4266_a0db_3b853235aedf.slice/crio-5cc36c590b23aee9699a69abc72e4e7d8a243d868e615511faa11e8bc1474a56 WatchSource:0}: Error finding container 5cc36c590b23aee9699a69abc72e4e7d8a243d868e615511faa11e8bc1474a56: Status 404 returned error can't find the container with id 5cc36c590b23aee9699a69abc72e4e7d8a243d868e615511faa11e8bc1474a56 Jun 06 13:04:41.387708 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:41.387665 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91a650a_da4f_48f1_a1bf_4a6b4600e94b.slice/crio-8e5d37d06aed47337fc260e9329991a6aa70f5e74da45fc4ce2ffde2cfa050e4 WatchSource:0}: Error finding container 8e5d37d06aed47337fc260e9329991a6aa70f5e74da45fc4ce2ffde2cfa050e4: Status 404 returned error can't find the container with id 8e5d37d06aed47337fc260e9329991a6aa70f5e74da45fc4ce2ffde2cfa050e4 Jun 06 13:04:41.398182 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.398157 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:41.398263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:41.398214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:41.398334 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:41.398276 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:04:41.398334 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:41.398318 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls podName:3cdae424-db3e-4271-8444-e3725e89086f nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.398304463 +0000 UTC m=+221.258386851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qgp6b" (UID: "3cdae424-db3e-4271-8444-e3725e89086f") : secret "samples-operator-tls" not found Jun 06 13:04:41.398447 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:41.398362 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:41.398447 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:41.398424 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls podName:a19efd4e-8f57-4585-ba4e-a1b8f8d88331 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.398404507 +0000 UTC m=+221.258486914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcn7s" (UID: "a19efd4e-8f57-4585-ba4e-a1b8f8d88331") : secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:42.316729 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.316641 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" event={"ID":"a91a650a-da4f-48f1-a1bf-4a6b4600e94b","Type":"ContainerStarted","Data":"2cb80835cb0eb385c6a9b7284a973471e6c7e946d6db5e1745ae8c89ccd7f7e2"} Jun 06 13:04:42.316729 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.316696 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" event={"ID":"a91a650a-da4f-48f1-a1bf-4a6b4600e94b","Type":"ContainerStarted","Data":"8e5d37d06aed47337fc260e9329991a6aa70f5e74da45fc4ce2ffde2cfa050e4"} Jun 06 13:04:42.318495 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.318467 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wlpwq" event={"ID":"ad949d75-ea87-4266-a0db-3b853235aedf","Type":"ContainerStarted","Data":"5cc36c590b23aee9699a69abc72e4e7d8a243d868e615511faa11e8bc1474a56"} Jun 06 13:04:42.331787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.331734 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f5mh8" podStartSLOduration=2.331716168 podStartE2EDuration="2.331716168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:42.331532319 +0000 UTC m=+221.191614731" watchObservedRunningTime="2026-06-06 13:04:42.331716168 +0000 UTC m=+221.191798580" Jun 06 13:04:42.406377 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.406341 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:42.406569 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:42.406403 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:42.406569 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:42.406505 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:04:42.406686 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:42.406580 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls podName:3cdae424-db3e-4271-8444-e3725e89086f nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.406558919 +0000 UTC m=+223.266641324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qgp6b" (UID: "3cdae424-db3e-4271-8444-e3725e89086f") : secret "samples-operator-tls" not found Jun 06 13:04:42.406874 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:42.406854 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:42.406953 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:42.406923 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls podName:a19efd4e-8f57-4585-ba4e-a1b8f8d88331 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.40690556 +0000 UTC m=+223.266987965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcn7s" (UID: "a19efd4e-8f57-4585-ba4e-a1b8f8d88331") : secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:43.016195 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:43.016149 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:43.062494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:43.062458 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:44.326433 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.326386 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" event={"ID":"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb","Type":"ContainerStarted","Data":"3e1d9a5c8304331a599c048517ccf7e8126ff3465a16f4340aed047450f0c669"} Jun 06 13:04:44.328129 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.328088 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" event={"ID":"46fe47ac-f3fb-415a-aa34-bdef9aac279c","Type":"ContainerStarted","Data":"38f47a912bf4d9dabc0cb426422986ce48310c3d4a31479fd4b70e9b8a538c53"} Jun 06 13:04:44.330826 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.330777 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wlpwq" event={"ID":"ad949d75-ea87-4266-a0db-3b853235aedf","Type":"ContainerStarted","Data":"3d4f820b7b1e047ce3a734fe70338b1e705f5bc1b01a5700f97d5354abfc3c38"} Jun 06 13:04:44.341325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.341273 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" podStartSLOduration=1.384339149 podStartE2EDuration="4.341255902s" totalImagesPullingTime="2.956916753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:44.340290103 +0000 UTC m=+223.200372537" watchObservedRunningTime="2026-06-06 13:04:44.341255902 +0000 UTC m=+223.201338313" Jun 06 13:04:44.382494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.382445 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-wlpwq" podStartSLOduration=1.574620219 podStartE2EDuration="4.382426673s" totalImagesPullingTime="2.807806454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:44.381270853 +0000 UTC m=+223.241353264" watchObservedRunningTime="2026-06-06 13:04:44.382426673 +0000 UTC m=+223.242509078" Jun 06 13:04:44.396109 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.396067 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" podStartSLOduration=1.364455875 podStartE2EDuration="4.396054303s" totalImagesPullingTime="3.031598428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:44.394960533 +0000 UTC m=+223.255042942" watchObservedRunningTime="2026-06-06 13:04:44.396054303 +0000 UTC m=+223.256136712" Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.423421 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:44.424055 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:44.424113 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls podName:3cdae424-db3e-4271-8444-e3725e89086f nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.424095555 +0000 UTC m=+227.284177942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qgp6b" (UID: "3cdae424-db3e-4271-8444-e3725e89086f") : secret "samples-operator-tls" not found Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:44.424169 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:44.424319 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:44.424673 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:44.424360 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls podName:a19efd4e-8f57-4585-ba4e-a1b8f8d88331 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.424348565 +0000 UTC m=+227.284430957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcn7s" (UID: "a19efd4e-8f57-4585-ba4e-a1b8f8d88331") : secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:45.377819 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.377782 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:45.486139 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.486108 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:45.579148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.579111 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:45.628133 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.628062 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:45.809549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.809513 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:45.968751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:45.968675 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:46.082748 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:46.082718 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:46.183797 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:46.183765 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:47.681554 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.681515 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-76rw7"] Jun 06 13:04:47.684499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.684482 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.687868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.686976 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 06 13:04:47.687868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.687353 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 06 13:04:47.687868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.687796 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 06 13:04:47.688110 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.688075 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mrbh9\"" Jun 06 13:04:47.689608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.689492 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 06 13:04:47.693201 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.693158 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-76rw7"] Jun 06 13:04:47.717856 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.717834 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:47.770158 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.770129 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:47.850373 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.850341 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b366097f-c5e8-483c-b886-4d82cf867bee-signing-cabundle\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.850494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.850465 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9m4b\" (UniqueName: \"kubernetes.io/projected/b366097f-c5e8-483c-b886-4d82cf867bee-kube-api-access-p9m4b\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.850550 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.850521 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b366097f-c5e8-483c-b886-4d82cf867bee-signing-key\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.951148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.951074 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9m4b\" (UniqueName: \"kubernetes.io/projected/b366097f-c5e8-483c-b886-4d82cf867bee-kube-api-access-p9m4b\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.951148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.951114 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b366097f-c5e8-483c-b886-4d82cf867bee-signing-key\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.951148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.951145 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b366097f-c5e8-483c-b886-4d82cf867bee-signing-cabundle\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.951871 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.951854 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b366097f-c5e8-483c-b886-4d82cf867bee-signing-cabundle\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.953568 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.953547 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b366097f-c5e8-483c-b886-4d82cf867bee-signing-key\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.960736 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.960716 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9m4b\" (UniqueName: \"kubernetes.io/projected/b366097f-c5e8-483c-b886-4d82cf867bee-kube-api-access-p9m4b\") pod \"service-ca-7d74d578b8-76rw7\" (UID: \"b366097f-c5e8-483c-b886-4d82cf867bee\") " pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:47.995910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:47.995877 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" Jun 06 13:04:48.057202 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.057166 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:48.116077 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.116043 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-76rw7"] Jun 06 13:04:48.118944 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:48.118917 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb366097f_c5e8_483c_b886_4d82cf867bee.slice/crio-7ec510d0d8eba6bd7990e7ae0259c4b934bbd0be4692851ae49ed65b777e8071 WatchSource:0}: Error finding container 7ec510d0d8eba6bd7990e7ae0259c4b934bbd0be4692851ae49ed65b777e8071: Status 404 returned error can't find the container with id 7ec510d0d8eba6bd7990e7ae0259c4b934bbd0be4692851ae49ed65b777e8071 Jun 06 13:04:48.344853 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.344820 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" event={"ID":"b366097f-c5e8-483c-b886-4d82cf867bee","Type":"ContainerStarted","Data":"13fa15699baec2f20d99dfcc4eabe42be6f21c1fb462e1a38e796664cf0edb9b"} Jun 06 13:04:48.345058 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.344867 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" event={"ID":"b366097f-c5e8-483c-b886-4d82cf867bee","Type":"ContainerStarted","Data":"7ec510d0d8eba6bd7990e7ae0259c4b934bbd0be4692851ae49ed65b777e8071"} Jun 06 13:04:48.362184 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.362123 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-76rw7" podStartSLOduration=1.3621098090000001 podStartE2EDuration="1.362109809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:48.361276291 +0000 UTC m=+227.221358747" watchObservedRunningTime="2026-06-06 13:04:48.362109809 +0000 UTC m=+227.222192219" Jun 06 13:04:48.390745 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.390720 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:48.455918 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.455885 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:48.456075 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.455933 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:48.456136 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:48.456076 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:48.456136 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:48.456107 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:04:48.456232 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:48.456146 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls podName:a19efd4e-8f57-4585-ba4e-a1b8f8d88331 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.4561275 +0000 UTC m=+235.316209902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcn7s" (UID: "a19efd4e-8f57-4585-ba4e-a1b8f8d88331") : secret "cluster-monitoring-operator-tls" not found Jun 06 13:04:48.456232 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:04:48.456166 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls podName:3cdae424-db3e-4271-8444-e3725e89086f nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.456156581 +0000 UTC m=+235.316238973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qgp6b" (UID: "3cdae424-db3e-4271-8444-e3725e89086f") : secret "samples-operator-tls" not found Jun 06 13:04:48.726672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:48.726600 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kn46z_812616d7-e431-4994-9d41-36a329a8aa27/dns-node-resolver/0.log" Jun 06 13:04:49.470884 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.470853 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:49.572168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.572136 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:49.672240 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.672196 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:49.730749 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.730661 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:49.827164 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.827131 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:49.926386 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:49.926357 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxqt8_04ab0a67-e8b2-4b52-a2ad-89af7fbd9185/node-ca/0.log" Jun 06 13:04:50.328000 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:50.327964 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56skw_5b934b99-dced-4990-a1bf-2f906fe62350/serve-healthcheck-canary/0.log" Jun 06 13:04:50.687788 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:50.687711 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:50.788509 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:50.788476 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:50.979169 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:50.979088 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:51.328838 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:51.328807 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7d55w_6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb/kube-storage-version-migrator-operator/0.log" Jun 06 13:04:51.378960 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:51.378929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:51.567637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:51.567601 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:51.769795 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:51.769705 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:52.603055 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:52.602975 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:52.771145 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:52.771106 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:53.167484 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:53.167455 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:53.370203 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:53.370175 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:53.471233 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:53.471152 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:53.571494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:53.571462 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:53.969496 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:53.969462 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:54.572079 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:54.572049 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:54.960753 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:54.960665 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:55.168186 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:55.168160 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:55.367215 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:55.367170 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:55.569614 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:55.569576 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:56.022282 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.022240 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:56.069876 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.069844 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:56.516064 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.516028 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:56.516064 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.516076 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:56.518442 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.518416 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a19efd4e-8f57-4585-ba4e-a1b8f8d88331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcn7s\" (UID: \"a19efd4e-8f57-4585-ba4e-a1b8f8d88331\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:56.518552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.518486 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cdae424-db3e-4271-8444-e3725e89086f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qgp6b\" (UID: \"3cdae424-db3e-4271-8444-e3725e89086f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:56.572307 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.572269 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:56.600201 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.600176 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" Jun 06 13:04:56.609270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.609245 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" Jun 06 13:04:56.734953 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.734919 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s"] Jun 06 13:04:56.739360 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:04:56.739333 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19efd4e_8f57_4585_ba4e_a1b8f8d88331.slice/crio-26673d27a7fc46b2a34011a39d3630ad9de8ca643bf7476eddc6c5c352db5f19 WatchSource:0}: Error finding container 26673d27a7fc46b2a34011a39d3630ad9de8ca643bf7476eddc6c5c352db5f19: Status 404 returned error can't find the container with id 26673d27a7fc46b2a34011a39d3630ad9de8ca643bf7476eddc6c5c352db5f19 Jun 06 13:04:56.752351 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:56.752327 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b"] Jun 06 13:04:57.171897 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.171868 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:57.365692 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.365659 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:57.376345 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.376276 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" event={"ID":"3cdae424-db3e-4271-8444-e3725e89086f","Type":"ContainerStarted","Data":"a4261dbe3f47e11a2aa750ffc1d11dd2db0c3a7f10a57614f98b90809c48ade6"} Jun 06 13:04:57.378002 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.377960 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" event={"ID":"a19efd4e-8f57-4585-ba4e-a1b8f8d88331","Type":"ContainerStarted","Data":"26673d27a7fc46b2a34011a39d3630ad9de8ca643bf7476eddc6c5c352db5f19"} Jun 06 13:04:57.765623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.765570 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:57.966329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:57.966294 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:58.366948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:58.366912 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:58.506026 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:58.505974 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:58.773303 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:58.773215 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:59.220740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.220709 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:59.323223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.323181 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:59.386792 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.386756 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" event={"ID":"3cdae424-db3e-4271-8444-e3725e89086f","Type":"ContainerStarted","Data":"fd6a2e44c75e1c511d82198c59078c0c8b6955a080c412a8d7ee6666826f97bc"} Jun 06 13:04:59.386976 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.386896 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" event={"ID":"3cdae424-db3e-4271-8444-e3725e89086f","Type":"ContainerStarted","Data":"f9eace2b21d2d3d8584b2cebbd876f6756634afe0b489171480ebd57ec99031e"} Jun 06 13:04:59.388254 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.388234 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" event={"ID":"a19efd4e-8f57-4585-ba4e-a1b8f8d88331","Type":"ContainerStarted","Data":"4a9c392be0645ec0098a0d32062ccfd4ee2b017c0a5a00722a94bae0a614ac8c"} Jun 06 13:04:59.401828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.401780 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qgp6b" podStartSLOduration=17.284928763 podStartE2EDuration="19.401761552s" totalImagesPullingTime="2.116832789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:59.401479393 +0000 UTC m=+238.261561835" watchObservedRunningTime="2026-06-06 13:04:59.401761552 +0000 UTC m=+238.261843963" Jun 06 13:04:59.408767 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.406646 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:59.418344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.418308 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcn7s" podStartSLOduration=17.250791457 podStartE2EDuration="19.418296526s" totalImagesPullingTime="2.167505069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:59.415728655 +0000 UTC m=+238.275811072" watchObservedRunningTime="2026-06-06 13:04:59.418296526 +0000 UTC m=+238.278378936" Jun 06 13:04:59.770591 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.770516 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:04:59.969508 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:04:59.969480 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:00.168421 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:00.168392 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:00.586492 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:00.586461 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.460746 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.460707 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.562022 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.561976 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.610576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.610547 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.756498 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.756410 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.945876 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.945837 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:03.994301 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:03.994274 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:04.140833 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:04.140797 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:04.189871 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:04.189843 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:04.537638 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:04.537555 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:04.583601 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:04.583573 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:04.965484 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:04.965447 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:05.143548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:05.143516 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:05.609921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:05.609889 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:06.364770 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:06.364740 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:06.415679 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:06.415654 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:09.000749 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.000712 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh"] Jun 06 13:05:09.006770 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.006750 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:09.010652 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.010625 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lbpnt\"" Jun 06 13:05:09.010792 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.010625 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 13:05:09.017837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.017812 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-wqrx6"] Jun 06 13:05:09.021661 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.021633 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh"] Jun 06 13:05:09.021756 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.021723 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:09.024111 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.024087 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 13:05:09.024231 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.024204 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nxf9f\"" Jun 06 13:05:09.024392 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.024361 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 13:05:09.025267 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.025248 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p2gfb"] Jun 06 13:05:09.029359 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.029340 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.031807 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.031788 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 13:05:09.031909 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.031832 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 13:05:09.031909 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.031870 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ff56m\"" Jun 06 13:05:09.039631 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.039608 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wqrx6"] Jun 06 13:05:09.040516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.040496 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2gfb"] Jun 06 13:05:09.105852 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.105814 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:09.110832 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.110806 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/93e7747a-5252-4b51-9e5e-9b73bbf7b08a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-v6zlh\" (UID: \"93e7747a-5252-4b51-9e5e-9b73bbf7b08a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:09.110950 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.110836 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdzvc\" (UniqueName: \"kubernetes.io/projected/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-api-access-mdzvc\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.110950 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.110867 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-222zr\" (UniqueName: \"kubernetes.io/projected/5beb5589-a262-4f57-aaa3-f681ef7801f6-kube-api-access-222zr\") pod \"downloads-6657875f97-wqrx6\" (UID: \"5beb5589-a262-4f57-aaa3-f681ef7801f6\") " pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:09.110950 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.110927 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.111099 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.110955 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.111099 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.111031 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-crio-socket\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.111099 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.111076 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-data-volume\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.208608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.208577 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:09.211672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211655 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-222zr\" (UniqueName: \"kubernetes.io/projected/5beb5589-a262-4f57-aaa3-f681ef7801f6-kube-api-access-222zr\") pod \"downloads-6657875f97-wqrx6\" (UID: \"5beb5589-a262-4f57-aaa3-f681ef7801f6\") " pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:09.211773 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211685 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.211773 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211703 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.211773 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-crio-socket\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.211944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-data-volume\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.211944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211894 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-crio-socket\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.211944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211908 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/93e7747a-5252-4b51-9e5e-9b73bbf7b08a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-v6zlh\" (UID: \"93e7747a-5252-4b51-9e5e-9b73bbf7b08a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:09.211944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.211937 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdzvc\" (UniqueName: \"kubernetes.io/projected/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-api-access-mdzvc\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.212184 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.212167 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-data-volume\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.212408 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.212389 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.214148 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.214128 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.214248 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.214181 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/93e7747a-5252-4b51-9e5e-9b73bbf7b08a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-v6zlh\" (UID: \"93e7747a-5252-4b51-9e5e-9b73bbf7b08a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:09.220280 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.220252 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-222zr\" (UniqueName: \"kubernetes.io/projected/5beb5589-a262-4f57-aaa3-f681ef7801f6-kube-api-access-222zr\") pod \"downloads-6657875f97-wqrx6\" (UID: \"5beb5589-a262-4f57-aaa3-f681ef7801f6\") " pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:09.220382 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.220285 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdzvc\" (UniqueName: \"kubernetes.io/projected/ba87e7d4-86ce-4caa-b40c-8b9d9372d73d-kube-api-access-mdzvc\") pod \"insights-runtime-extractor-p2gfb\" (UID: \"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d\") " pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.315990 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.315962 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:09.331080 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.331056 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:09.338734 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.338704 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2gfb" Jun 06 13:05:09.475777 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.475742 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh"] Jun 06 13:05:09.481914 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:09.481863 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e7747a_5252_4b51_9e5e_9b73bbf7b08a.slice/crio-b95bdf5c2aa764ae66413800794b2f3ce318237b749410c942d5bfb3a82165fd WatchSource:0}: Error finding container b95bdf5c2aa764ae66413800794b2f3ce318237b749410c942d5bfb3a82165fd: Status 404 returned error can't find the container with id b95bdf5c2aa764ae66413800794b2f3ce318237b749410c942d5bfb3a82165fd Jun 06 13:05:09.511468 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.511440 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wqrx6"] Jun 06 13:05:09.513957 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:09.513938 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5beb5589_a262_4f57_aaa3_f681ef7801f6.slice/crio-6cd882f05c2056e6666951f730cf48c5e04e3e5fa7d8556bba26cdc814d2f949 WatchSource:0}: Error finding container 6cd882f05c2056e6666951f730cf48c5e04e3e5fa7d8556bba26cdc814d2f949: Status 404 returned error can't find the container with id 6cd882f05c2056e6666951f730cf48c5e04e3e5fa7d8556bba26cdc814d2f949 Jun 06 13:05:09.517515 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:09.517493 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2gfb"] Jun 06 13:05:09.520124 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:09.520103 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba87e7d4_86ce_4caa_b40c_8b9d9372d73d.slice/crio-fba2b1a2afe36b40fbb26a84dc95ba8edc01bd6fbe00cafe89b274459c3a97d2 WatchSource:0}: Error finding container fba2b1a2afe36b40fbb26a84dc95ba8edc01bd6fbe00cafe89b274459c3a97d2: Status 404 returned error can't find the container with id fba2b1a2afe36b40fbb26a84dc95ba8edc01bd6fbe00cafe89b274459c3a97d2 Jun 06 13:05:10.426464 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:10.426379 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wqrx6" event={"ID":"5beb5589-a262-4f57-aaa3-f681ef7801f6","Type":"ContainerStarted","Data":"6cd882f05c2056e6666951f730cf48c5e04e3e5fa7d8556bba26cdc814d2f949"} Jun 06 13:05:10.428847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:10.428711 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2gfb" event={"ID":"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d","Type":"ContainerStarted","Data":"275199fe1a06cde9d5074331541e660285506dc67a8f2187ec8725278dc04ce9"} Jun 06 13:05:10.428847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:10.428779 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2gfb" event={"ID":"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d","Type":"ContainerStarted","Data":"b6afd76c9697bd8349e9fd2b927fc1839baf61b0db767b42c800074a18e67267"} Jun 06 13:05:10.428847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:10.428809 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2gfb" event={"ID":"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d","Type":"ContainerStarted","Data":"fba2b1a2afe36b40fbb26a84dc95ba8edc01bd6fbe00cafe89b274459c3a97d2"} Jun 06 13:05:10.430025 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:10.430002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" event={"ID":"93e7747a-5252-4b51-9e5e-9b73bbf7b08a","Type":"ContainerStarted","Data":"b95bdf5c2aa764ae66413800794b2f3ce318237b749410c942d5bfb3a82165fd"} Jun 06 13:05:11.435892 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:11.435851 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" event={"ID":"93e7747a-5252-4b51-9e5e-9b73bbf7b08a","Type":"ContainerStarted","Data":"a7ee552f33ed48218f4b3d90fc7513f8ce1bc0653335982890945ad87ae68c5c"} Jun 06 13:05:11.436401 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:11.436119 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:11.441571 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:11.441520 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" Jun 06 13:05:11.450201 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:11.450034 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-v6zlh" podStartSLOduration=2.246219289 podStartE2EDuration="3.450014268s" totalImagesPullingTime="1.203794979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:11.449730416 +0000 UTC m=+250.309812853" watchObservedRunningTime="2026-06-06 13:05:11.450014268 +0000 UTC m=+250.310096679" Jun 06 13:05:12.404538 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.404503 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:12.441205 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.441173 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl"] Jun 06 13:05:12.463069 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.463023 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2gfb" event={"ID":"ba87e7d4-86ce-4caa-b40c-8b9d9372d73d","Type":"ContainerStarted","Data":"558c803600d2c68da5aaaba65a0e08a55d40c1f329bc983f96a1e8cec5df2c08"} Jun 06 13:05:12.463238 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.463081 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.463238 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.463098 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl"] Jun 06 13:05:12.466006 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.465955 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fd5zg\"" Jun 06 13:05:12.466311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.466289 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 13:05:12.466515 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.466495 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 13:05:12.466632 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.466516 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 13:05:12.466632 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.466521 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p2gfb" podStartSLOduration=2.201421708 podStartE2EDuration="4.46650598s" totalImagesPullingTime="2.265084272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:05:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:12.465405169 +0000 UTC m=+251.325487609" watchObservedRunningTime="2026-06-06 13:05:12.46650598 +0000 UTC m=+251.326588388" Jun 06 13:05:12.471618 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.471477 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:12.541962 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.541933 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d809561d-2496-45fc-8f33-21c5a8de3a9c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.542232 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.542195 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.542336 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.542286 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.542399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.542361 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vzp\" (UniqueName: \"kubernetes.io/projected/d809561d-2496-45fc-8f33-21c5a8de3a9c-kube-api-access-r2vzp\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.643718 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.643683 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.643911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.643736 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.643911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.643770 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vzp\" (UniqueName: \"kubernetes.io/projected/d809561d-2496-45fc-8f33-21c5a8de3a9c-kube-api-access-r2vzp\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.643911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.643839 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d809561d-2496-45fc-8f33-21c5a8de3a9c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.644254 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:12.644217 2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 06 13:05:12.644384 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:12.644300 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls podName:d809561d-2496-45fc-8f33-21c5a8de3a9c nodeName:}" failed. No retries permitted until 2026-06-06 13:05:13.144277693 +0000 UTC m=+252.004360098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-cpdgl" (UID: "d809561d-2496-45fc-8f33-21c5a8de3a9c") : secret "prometheus-operator-tls" not found Jun 06 13:05:12.644620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.644597 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d809561d-2496-45fc-8f33-21c5a8de3a9c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.646665 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.646644 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.652349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.652322 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vzp\" (UniqueName: \"kubernetes.io/projected/d809561d-2496-45fc-8f33-21c5a8de3a9c-kube-api-access-r2vzp\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:12.844717 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:12.844677 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:13.147481 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.147397 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:13.149942 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.149907 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d809561d-2496-45fc-8f33-21c5a8de3a9c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpdgl\" (UID: \"d809561d-2496-45fc-8f33-21c5a8de3a9c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:13.263589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.263549 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:13.321793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.321759 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:13.374943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.374911 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" Jun 06 13:05:13.378113 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.378086 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:13.450430 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.450402 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:05:13.453321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.453269 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0adce35-ec50-4eba-89ba-88fde6e1ea16-metrics-certs\") pod \"network-metrics-daemon-2l27h\" (UID: \"c0adce35-ec50-4eba-89ba-88fde6e1ea16\") " pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:05:13.528378 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.528216 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl"] Jun 06 13:05:13.531298 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:13.531248 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd809561d_2496_45fc_8f33_21c5a8de3a9c.slice/crio-3205bd0a0e17091dca10e2b1a5f4bd32dfa472db908bec3e1a08025260ae03c1 WatchSource:0}: Error finding container 3205bd0a0e17091dca10e2b1a5f4bd32dfa472db908bec3e1a08025260ae03c1: Status 404 returned error can't find the container with id 3205bd0a0e17091dca10e2b1a5f4bd32dfa472db908bec3e1a08025260ae03c1 Jun 06 13:05:13.578895 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.578864 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:05:13.607267 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.607241 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcwkx\"" Jun 06 13:05:13.611603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.611579 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.613932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.613908 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8jlbh\"" Jun 06 13:05:13.614084 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614066 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 13:05:13.614156 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614101 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 13:05:13.614156 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614141 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 13:05:13.614799 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614780 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 13:05:13.614881 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614789 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 13:05:13.614933 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.614911 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2l27h" Jun 06 13:05:13.617686 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.617667 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:05:13.652120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652052 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.652226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652145 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.652226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652194 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.652226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652214 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgbhp\" (UniqueName: \"kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.652333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652248 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.652333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.652304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.748257 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.748212 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2l27h"] Jun 06 13:05:13.751176 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:13.751145 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0adce35_ec50_4eba_89ba_88fde6e1ea16.slice/crio-9a5b0cac10da76950017aab7262c970cc394eeaafdcf96c84458e0effb518351 WatchSource:0}: Error finding container 9a5b0cac10da76950017aab7262c970cc394eeaafdcf96c84458e0effb518351: Status 404 returned error can't find the container with id 9a5b0cac10da76950017aab7262c970cc394eeaafdcf96c84458e0effb518351 Jun 06 13:05:13.752736 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.752714 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.752825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.752760 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.752825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.752797 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.752926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.752833 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgbhp\" (UniqueName: \"kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.752926 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.752866 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.753068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.753007 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.753535 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.753516 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.754061 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.754019 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.754257 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.754137 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.755587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.755570 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.756180 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.756158 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.761726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.761704 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgbhp\" (UniqueName: \"kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp\") pod \"console-784b46c95f-5rgct\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.923086 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.923008 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:13.933278 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.933249 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:13.987636 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:13.987603 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:14.097673 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:14.097645 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:05:14.100355 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:14.100328 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef48070c_a193_4ccf_8021_1aa4a96c2c47.slice/crio-2e3b8a414eb21c1bba87e1ae8db076437c9b25d5b373416a96fbdcabdd2f7c9c WatchSource:0}: Error finding container 2e3b8a414eb21c1bba87e1ae8db076437c9b25d5b373416a96fbdcabdd2f7c9c: Status 404 returned error can't find the container with id 2e3b8a414eb21c1bba87e1ae8db076437c9b25d5b373416a96fbdcabdd2f7c9c Jun 06 13:05:14.456308 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:14.456268 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" event={"ID":"d809561d-2496-45fc-8f33-21c5a8de3a9c","Type":"ContainerStarted","Data":"3205bd0a0e17091dca10e2b1a5f4bd32dfa472db908bec3e1a08025260ae03c1"} Jun 06 13:05:14.458172 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:14.458137 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784b46c95f-5rgct" event={"ID":"ef48070c-a193-4ccf-8021-1aa4a96c2c47","Type":"ContainerStarted","Data":"2e3b8a414eb21c1bba87e1ae8db076437c9b25d5b373416a96fbdcabdd2f7c9c"} Jun 06 13:05:14.459799 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:14.459772 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2l27h" event={"ID":"c0adce35-ec50-4eba-89ba-88fde6e1ea16","Type":"ContainerStarted","Data":"9a5b0cac10da76950017aab7262c970cc394eeaafdcf96c84458e0effb518351"} Jun 06 13:05:15.161360 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.161193 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:15.216324 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.216233 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:15.470977 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.470873 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" event={"ID":"d809561d-2496-45fc-8f33-21c5a8de3a9c","Type":"ContainerStarted","Data":"54242b9113df35b27729f5b05b72dee2292ab5e706ae77754b75a86b11e066e3"} Jun 06 13:05:15.474073 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.474004 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2l27h" event={"ID":"c0adce35-ec50-4eba-89ba-88fde6e1ea16","Type":"ContainerStarted","Data":"8cb467cd72631b14aa8dfdb1726796f8c482e981277f7b2070b1630543a8515e"} Jun 06 13:05:15.677783 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.677670 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:15.773940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.773855 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:15.823157 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:15.823075 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:16.481415 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.481345 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2l27h" event={"ID":"c0adce35-ec50-4eba-89ba-88fde6e1ea16","Type":"ContainerStarted","Data":"7758d001b5bbd84a714bf4f845dbc0df2f87506d972e266914b127c2cb7eed5f"} Jun 06 13:05:16.483485 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.483452 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" event={"ID":"d809561d-2496-45fc-8f33-21c5a8de3a9c","Type":"ContainerStarted","Data":"cb54bb53c800e55fbcc0ae1128e4011ddb7d7515492543386f2b460c9b0180f9"} Jun 06 13:05:16.497451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.497395 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2l27h" podStartSLOduration=253.914418937 podStartE2EDuration="4m15.49737926s" totalImagesPullingTime="1.582960323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:16.496695204 +0000 UTC m=+255.356777638" watchObservedRunningTime="2026-06-06 13:05:16.49737926 +0000 UTC m=+255.357461670" Jun 06 13:05:16.514229 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.514177 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpdgl" podStartSLOduration=2.7132573779999998 podStartE2EDuration="4.514156135s" totalImagesPullingTime="1.800898757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:16.511286166 +0000 UTC m=+255.371368607" watchObservedRunningTime="2026-06-06 13:05:16.514156135 +0000 UTC m=+255.374238547" Jun 06 13:05:16.577358 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.577296 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:16.678458 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:16.678405 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:18.493869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.493582 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784b46c95f-5rgct" event={"ID":"ef48070c-a193-4ccf-8021-1aa4a96c2c47","Type":"ContainerStarted","Data":"71ffcbc4fccf695eabd00efdeea62584c8ef0c46cf0eb13a72e30e1a728f009e"} Jun 06 13:05:18.515726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.515585 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784b46c95f-5rgct" podStartSLOduration=2.133802796 podStartE2EDuration="5.515564135s" totalImagesPullingTime="3.381761339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:18.515205876 +0000 UTC m=+257.375288309" watchObservedRunningTime="2026-06-06 13:05:18.515564135 +0000 UTC m=+257.375646546" Jun 06 13:05:18.550257 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.550223 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:18.788658 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.788557 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:18.852459 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.852427 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wlqlz"] Jun 06 13:05:18.855652 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.855634 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.858400 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.858379 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 13:05:18.858543 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.858519 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pf29j\"" Jun 06 13:05:18.858723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.858706 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 13:05:18.858781 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.858757 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 13:05:18.870407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.870319 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902254 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-metrics-client-ca\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902283 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902301 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7j4\" (UniqueName: \"kubernetes.io/projected/9e844808-bca2-4cb4-b7a5-f49f03348354-kube-api-access-jj7j4\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902319 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-wtmp\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902362 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-sys\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902386 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-root\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902402 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902448 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-textfile\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.902523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.902490 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:18.925256 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:18.925225 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.004116 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004080 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-sys\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004300 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004136 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-root\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004300 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004168 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004300 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004254 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-root\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004309 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-textfile\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004344 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004565 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004506 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-sys\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004766 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-metrics-client-ca\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.004947 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.004907 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.005198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005181 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7j4\" (UniqueName: \"kubernetes.io/projected/9e844808-bca2-4cb4-b7a5-f49f03348354-kube-api-access-jj7j4\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.005461 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:19.005444 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 13:05:19.005552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005533 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-metrics-client-ca\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.005608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005449 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.005608 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:19.005593 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls podName:9e844808-bca2-4cb4-b7a5-f49f03348354 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:19.505522729 +0000 UTC m=+258.365605120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls") pod "node-exporter-wlqlz" (UID: "9e844808-bca2-4cb4-b7a5-f49f03348354") : secret "node-exporter-tls" not found Jun 06 13:05:19.005895 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005840 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-wtmp\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.005979 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005960 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-wtmp\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.006062 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.005895 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-textfile\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.007235 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.007214 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.022499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.015660 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7j4\" (UniqueName: \"kubernetes.io/projected/9e844808-bca2-4cb4-b7a5-f49f03348354-kube-api-access-jj7j4\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.029722 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.028258 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.099953 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.099888 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.193866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.193786 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.488584 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.488502 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.515521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.515497 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:19.516031 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:19.515661 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 13:05:19.516031 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:19.515734 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls podName:9e844808-bca2-4cb4-b7a5-f49f03348354 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:20.515714235 +0000 UTC m=+259.375796637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls") pod "node-exporter-wlqlz" (UID: "9e844808-bca2-4cb4-b7a5-f49f03348354") : secret "node-exporter-tls" not found Jun 06 13:05:19.608473 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.608428 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.774885 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.774814 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.857779 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.857707 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:19.862565 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.862538 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:05:19.867754 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.867721 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.870386 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.870364 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 13:05:19.871516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871061 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 13:05:19.871516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871124 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 13:05:19.871516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871289 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 13:05:19.871516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871387 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 13:05:19.871516 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871068 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 13:05:19.871823 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.871638 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 13:05:19.872094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.872058 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 13:05:19.872230 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.872214 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 13:05:19.872320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.872305 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4g2jr\"" Jun 06 13:05:19.891607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.891149 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:05:19.918773 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.918743 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.918902 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.918785 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.918902 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.918811 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.918915 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.918962 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919009 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919208 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919173 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919214 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919241 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919368 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919276 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919368 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919299 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919466 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919375 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.919466 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.919436 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:19.976206 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:19.976172 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:20.020932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.020901 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.020932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.020938 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.020964 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021041 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021078 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021103 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021139 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021163 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021198 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021223 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021246 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021269 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021405 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.021692 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:20.021473 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle podName:eb8475d7-9951-47ea-8bea-4f038cc25654 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:20.521453378 +0000 UTC m=+259.381535786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654") : configmap references non-existent config key: ca-bundle.crt Jun 06 13:05:20.021692 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:20.021564 2550 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 06 13:05:20.021692 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:20.021605 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls podName:eb8475d7-9951-47ea-8bea-4f038cc25654 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:20.521593101 +0000 UTC m=+259.381675491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654") : secret "alertmanager-main-tls" not found Jun 06 13:05:20.021864 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.021705 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.022678 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.022616 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.025065 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.024947 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.025813 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.025773 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.026629 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.026594 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.027221 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.027064 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.027221 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.027128 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.027221 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.027195 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.027360 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.027246 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.027476 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.027457 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.030705 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.030672 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.177238 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.177203 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:20.527203 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.527164 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.527203 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.527207 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:20.527741 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.527300 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.528173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.528151 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.530165 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.530141 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:20.530274 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.530238 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e844808-bca2-4cb4-b7a5-f49f03348354-node-exporter-tls\") pod \"node-exporter-wlqlz\" (UID: \"9e844808-bca2-4cb4-b7a5-f49f03348354\") " pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:20.668843 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.668807 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlqlz" Jun 06 13:05:20.795442 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:20.795354 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:05:21.696778 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.696748 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:21.769496 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.769463 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:21.774362 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.774337 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr"] Jun 06 13:05:21.777365 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.777346 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.783126 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783105 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a2edbh0ummn3b\"" Jun 06 13:05:21.783251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783143 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 13:05:21.783251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783192 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 13:05:21.783251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783238 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kwb7r\"" Jun 06 13:05:21.783251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783108 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 13:05:21.783493 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783477 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 13:05:21.783570 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.783501 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 13:05:21.796269 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.796247 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr"] Jun 06 13:05:21.839369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839290 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839328 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2ch\" (UniqueName: \"kubernetes.io/projected/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-kube-api-access-7p2ch\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839356 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-grpc-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839382 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839534 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839575 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839759 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839627 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-metrics-client-ca\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.839759 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.839667 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.940725 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940692 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.940865 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940741 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.940865 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940773 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-metrics-client-ca\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.940865 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940808 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.941040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940868 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.941040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940893 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2ch\" (UniqueName: \"kubernetes.io/projected/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-kube-api-access-7p2ch\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.941040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940922 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-grpc-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.941040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.940948 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.942087 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.942024 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-metrics-client-ca\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.944356 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.944332 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.944451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.944332 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.945439 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.944659 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.945439 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.944924 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.945555 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.945446 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-grpc-tls\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.946365 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.946340 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:21.948802 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:21.948750 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2ch\" (UniqueName: \"kubernetes.io/projected/9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8-kube-api-access-7p2ch\") pod \"thanos-querier-59bfd5bc44-xkkvr\" (UID: \"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8\") " pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:22.043307 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:22.043268 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:22.089620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:22.089586 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:22.157895 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:22.157867 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:23.366829 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.366783 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:23.467513 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.467454 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:23.581390 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.581358 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:23.585349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.585324 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr"] Jun 06 13:05:23.603764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.603716 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:05:23.604032 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.604008 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.606064 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.606042 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 06 13:05:23.606368 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.606324 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pfsch\"" Jun 06 13:05:23.611397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.611375 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr"] Jun 06 13:05:23.617112 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.617063 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:05:23.619558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.619539 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.626948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.626910 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 13:05:23.632076 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.632057 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:05:23.644535 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.644510 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:23.757921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.757885 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.758109 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.757941 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758109 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758011 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cff6p\" (UniqueName: \"kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758109 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758040 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758296 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758130 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758296 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758275 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758336 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xcc\" (UniqueName: \"kubernetes.io/projected/e32c53a0-afe8-4893-bfee-94f1a679579b-kube-api-access-b2xcc\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.758395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758364 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.758484 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.758396 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859213 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859178 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859423 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859354 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859434 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xcc\" (UniqueName: \"kubernetes.io/projected/e32c53a0-afe8-4893-bfee-94f1a679579b-kube-api-access-b2xcc\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.859499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859459 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859491 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859527 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.859704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859570 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859593 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cff6p\" (UniqueName: \"kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.859623 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.859910 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:23.859897 2550 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 06 13:05:23.860035 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:23.860013 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert podName:e32c53a0-afe8-4893-bfee-94f1a679579b nodeName:}" failed. No retries permitted until 2026-06-06 13:05:24.359972359 +0000 UTC m=+263.220054757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-tdlsr" (UID: "e32c53a0-afe8-4893-bfee-94f1a679579b") : secret "monitoring-plugin-cert" not found Jun 06 13:05:23.860234 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.860213 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.860303 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.860237 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.860431 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.860409 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.860911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.860888 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.862467 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.862445 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.862622 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.862598 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.870201 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.870132 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cff6p\" (UniqueName: \"kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p\") pod \"console-dddb955f6-q89wx\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:23.870423 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.870401 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xcc\" (UniqueName: \"kubernetes.io/projected/e32c53a0-afe8-4893-bfee-94f1a679579b-kube-api-access-b2xcc\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:23.924024 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.923948 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:05:23.933210 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:23.933161 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:24.016809 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.016774 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:24.364514 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.364480 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:24.367181 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.367156 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e32c53a0-afe8-4893-bfee-94f1a679579b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-tdlsr\" (UID: \"e32c53a0-afe8-4893-bfee-94f1a679579b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:24.517819 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.517788 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:24.970841 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.970794 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:24.978543 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.978503 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:05:24.982146 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.982119 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:24.986837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.986814 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 13:05:24.986963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.986908 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.989698 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.989862 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l8lfq\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.989963 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990031 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990102 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990151 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990204 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990234 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 13:05:24.990426 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990343 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ced53du6bg2o9\"" Jun 06 13:05:24.990910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990600 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 13:05:24.990910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990621 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 13:05:24.990910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990900 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 13:05:24.991374 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.990903 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 13:05:24.991374 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.991102 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 13:05:24.992737 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.992694 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 13:05:24.997102 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:24.997078 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:05:25.071533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071359 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071410 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071469 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071582 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071621 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071655 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071681 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.071874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071830 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.071961 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072010 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072042 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072107 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcntd\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072140 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072170 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072201 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.072471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.072314 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173468 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173416 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173490 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173536 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173566 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173592 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173622 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173667 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173688 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173718 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173740 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173777 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173816 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173842 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173882 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.173924 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173905 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173933 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.173965 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcntd\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174007 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174031 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174062 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174202 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.174700 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174455 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.175328 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.174976 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.176123 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.176025 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.178513 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.178491 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.179171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.179150 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.179417 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.179374 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.179642 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.179550 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.181785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.179729 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.181785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.180239 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.181785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.180491 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.181785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.180621 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.182674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.182652 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.182764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.182699 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.183124 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.182941 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.183124 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.183070 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.183124 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.183075 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.183448 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.183419 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.183963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.183889 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.185617 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.185598 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcntd\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd\") pod \"prometheus-k8s-0\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:25.294932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:25.294838 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:27.106439 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.106265 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:27.168842 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.168658 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:27.259173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.259149 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:27.266332 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.266296 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:05:27.267655 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:27.267628 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8475d7_9951_47ea_8bea_4f038cc25654.slice/crio-eb67c5eb403aeef0d2d3189e63ab5527329c2f8c152642c2c560e9c49f9cccf9 WatchSource:0}: Error finding container eb67c5eb403aeef0d2d3189e63ab5527329c2f8c152642c2c560e9c49f9cccf9: Status 404 returned error can't find the container with id eb67c5eb403aeef0d2d3189e63ab5527329c2f8c152642c2c560e9c49f9cccf9 Jun 06 13:05:27.308301 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.308279 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr"] Jun 06 13:05:27.310512 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:27.310490 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32c53a0_afe8_4893_bfee_94f1a679579b.slice/crio-face08f915e471399852b3ebda28b3795af23e6ce3ff9537f68f0061f383e9d3 WatchSource:0}: Error finding container face08f915e471399852b3ebda28b3795af23e6ce3ff9537f68f0061f383e9d3: Status 404 returned error can't find the container with id face08f915e471399852b3ebda28b3795af23e6ce3ff9537f68f0061f383e9d3 Jun 06 13:05:27.476921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.476859 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:05:27.480194 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.480103 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr"] Jun 06 13:05:27.480572 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:27.480543 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf04d606_b13f_4d52_b0cf_2610e363c2cb.slice/crio-13abf7d7b39de3493eef7ca909436ab334c6095dff6219b824d00b2e109695e5 WatchSource:0}: Error finding container 13abf7d7b39de3493eef7ca909436ab334c6095dff6219b824d00b2e109695e5: Status 404 returned error can't find the container with id 13abf7d7b39de3493eef7ca909436ab334c6095dff6219b824d00b2e109695e5 Jun 06 13:05:27.487452 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.487420 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:05:27.490726 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:27.490589 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5d0f07_f0df_4a0c_8ced_d2ab08f825c8.slice/crio-965b1a6df58edb56093eb38afafce7505e1f3d492e7a5b82ac86225dd30dd464 WatchSource:0}: Error finding container 965b1a6df58edb56093eb38afafce7505e1f3d492e7a5b82ac86225dd30dd464: Status 404 returned error can't find the container with id 965b1a6df58edb56093eb38afafce7505e1f3d492e7a5b82ac86225dd30dd464 Jun 06 13:05:27.490839 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:27.490819 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d835be_1176_40e0_872d_faa1c2a0cbab.slice/crio-7da99b8ddd02362b5ffaf860b48a7759d9b6f616a5200ed8cd883478128e3862 WatchSource:0}: Error finding container 7da99b8ddd02362b5ffaf860b48a7759d9b6f616a5200ed8cd883478128e3862: Status 404 returned error can't find the container with id 7da99b8ddd02362b5ffaf860b48a7759d9b6f616a5200ed8cd883478128e3862 Jun 06 13:05:27.533241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.533081 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlqlz" event={"ID":"9e844808-bca2-4cb4-b7a5-f49f03348354","Type":"ContainerStarted","Data":"5af0ab26daac845c696073011a05eaf6f15ea7dbc95ee767be0301ff6c4c473c"} Jun 06 13:05:27.535070 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.534659 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"965b1a6df58edb56093eb38afafce7505e1f3d492e7a5b82ac86225dd30dd464"} Jun 06 13:05:27.536137 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.536041 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"7da99b8ddd02362b5ffaf860b48a7759d9b6f616a5200ed8cd883478128e3862"} Jun 06 13:05:27.538010 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.537944 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" event={"ID":"e32c53a0-afe8-4893-bfee-94f1a679579b","Type":"ContainerStarted","Data":"face08f915e471399852b3ebda28b3795af23e6ce3ff9537f68f0061f383e9d3"} Jun 06 13:05:27.539608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.539559 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dddb955f6-q89wx" event={"ID":"bf04d606-b13f-4d52-b0cf-2610e363c2cb","Type":"ContainerStarted","Data":"13abf7d7b39de3493eef7ca909436ab334c6095dff6219b824d00b2e109695e5"} Jun 06 13:05:27.543411 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.543321 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wqrx6" event={"ID":"5beb5589-a262-4f57-aaa3-f681ef7801f6","Type":"ContainerStarted","Data":"283c73ec34313ba0665461125d2f7de206b311f33bac300f8f1f5821727d7faa"} Jun 06 13:05:27.544084 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.544030 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:27.545853 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.545829 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"eb67c5eb403aeef0d2d3189e63ab5527329c2f8c152642c2c560e9c49f9cccf9"} Jun 06 13:05:27.549947 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.549903 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-wqrx6" Jun 06 13:05:27.558422 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:27.558198 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-wqrx6" podStartSLOduration=1.922738836 podStartE2EDuration="19.558182701s" totalImagesPullingTime="17.635443865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:27.558174584 +0000 UTC m=+266.418256995" watchObservedRunningTime="2026-06-06 13:05:27.558182701 +0000 UTC m=+266.418265120" Jun 06 13:05:28.561263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:28.561226 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dddb955f6-q89wx" event={"ID":"bf04d606-b13f-4d52-b0cf-2610e363c2cb","Type":"ContainerStarted","Data":"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544"} Jun 06 13:05:28.577834 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:28.577777 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dddb955f6-q89wx" podStartSLOduration=5.577756872 podStartE2EDuration="5.577756872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:28.576876301 +0000 UTC m=+267.436958712" watchObservedRunningTime="2026-06-06 13:05:28.577756872 +0000 UTC m=+267.437839265" Jun 06 13:05:31.575385 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.575346 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4" exitCode=0 Jun 06 13:05:31.575909 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.575439 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4"} Jun 06 13:05:31.577428 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.577401 2550 generic.go:356] "Generic (PLEG): container finished" podID="9e844808-bca2-4cb4-b7a5-f49f03348354" containerID="a751be5a825007bd4d589b2cf632e3dfe785bf2e123b9dc8075d0cbc3c04f0c2" exitCode=0 Jun 06 13:05:31.577528 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.577487 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlqlz" event={"ID":"9e844808-bca2-4cb4-b7a5-f49f03348354","Type":"ContainerDied","Data":"a751be5a825007bd4d589b2cf632e3dfe785bf2e123b9dc8075d0cbc3c04f0c2"} Jun 06 13:05:31.582331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.582165 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"b66e737247ec4eefba577c80b9242272a4cbe45fccc43d9beb7511edd11d1ea3"} Jun 06 13:05:31.582331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.582226 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"ec26ba56d1f3b8895cf5b5b6ed2481232eb24a348738108030e55df7eefa39d1"} Jun 06 13:05:31.582331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.582264 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"35217a2b4e3bbd9913502e56199aa75b48a908ff48601657f0e4cb9d917f4a9f"} Jun 06 13:05:31.585607 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.585582 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" exitCode=0 Jun 06 13:05:31.585764 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.585656 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} Jun 06 13:05:31.588851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.588827 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" event={"ID":"e32c53a0-afe8-4893-bfee-94f1a679579b","Type":"ContainerStarted","Data":"ecf2288d2a494ea76db4bf7cc94fcd1bc50257840917d4280668a145feab5adc"} Jun 06 13:05:31.589049 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.589025 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:31.596011 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.595976 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" Jun 06 13:05:31.642853 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:31.642805 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-tdlsr" podStartSLOduration=5.12660885 podStartE2EDuration="8.642784552s" totalImagesPullingTime="3.516175702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:31.640818559 +0000 UTC m=+270.500900989" watchObservedRunningTime="2026-06-06 13:05:31.642784552 +0000 UTC m=+270.502866965" Jun 06 13:05:32.597680 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:32.597638 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlqlz" event={"ID":"9e844808-bca2-4cb4-b7a5-f49f03348354","Type":"ContainerStarted","Data":"6fcf902527efdf333faf73e4f3da5214286400a7bdb952b2015bc906a3620fac"} Jun 06 13:05:32.598271 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:32.597742 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlqlz" event={"ID":"9e844808-bca2-4cb4-b7a5-f49f03348354","Type":"ContainerStarted","Data":"7585bd0db98ea06ded9e0b61931c8838160c1effacfa4a2f9fe9ff5995c50e84"} Jun 06 13:05:32.615921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:32.615831 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wlqlz" podStartSLOduration=10.849054159 podStartE2EDuration="14.615811301s" totalImagesPullingTime="3.668868484s" totalInitContainerRuntime="97.888658ms" isStatefulPod=true podCreationTimestamp="2026-06-06 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:32.614629219 +0000 UTC m=+271.474711655" watchObservedRunningTime="2026-06-06 13:05:32.615811301 +0000 UTC m=+271.475893711" Jun 06 13:05:33.610653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:33.610614 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"585e4aedb63be6bd15c6644944e9d9ff6d04f031da62d3e63fc01f69a04a7daf"} Jun 06 13:05:33.933833 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:33.933795 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:33.934041 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:33.933893 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:05:33.935502 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:33.935377 2550 patch_prober.go:28] interesting pod/console-dddb955f6-q89wx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 13:05:33.935502 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:33.935426 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-dddb955f6-q89wx" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 13:05:34.172244 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.172209 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:34.621120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.620699 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"aa672bbc582aa1b82eb0c7c35ae40c1a7afa54365b85f6ab8fe57f5095c851ed"} Jun 06 13:05:34.621120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.620829 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:34.621120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.620871 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" event={"ID":"9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8","Type":"ContainerStarted","Data":"8abaa1b79d02ea97f53737a0884ce1f982fd0c7bfad9ce638961b22fb102d186"} Jun 06 13:05:34.623805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.623776 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af"} Jun 06 13:05:34.643593 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:34.643533 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" podStartSLOduration=8.549017343 podStartE2EDuration="13.643509915s" totalImagesPullingTime="5.094492572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:34.640432608 +0000 UTC m=+273.500515045" watchObservedRunningTime="2026-06-06 13:05:34.643509915 +0000 UTC m=+273.503592326" Jun 06 13:05:36.635922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.635891 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0"} Jun 06 13:05:36.636325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.635967 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e"} Jun 06 13:05:36.636325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.636035 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad"} Jun 06 13:05:36.636325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.636070 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd"} Jun 06 13:05:36.636325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.636107 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerStarted","Data":"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4"} Jun 06 13:05:36.639304 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.639282 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} Jun 06 13:05:36.639395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.639334 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} Jun 06 13:05:36.639395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.639359 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} Jun 06 13:05:36.639395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.639385 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} Jun 06 13:05:36.639493 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.639408 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} Jun 06 13:05:36.662620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:36.662570 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=11.585366845 podStartE2EDuration="17.662555377s" totalImagesPullingTime="6.051517823s" totalInitContainerRuntime="25.670709ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:36.660100484 +0000 UTC m=+275.520182933" watchObservedRunningTime="2026-06-06 13:05:36.662555377 +0000 UTC m=+275.522637787" Jun 06 13:05:37.650496 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:37.650457 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerStarted","Data":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} Jun 06 13:05:37.678454 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:37.678396 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.921408695 podStartE2EDuration="13.678380864s" totalImagesPullingTime="7.729460607s" totalInitContainerRuntime="27.511562ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:37.675236502 +0000 UTC m=+276.535318932" watchObservedRunningTime="2026-06-06 13:05:37.678380864 +0000 UTC m=+276.538463313" Jun 06 13:05:40.295826 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:40.295735 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:05:40.634594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:40.634568 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59bfd5bc44-xkkvr" Jun 06 13:05:42.166545 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:42.166500 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" podUID="7a83b9db-3de2-4638-947a-567751343ebe" Jun 06 13:05:42.166545 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:05:42.166499 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bstc6" podUID="b6c058b0-a11a-450b-997e-78810d873a47" Jun 06 13:05:42.672168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:42.672139 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:42.672330 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:42.672139 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:05:42.791480 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:42.791446 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:42.846730 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:42.846698 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:43.934253 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:43.934210 2550 patch_prober.go:28] interesting pod/console-dddb955f6-q89wx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 13:05:43.934638 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:43.934278 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-dddb955f6-q89wx" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 13:05:45.994645 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:45.994610 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:05:45.996946 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:45.996926 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"image-registry-6bdbc7c8cf-2pn6g\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:05:46.095999 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.095941 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:46.098104 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.098085 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c058b0-a11a-450b-997e-78810d873a47-metrics-tls\") pod \"dns-default-bstc6\" (UID: \"b6c058b0-a11a-450b-997e-78810d873a47\") " pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:46.276595 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.276542 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b82xj\"" Jun 06 13:05:46.276595 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.276544 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9w2\"" Jun 06 13:05:46.283830 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.283806 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:46.283943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.283916 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:05:46.458575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.458547 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bstc6"] Jun 06 13:05:46.460705 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:46.460676 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c058b0_a11a_450b_997e_78810d873a47.slice/crio-4fe24371c6c604bb95f5f8d16ce7d9335794dee48684816b2f617c1977a622e2 WatchSource:0}: Error finding container 4fe24371c6c604bb95f5f8d16ce7d9335794dee48684816b2f617c1977a622e2: Status 404 returned error can't find the container with id 4fe24371c6c604bb95f5f8d16ce7d9335794dee48684816b2f617c1977a622e2 Jun 06 13:05:46.487656 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.485628 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:05:46.491269 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:05:46.491239 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a83b9db_3de2_4638_947a_567751343ebe.slice/crio-3d445a27d5b16dbb18f8e96b5042eeb0ba4a8fd4eb635611b0744bc456934706 WatchSource:0}: Error finding container 3d445a27d5b16dbb18f8e96b5042eeb0ba4a8fd4eb635611b0744bc456934706: Status 404 returned error can't find the container with id 3d445a27d5b16dbb18f8e96b5042eeb0ba4a8fd4eb635611b0744bc456934706 Jun 06 13:05:46.690787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.690757 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" event={"ID":"7a83b9db-3de2-4638-947a-567751343ebe","Type":"ContainerStarted","Data":"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77"} Jun 06 13:05:46.690917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.690813 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" event={"ID":"7a83b9db-3de2-4638-947a-567751343ebe","Type":"ContainerStarted","Data":"3d445a27d5b16dbb18f8e96b5042eeb0ba4a8fd4eb635611b0744bc456934706"} Jun 06 13:05:46.690917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.690855 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:05:46.691725 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.691701 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bstc6" event={"ID":"b6c058b0-a11a-450b-997e-78810d873a47","Type":"ContainerStarted","Data":"4fe24371c6c604bb95f5f8d16ce7d9335794dee48684816b2f617c1977a622e2"} Jun 06 13:05:46.708970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:46.708921 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" podStartSLOduration=284.708905228 podStartE2EDuration="4m44.708905228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:46.708320627 +0000 UTC m=+285.568403059" watchObservedRunningTime="2026-06-06 13:05:46.708905228 +0000 UTC m=+285.568987639" Jun 06 13:05:47.122045 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:47.122009 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:47.172965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:47.172906 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:48.635166 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:48.635126 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-784b46c95f-5rgct" podUID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" containerName="console" containerID="cri-o://71ffcbc4fccf695eabd00efdeea62584c8ef0c46cf0eb13a72e30e1a728f009e" gracePeriod=15 Jun 06 13:05:49.300193 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.300173 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:49.352553 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.352517 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:49.708869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.708776 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bstc6" event={"ID":"b6c058b0-a11a-450b-997e-78810d873a47","Type":"ContainerStarted","Data":"083db0d8ecbbf4262aa81b51e16478833cc276c3bc134be471353d90476b862c"} Jun 06 13:05:49.708869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.708834 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bstc6" event={"ID":"b6c058b0-a11a-450b-997e-78810d873a47","Type":"ContainerStarted","Data":"669dd185c5abba6fc4bcd2882a8766e5d4c3f8010897bd21d2121d68f0a1be79"} Jun 06 13:05:49.708869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.708859 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:49.726947 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:49.726904 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bstc6" podStartSLOduration=251.04151406 podStartE2EDuration="4m13.726889575s" totalImagesPullingTime="2.685375515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:49.725629317 +0000 UTC m=+288.585711751" watchObservedRunningTime="2026-06-06 13:05:49.726889575 +0000 UTC m=+288.586971984" Jun 06 13:05:50.715052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:50.715019 2550 generic.go:356] "Generic (PLEG): container finished" podID="ad949d75-ea87-4266-a0db-3b853235aedf" containerID="3d4f820b7b1e047ce3a734fe70338b1e705f5bc1b01a5700f97d5354abfc3c38" exitCode=0 Jun 06 13:05:50.715502 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:50.715103 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wlpwq" event={"ID":"ad949d75-ea87-4266-a0db-3b853235aedf","Type":"ContainerDied","Data":"3d4f820b7b1e047ce3a734fe70338b1e705f5bc1b01a5700f97d5354abfc3c38"} Jun 06 13:05:50.715502 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:50.715448 2550 scope.go:117] "RemoveContainer" containerID="3d4f820b7b1e047ce3a734fe70338b1e705f5bc1b01a5700f97d5354abfc3c38" Jun 06 13:05:51.721024 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:51.720975 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wlpwq" event={"ID":"ad949d75-ea87-4266-a0db-3b853235aedf","Type":"ContainerStarted","Data":"17f3ecc5741fda25f69482aa923b65adf888ee93a1add350ae31a5a6e5c56d80"} Jun 06 13:05:53.638503 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:53.638456 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/init-config-reloader/0.log" Jun 06 13:05:53.838124 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:53.838069 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/alertmanager/0.log" Jun 06 13:05:53.934521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:53.934427 2550 patch_prober.go:28] interesting pod/console-dddb955f6-q89wx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 06 13:05:53.934521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:53.934488 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-dddb955f6-q89wx" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 06 13:05:54.038205 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:54.038173 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/config-reloader/0.log" Jun 06 13:05:54.237768 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:54.237698 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/kube-rbac-proxy-web/0.log" Jun 06 13:05:54.437873 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:54.437842 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/kube-rbac-proxy/0.log" Jun 06 13:05:54.637556 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:54.637529 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/kube-rbac-proxy-metric/0.log" Jun 06 13:05:54.837886 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:54.837860 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb8475d7-9951-47ea-8bea-4f038cc25654/prom-label-proxy/0.log" Jun 06 13:05:55.039533 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:55.039453 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-dcn7s_a19efd4e-8f57-4585-ba4e-a1b8f8d88331/cluster-monitoring-operator/0.log" Jun 06 13:05:55.740579 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:55.740548 2550 generic.go:356] "Generic (PLEG): container finished" podID="46fe47ac-f3fb-415a-aa34-bdef9aac279c" containerID="38f47a912bf4d9dabc0cb426422986ce48310c3d4a31479fd4b70e9b8a538c53" exitCode=0 Jun 06 13:05:55.740743 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:55.740621 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" event={"ID":"46fe47ac-f3fb-415a-aa34-bdef9aac279c","Type":"ContainerDied","Data":"38f47a912bf4d9dabc0cb426422986ce48310c3d4a31479fd4b70e9b8a538c53"} Jun 06 13:05:55.740929 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:55.740916 2550 scope.go:117] "RemoveContainer" containerID="38f47a912bf4d9dabc0cb426422986ce48310c3d4a31479fd4b70e9b8a538c53" Jun 06 13:05:56.038094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:56.038009 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-tdlsr_e32c53a0-afe8-4893-bfee-94f1a679579b/monitoring-plugin/0.log" Jun 06 13:05:56.643587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:56.643554 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:56.690374 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:56.690338 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:56.747068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:56.747031 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-54xm9" event={"ID":"46fe47ac-f3fb-415a-aa34-bdef9aac279c","Type":"ContainerStarted","Data":"1bd6c21430e149f3d93de2812a56b0459ebcabd47111e3499a447c97568be808"} Jun 06 13:05:57.437868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:57.437840 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/init-textfile/0.log" Jun 06 13:05:57.638520 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:57.638491 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/node-exporter/0.log" Jun 06 13:05:57.838250 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:57.838215 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/kube-rbac-proxy/0.log" Jun 06 13:05:58.259424 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:58.259352 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:58.306273 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:58.306246 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:05:58.638836 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:58.638808 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/init-config-reloader/0.log" Jun 06 13:05:58.838845 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:58.838803 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/prometheus/0.log" Jun 06 13:05:59.038036 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.037940 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/config-reloader/0.log" Jun 06 13:05:59.238103 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.238073 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/thanos-sidecar/0.log" Jun 06 13:05:59.438230 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.438201 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/kube-rbac-proxy-web/0.log" Jun 06 13:05:59.637599 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.637575 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/kube-rbac-proxy/0.log" Jun 06 13:05:59.717557 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.717482 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bstc6" Jun 06 13:05:59.763108 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.763076 2550 generic.go:356] "Generic (PLEG): container finished" podID="6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb" containerID="3e1d9a5c8304331a599c048517ccf7e8126ff3465a16f4340aed047450f0c669" exitCode=0 Jun 06 13:05:59.763225 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.763139 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" event={"ID":"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb","Type":"ContainerDied","Data":"3e1d9a5c8304331a599c048517ccf7e8126ff3465a16f4340aed047450f0c669"} Jun 06 13:05:59.763477 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.763461 2550 scope.go:117] "RemoveContainer" containerID="3e1d9a5c8304331a599c048517ccf7e8126ff3465a16f4340aed047450f0c669" Jun 06 13:05:59.837766 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:05:59.837742 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2d835be-1176-40e0-872d-faa1c2a0cbab/kube-rbac-proxy-thanos/0.log" Jun 06 13:06:00.039613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:00.039539 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpdgl_d809561d-2496-45fc-8f33-21c5a8de3a9c/prometheus-operator/0.log" Jun 06 13:06:00.237093 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:00.237067 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpdgl_d809561d-2496-45fc-8f33-21c5a8de3a9c/kube-rbac-proxy/0.log" Jun 06 13:06:00.438212 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:00.438187 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-v6zlh_93e7747a-5252-4b51-9e5e-9b73bbf7b08a/prometheus-operator-admission-webhook/0.log" Jun 06 13:06:00.769307 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:00.769221 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7d55w" event={"ID":"6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb","Type":"ContainerStarted","Data":"b10afea3b189c3653ed0620d3af5eef23c08be2ab2efbb25ae63fd7af8722a52"} Jun 06 13:06:01.238246 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.238218 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/thanos-query/0.log" Jun 06 13:06:01.438501 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.438470 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-web/0.log" Jun 06 13:06:01.561025 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.560997 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:06:01.562167 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.562142 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:06:01.565975 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.565955 2550 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 13:06:01.638559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.638436 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy/0.log" Jun 06 13:06:02.263407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:01.838232 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/prom-label-proxy/0.log" Jun 06 13:06:02.263407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:02.038535 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-rules/0.log" Jun 06 13:06:02.263407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:02.238256 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-metrics/0.log" Jun 06 13:06:02.779269 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:02.779240 2550 generic.go:356] "Generic (PLEG): container finished" podID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" containerID="71ffcbc4fccf695eabd00efdeea62584c8ef0c46cf0eb13a72e30e1a728f009e" exitCode=0 Jun 06 13:06:02.779399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:02.779278 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784b46c95f-5rgct" event={"ID":"ef48070c-a193-4ccf-8021-1aa4a96c2c47","Type":"ContainerDied","Data":"71ffcbc4fccf695eabd00efdeea62584c8ef0c46cf0eb13a72e30e1a728f009e"} Jun 06 13:06:02.914567 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:02.914539 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:06:03.052436 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052362 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052436 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052410 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052436 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052425 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052762 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052557 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgbhp\" (UniqueName: \"kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052762 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052636 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052762 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052703 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca\") pod \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\" (UID: \"ef48070c-a193-4ccf-8021-1aa4a96c2c47\") " Jun 06 13:06:03.052898 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.052802 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:03.053052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.053023 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config" (OuterVolumeSpecName: "console-config") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:03.053052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.053047 2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-oauth-serving-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.053159 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.053057 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:03.054657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.054635 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:03.054948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.054923 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:03.055087 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.054943 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp" (OuterVolumeSpecName: "kube-api-access-qgbhp") pod "ef48070c-a193-4ccf-8021-1aa4a96c2c47" (UID: "ef48070c-a193-4ccf-8021-1aa4a96c2c47"). InnerVolumeSpecName "kube-api-access-qgbhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:03.153521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.153484 2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-oauth-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.153521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.153514 2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-serving-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.153521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.153524 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgbhp\" (UniqueName: \"kubernetes.io/projected/ef48070c-a193-4ccf-8021-1aa4a96c2c47-kube-api-access-qgbhp\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.153521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.153533 2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-console-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.153793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.153543 2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef48070c-a193-4ccf-8021-1aa4a96c2c47-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:03.441433 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.441407 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784b46c95f-5rgct_ef48070c-a193-4ccf-8021-1aa4a96c2c47/console/0.log" Jun 06 13:06:03.637944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.637916 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dddb955f6-q89wx_bf04d606-b13f-4d52-b0cf-2610e363c2cb/console/0.log" Jun 06 13:06:03.784349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.784271 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784b46c95f-5rgct" Jun 06 13:06:03.784349 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.784292 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784b46c95f-5rgct" event={"ID":"ef48070c-a193-4ccf-8021-1aa4a96c2c47","Type":"ContainerDied","Data":"2e3b8a414eb21c1bba87e1ae8db076437c9b25d5b373416a96fbdcabdd2f7c9c"} Jun 06 13:06:03.784523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.784355 2550 scope.go:117] "RemoveContainer" containerID="71ffcbc4fccf695eabd00efdeea62584c8ef0c46cf0eb13a72e30e1a728f009e" Jun 06 13:06:03.800223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.800201 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:06:03.805499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.805478 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784b46c95f-5rgct"] Jun 06 13:06:03.838645 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.838620 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-wqrx6_5beb5589-a262-4f57-aaa3-f681ef7801f6/download-server/0.log" Jun 06 13:06:03.937735 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.937710 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:06:03.941423 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:03.941398 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:06:04.038792 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:04.038718 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bstc6_b6c058b0-a11a-450b-997e-78810d873a47/dns/0.log" Jun 06 13:06:04.087161 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:04.087113 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:04.238751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:04.238726 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bstc6_b6c058b0-a11a-450b-997e-78810d873a47/kube-rbac-proxy/0.log" Jun 06 13:06:05.292928 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:05.292898 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:05.442867 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:05.442842 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kn46z_812616d7-e431-4994-9d41-36a329a8aa27/dns-node-resolver/0.log" Jun 06 13:06:05.609636 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:05.609605 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" path="/var/lib/kubelet/pods/ef48070c-a193-4ccf-8021-1aa4a96c2c47/volumes" Jun 06 13:06:05.838072 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:05.838047 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bdbc7c8cf-2pn6g_7a83b9db-3de2-4638-947a-567751343ebe/registry/0.log" Jun 06 13:06:06.288101 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:06.288068 2550 patch_prober.go:28] interesting pod/image-registry-6bdbc7c8cf-2pn6g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 13:06:06.288260 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:06.288123 2550 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" podUID="7a83b9db-3de2-4638-947a-567751343ebe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 13:06:06.638118 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:06.638091 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxqt8_04ab0a67-e8b2-4b52-a2ad-89af7fbd9185/node-ca/0.log" Jun 06 13:06:07.037761 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:07.037685 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56skw_5b934b99-dced-4990-a1bf-2f906fe62350/serve-healthcheck-canary/0.log" Jun 06 13:06:07.702167 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:07.702140 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:06:07.868045 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:07.868009 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:07.918634 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:07.918594 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:08.819234 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:08.819205 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:08.920136 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:08.920101 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.114576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.114490 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:06:09.212006 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.211923 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.265151 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.265037 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.412055 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.411952 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:06:09.483566 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.483530 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.533700 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.533677 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.866893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.866859 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:09.919310 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:09.919234 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:16.075913 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:16.075878 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:16.173398 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:16.173364 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:20.990656 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:20.990616 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:22.266142 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:22.266106 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:22.314326 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:22.314302 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:25.295383 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:25.295348 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:25.315249 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:25.315222 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:25.902633 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:25.902605 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:28.264950 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:28.264901 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:28.365142 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:28.365107 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:31.372544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:31.372506 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:31.473811 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:31.473779 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:34.135402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.135360 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dddb955f6-q89wx" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" containerID="cri-o://6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544" gracePeriod=15 Jun 06 13:06:34.392279 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.392227 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:06:34.441482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.441450 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" podUID="7a83b9db-3de2-4638-947a-567751343ebe" containerName="registry" containerID="cri-o://c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77" gracePeriod=30 Jun 06 13:06:34.545652 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545623 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.545814 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545658 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.545814 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545723 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.545814 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545777 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.545814 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545804 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.546056 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545831 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.546056 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545864 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cff6p\" (UniqueName: \"kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p\") pod \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\" (UID: \"bf04d606-b13f-4d52-b0cf-2610e363c2cb\") " Jun 06 13:06:34.546056 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.545932 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:34.546261 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.546205 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:34.546261 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.546238 2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-oauth-serving-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.546399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.546377 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config" (OuterVolumeSpecName: "console-config") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:34.546399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.546386 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:34.548015 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.547971 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:34.548102 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.548032 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:34.548102 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.548056 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p" (OuterVolumeSpecName: "kube-api-access-cff6p") pod "bf04d606-b13f-4d52-b0cf-2610e363c2cb" (UID: "bf04d606-b13f-4d52-b0cf-2610e363c2cb"). InnerVolumeSpecName "kube-api-access-cff6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646770 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-trusted-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646793 2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646802 2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-oauth-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646810 2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646818 2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf04d606-b13f-4d52-b0cf-2610e363c2cb-console-serving-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.646837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.646826 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cff6p\" (UniqueName: \"kubernetes.io/projected/bf04d606-b13f-4d52-b0cf-2610e363c2cb-kube-api-access-cff6p\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:34.833408 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.833380 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:34.926276 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.926193 2550 generic.go:356] "Generic (PLEG): container finished" podID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerID="6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544" exitCode=0 Jun 06 13:06:34.926276 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.926232 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dddb955f6-q89wx" Jun 06 13:06:34.926441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.926278 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dddb955f6-q89wx" event={"ID":"bf04d606-b13f-4d52-b0cf-2610e363c2cb","Type":"ContainerDied","Data":"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544"} Jun 06 13:06:34.926441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.926323 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dddb955f6-q89wx" event={"ID":"bf04d606-b13f-4d52-b0cf-2610e363c2cb","Type":"ContainerDied","Data":"13abf7d7b39de3493eef7ca909436ab334c6095dff6219b824d00b2e109695e5"} Jun 06 13:06:34.926441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.926344 2550 scope.go:117] "RemoveContainer" containerID="6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544" Jun 06 13:06:34.932184 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.932162 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:34.936136 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.936115 2550 scope.go:117] "RemoveContainer" containerID="6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544" Jun 06 13:06:34.936403 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:34.936382 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544\": container with ID starting with 6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544 not found: ID does not exist" containerID="6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544" Jun 06 13:06:34.936461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.936411 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544"} err="failed to get container status \"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544\": rpc error: code = NotFound desc = could not find container \"6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544\": container with ID starting with 6053c036ce60988e41cf8dbb662fa7b23291a89414dc1b0f6764419c36270544 not found: ID does not exist" Jun 06 13:06:34.951120 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.951098 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:06:34.961450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:34.961427 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dddb955f6-q89wx"] Jun 06 13:06:35.029615 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.029589 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:35.149197 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.149162 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:35.247365 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.247290 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:35.532842 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.532817 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:35.581578 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.581552 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:35.610650 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.610512 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" path="/var/lib/kubelet/pods/bf04d606-b13f-4d52-b0cf-2610e363c2cb/volumes" Jun 06 13:06:35.689765 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.689744 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:06:35.755957 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.755928 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-824sl\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756028 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756068 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756102 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756147 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756132 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756164 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756210 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756274 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration\") pod \"7a83b9db-3de2-4638-947a-567751343ebe\" (UID: \"7a83b9db-3de2-4638-947a-567751343ebe\") " Jun 06 13:06:35.756601 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756558 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:35.756901 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.756871 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:35.758840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.758812 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:35.758943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.758869 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl" (OuterVolumeSpecName: "kube-api-access-824sl") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "kube-api-access-824sl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:35.759084 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.759064 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:35.759393 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.759365 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:35.759494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.759467 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:35.764849 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.764822 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7a83b9db-3de2-4638-947a-567751343ebe" (UID: "7a83b9db-3de2-4638-947a-567751343ebe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:06:35.857580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857552 2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-registry-certificates\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857577 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a83b9db-3de2-4638-947a-567751343ebe-trusted-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857586 2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-installation-pull-secrets\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857791 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857596 2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-bound-sa-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857791 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857604 2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-registry-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857791 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857613 2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a83b9db-3de2-4638-947a-567751343ebe-ca-trust-extracted\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857791 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857622 2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a83b9db-3de2-4638-947a-567751343ebe-image-registry-private-configuration\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.857791 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.857632 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-824sl\" (UniqueName: \"kubernetes.io/projected/7a83b9db-3de2-4638-947a-567751343ebe-kube-api-access-824sl\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:35.932388 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.932360 2550 generic.go:356] "Generic (PLEG): container finished" podID="7a83b9db-3de2-4638-947a-567751343ebe" containerID="c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77" exitCode=0 Jun 06 13:06:35.932548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.932394 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" event={"ID":"7a83b9db-3de2-4638-947a-567751343ebe","Type":"ContainerDied","Data":"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77"} Jun 06 13:06:35.932548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.932400 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" Jun 06 13:06:35.932548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.932427 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g" event={"ID":"7a83b9db-3de2-4638-947a-567751343ebe","Type":"ContainerDied","Data":"3d445a27d5b16dbb18f8e96b5042eeb0ba4a8fd4eb635611b0744bc456934706"} Jun 06 13:06:35.932548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.932446 2550 scope.go:117] "RemoveContainer" containerID="c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77" Jun 06 13:06:35.941431 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.941412 2550 scope.go:117] "RemoveContainer" containerID="c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77" Jun 06 13:06:35.941689 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:35.941668 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77\": container with ID starting with c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77 not found: ID does not exist" containerID="c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77" Jun 06 13:06:35.941754 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.941701 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77"} err="failed to get container status \"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77\": rpc error: code = NotFound desc = could not find container \"c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77\": container with ID starting with c8e2a2ec97a517ba83618513494ece0c96384c3dcf54879e439f2ba87a904a77 not found: ID does not exist" Jun 06 13:06:35.952531 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.952510 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:06:35.959818 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:35.959797 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bdbc7c8cf-2pn6g"] Jun 06 13:06:36.944917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:36.944882 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:36.994521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:36.994487 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:37.613019 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:37.610860 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a83b9db-3de2-4638-947a-567751343ebe" path="/var/lib/kubelet/pods/7a83b9db-3de2-4638-947a-567751343ebe/volumes" Jun 06 13:06:39.082829 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.082789 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:06:39.083357 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.083180 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="alertmanager" containerID="cri-o://79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" gracePeriod=120 Jun 06 13:06:39.083357 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.083271 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="prom-label-proxy" containerID="cri-o://4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" gracePeriod=120 Jun 06 13:06:39.083357 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.083282 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-web" containerID="cri-o://e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" gracePeriod=120 Jun 06 13:06:39.083497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.083309 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="config-reloader" containerID="cri-o://ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" gracePeriod=120 Jun 06 13:06:39.083497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.083343 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy" containerID="cri-o://3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" gracePeriod=120 Jun 06 13:06:39.084270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.084199 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-metric" containerID="cri-o://acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" gracePeriod=120 Jun 06 13:06:39.957089 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957051 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" exitCode=0 Jun 06 13:06:39.957089 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957084 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" exitCode=0 Jun 06 13:06:39.957089 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957093 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" exitCode=0 Jun 06 13:06:39.957311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957099 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" exitCode=0 Jun 06 13:06:39.957311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957128 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0"} Jun 06 13:06:39.957311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957189 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad"} Jun 06 13:06:39.957311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957215 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4"} Jun 06 13:06:39.957311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:39.957240 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af"} Jun 06 13:06:40.337231 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.337207 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:06:40.500434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500341 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500380 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500402 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500425 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500455 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500479 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500518 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500569 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500597 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500643 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500689 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500716 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.500772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.500766 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy\") pod \"eb8475d7-9951-47ea-8bea-4f038cc25654\" (UID: \"eb8475d7-9951-47ea-8bea-4f038cc25654\") " Jun 06 13:06:40.501342 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.501312 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:06:40.502287 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.501695 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:40.502287 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.502062 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:40.503558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.503297 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out" (OuterVolumeSpecName: "config-out") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:06:40.503558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.503422 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.503558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.503455 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.503558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.503493 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume" (OuterVolumeSpecName: "config-volume") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.503816 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.503613 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.504880 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.504849 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf" (OuterVolumeSpecName: "kube-api-access-mczvf") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "kube-api-access-mczvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:40.505198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.505179 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:40.505753 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.505725 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.508704 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.508683 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.515231 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.515211 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config" (OuterVolumeSpecName: "web-config") pod "eb8475d7-9951-47ea-8bea-4f038cc25654" (UID: "eb8475d7-9951-47ea-8bea-4f038cc25654"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:40.602410 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602381 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-web-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602410 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602405 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-tls-assets\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602410 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602416 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602426 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602437 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/eb8475d7-9951-47ea-8bea-4f038cc25654-kube-api-access-mczvf\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602447 2550 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-cluster-tls-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602455 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-config-out\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602463 2550 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-config-volume\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602471 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-main-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602479 2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602487 2550 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb8475d7-9951-47ea-8bea-4f038cc25654-metrics-client-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602495 2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb8475d7-9951-47ea-8bea-4f038cc25654-alertmanager-main-db\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.602603 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.602504 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb8475d7-9951-47ea-8bea-4f038cc25654-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:40.964179 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964144 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" exitCode=0 Jun 06 13:06:40.964179 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964172 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerID="e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" exitCode=0 Jun 06 13:06:40.964444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964222 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e"} Jun 06 13:06:40.964444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964294 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd"} Jun 06 13:06:40.964444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964239 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:06:40.964444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964329 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb8475d7-9951-47ea-8bea-4f038cc25654","Type":"ContainerDied","Data":"eb67c5eb403aeef0d2d3189e63ab5527329c2f8c152642c2c560e9c49f9cccf9"} Jun 06 13:06:40.964444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.964361 2550 scope.go:117] "RemoveContainer" containerID="4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" Jun 06 13:06:40.973179 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.973155 2550 scope.go:117] "RemoveContainer" containerID="acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" Jun 06 13:06:40.980112 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.980092 2550 scope.go:117] "RemoveContainer" containerID="3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" Jun 06 13:06:40.986499 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.986484 2550 scope.go:117] "RemoveContainer" containerID="e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" Jun 06 13:06:40.989566 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.989540 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:06:40.994260 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.994237 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:06:40.994494 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:40.994481 2550 scope.go:117] "RemoveContainer" containerID="ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" Jun 06 13:06:41.001242 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.001224 2550 scope.go:117] "RemoveContainer" containerID="79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" Jun 06 13:06:41.008007 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.007977 2550 scope.go:117] "RemoveContainer" containerID="60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4" Jun 06 13:06:41.014790 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.014770 2550 scope.go:117] "RemoveContainer" containerID="4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" Jun 06 13:06:41.015229 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.015202 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0\": container with ID starting with 4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0 not found: ID does not exist" containerID="4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" Jun 06 13:06:41.015542 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.015238 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0"} err="failed to get container status \"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0\": rpc error: code = NotFound desc = could not find container \"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0\": container with ID starting with 4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0 not found: ID does not exist" Jun 06 13:06:41.015542 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.015264 2550 scope.go:117] "RemoveContainer" containerID="acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" Jun 06 13:06:41.015673 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.015646 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e\": container with ID starting with acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e not found: ID does not exist" containerID="acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" Jun 06 13:06:41.015721 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.015677 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e"} err="failed to get container status \"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e\": rpc error: code = NotFound desc = could not find container \"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e\": container with ID starting with acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e not found: ID does not exist" Jun 06 13:06:41.015721 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.015699 2550 scope.go:117] "RemoveContainer" containerID="3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" Jun 06 13:06:41.016029 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.016010 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad\": container with ID starting with 3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad not found: ID does not exist" containerID="3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" Jun 06 13:06:41.016105 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016034 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad"} err="failed to get container status \"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad\": rpc error: code = NotFound desc = could not find container \"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad\": container with ID starting with 3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad not found: ID does not exist" Jun 06 13:06:41.016105 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016049 2550 scope.go:117] "RemoveContainer" containerID="e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" Jun 06 13:06:41.016297 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.016281 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd\": container with ID starting with e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd not found: ID does not exist" containerID="e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" Jun 06 13:06:41.016342 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016304 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd"} err="failed to get container status \"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd\": rpc error: code = NotFound desc = could not find container \"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd\": container with ID starting with e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd not found: ID does not exist" Jun 06 13:06:41.016342 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016319 2550 scope.go:117] "RemoveContainer" containerID="ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" Jun 06 13:06:41.016537 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.016522 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4\": container with ID starting with ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4 not found: ID does not exist" containerID="ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" Jun 06 13:06:41.016574 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016539 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4"} err="failed to get container status \"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4\": rpc error: code = NotFound desc = could not find container \"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4\": container with ID starting with ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4 not found: ID does not exist" Jun 06 13:06:41.016574 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016551 2550 scope.go:117] "RemoveContainer" containerID="79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" Jun 06 13:06:41.016729 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.016713 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af\": container with ID starting with 79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af not found: ID does not exist" containerID="79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" Jun 06 13:06:41.016775 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016732 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af"} err="failed to get container status \"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af\": rpc error: code = NotFound desc = could not find container \"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af\": container with ID starting with 79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af not found: ID does not exist" Jun 06 13:06:41.016775 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016743 2550 scope.go:117] "RemoveContainer" containerID="60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4" Jun 06 13:06:41.016927 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:41.016912 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4\": container with ID starting with 60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4 not found: ID does not exist" containerID="60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4" Jun 06 13:06:41.016963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016929 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4"} err="failed to get container status \"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4\": rpc error: code = NotFound desc = could not find container \"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4\": container with ID starting with 60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4 not found: ID does not exist" Jun 06 13:06:41.016963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.016940 2550 scope.go:117] "RemoveContainer" containerID="4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0" Jun 06 13:06:41.017199 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017183 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0"} err="failed to get container status \"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0\": rpc error: code = NotFound desc = could not find container \"4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0\": container with ID starting with 4250b589c1fa3f4ac7e71ea762ed168d4b6bc8fe164904c85552b4660f2e25e0 not found: ID does not exist" Jun 06 13:06:41.017250 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017200 2550 scope.go:117] "RemoveContainer" containerID="acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e" Jun 06 13:06:41.017416 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017398 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e"} err="failed to get container status \"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e\": rpc error: code = NotFound desc = could not find container \"acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e\": container with ID starting with acc07e55a5910c2a87bc6b6f66ab3f29c30128a977c39fa33e1a7f66def0045e not found: ID does not exist" Jun 06 13:06:41.017453 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017417 2550 scope.go:117] "RemoveContainer" containerID="3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad" Jun 06 13:06:41.017635 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017617 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad"} err="failed to get container status \"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad\": rpc error: code = NotFound desc = could not find container \"3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad\": container with ID starting with 3c44ae39320c5e3eda5b81633b0a7ca14ead2929dab9cb6c170031adbe577dad not found: ID does not exist" Jun 06 13:06:41.017684 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017645 2550 scope.go:117] "RemoveContainer" containerID="e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd" Jun 06 13:06:41.017865 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017849 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd"} err="failed to get container status \"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd\": rpc error: code = NotFound desc = could not find container \"e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd\": container with ID starting with e72f88320e884415e177a47d7e41c24606c839a7e74599594e57f5f3a9f695fd not found: ID does not exist" Jun 06 13:06:41.017905 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.017866 2550 scope.go:117] "RemoveContainer" containerID="ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4" Jun 06 13:06:41.018094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.018078 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4"} err="failed to get container status \"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4\": rpc error: code = NotFound desc = could not find container \"ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4\": container with ID starting with ec61343aa1384427633deae20bd744ce238b259da9cc65bf57b51f1a190464f4 not found: ID does not exist" Jun 06 13:06:41.018094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.018094 2550 scope.go:117] "RemoveContainer" containerID="79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af" Jun 06 13:06:41.018294 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.018273 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af"} err="failed to get container status \"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af\": rpc error: code = NotFound desc = could not find container \"79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af\": container with ID starting with 79a585d5d4dcd854660a7f7c8baaac3e87b3a9b062c71d9eec6e5adbbefa34af not found: ID does not exist" Jun 06 13:06:41.018294 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.018292 2550 scope.go:117] "RemoveContainer" containerID="60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4" Jun 06 13:06:41.018546 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.018523 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4"} err="failed to get container status \"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4\": rpc error: code = NotFound desc = could not find container \"60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4\": container with ID starting with 60e4fe46e70f07a3ddac32b651d878a6a121f965e9a7f33941e7cc63771d9fa4 not found: ID does not exist" Jun 06 13:06:41.613902 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:41.613870 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" path="/var/lib/kubelet/pods/eb8475d7-9951-47ea-8bea-4f038cc25654/volumes" Jun 06 13:06:43.261259 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.261225 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:43.316305 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316265 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:43.316824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316644 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="prometheus" containerID="cri-o://ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" gracePeriod=600 Jun 06 13:06:43.316824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316667 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-web" containerID="cri-o://74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" gracePeriod=600 Jun 06 13:06:43.316824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316688 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="config-reloader" containerID="cri-o://3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" gracePeriod=600 Jun 06 13:06:43.316824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316722 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy" containerID="cri-o://b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" gracePeriod=600 Jun 06 13:06:43.316824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316736 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="thanos-sidecar" containerID="cri-o://a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" gracePeriod=600 Jun 06 13:06:43.317196 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.316652 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" gracePeriod=600 Jun 06 13:06:43.318227 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.318201 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:43.589184 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.589157 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:43.734648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734613 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734648 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734681 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734708 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734742 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734783 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734807 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.734893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.734834 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735053 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735077 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735114 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735158 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735194 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735226 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735263 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735292 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcntd\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735321 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735347 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735375 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735377 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735407 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735467 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.735559 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735509 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls\") pod \"c2d835be-1176-40e0-872d-faa1c2a0cbab\" (UID: \"c2d835be-1176-40e0-872d-faa1c2a0cbab\") " Jun 06 13:06:43.736018 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735778 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-metrics-client-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.736018 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735797 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.736018 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.735814 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.736169 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.736104 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:06:43.737750 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.737710 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.737915 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.737876 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.738458 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738427 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.738666 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738642 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:43.738740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738723 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out" (OuterVolumeSpecName: "config-out") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:06:43.738798 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738753 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:43.738798 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738785 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.738907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.738850 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.739171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.739136 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.739364 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.739328 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.739485 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.739372 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.739602 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.739560 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.739848 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.739819 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.740358 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.740334 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config" (OuterVolumeSpecName: "config") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.740568 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.740549 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd" (OuterVolumeSpecName: "kube-api-access-wcntd") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "kube-api-access-wcntd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:43.748873 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.748849 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config" (OuterVolumeSpecName: "web-config") pod "c2d835be-1176-40e0-872d-faa1c2a0cbab" (UID: "c2d835be-1176-40e0-872d-faa1c2a0cbab"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836613 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836643 2550 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-grpc-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836654 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-config-out\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836662 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-web-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836672 2550 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-metrics-client-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836680 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836689 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-db\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.836695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836698 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-tls-assets\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836707 2550 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-kube-rbac-proxy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836715 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836723 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836733 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836741 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcntd\" (UniqueName: \"kubernetes.io/projected/c2d835be-1176-40e0-872d-faa1c2a0cbab-kube-api-access-wcntd\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836749 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836758 2550 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836767 2550 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2d835be-1176-40e0-872d-faa1c2a0cbab-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.837094 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.836775 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d835be-1176-40e0-872d-faa1c2a0cbab-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:06:43.899371 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.899333 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:43.949368 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.949336 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:43.979482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979454 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" exitCode=0 Jun 06 13:06:43.979482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979483 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" exitCode=0 Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979493 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" exitCode=0 Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979502 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" exitCode=0 Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979513 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" exitCode=0 Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979521 2550 generic.go:356] "Generic (PLEG): container finished" podID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" exitCode=0 Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979547 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:43.979639 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979540 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} Jun 06 13:06:43.979807 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979685 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} Jun 06 13:06:43.979807 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979731 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} Jun 06 13:06:43.979807 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979750 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:43.979807 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979774 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} Jun 06 13:06:43.979977 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979816 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} Jun 06 13:06:43.979977 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979857 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} Jun 06 13:06:43.979977 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.979896 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2d835be-1176-40e0-872d-faa1c2a0cbab","Type":"ContainerDied","Data":"7da99b8ddd02362b5ffaf860b48a7759d9b6f616a5200ed8cd883478128e3862"} Jun 06 13:06:43.987893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.987875 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:43.995251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:43.995236 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.002074 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.002059 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.002375 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.002357 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:44.008944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.008926 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.009706 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.009686 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:44.015571 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.015556 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.023402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.023384 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.030020 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.029992 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.030265 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.030248 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.030320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030272 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.030320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030289 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.030519 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.030502 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.030594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030519 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.030594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030531 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.030781 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.030751 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.030844 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030789 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.030844 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.030812 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.031126 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.031110 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.031202 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031133 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.031202 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031152 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.031418 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.031399 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.031458 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031425 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.031458 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031444 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.031851 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.031714 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.031851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031824 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.031851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.031854 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.032481 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:06:44.032429 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.032481 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.032461 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.032481 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.032475 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.032777 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.032749 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.032829 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.032779 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.033075 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033054 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.033152 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033078 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.033316 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033298 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.033397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033318 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.033598 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033575 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.033653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033600 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.033723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033708 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:44.033839 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033821 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.033882 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.033840 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.034063 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034046 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-metric" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034065 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-metric" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034080 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034089 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034102 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="init-config-reloader" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034111 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="init-config-reloader" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034120 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="init-config-reloader" Jun 06 13:06:44.034125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034126 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="init-config-reloader" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034133 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a83b9db-3de2-4638-947a-567751343ebe" containerName="registry" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034138 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a83b9db-3de2-4638-947a-567751343ebe" containerName="registry" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034145 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="prom-label-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034142 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034166 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034153 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="prom-label-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034223 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034232 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034240 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" containerName="console" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034245 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" containerName="console" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034254 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034259 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034267 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="prometheus" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034272 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="prometheus" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034281 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="thanos-sidecar" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034288 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="thanos-sidecar" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034302 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034308 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034319 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="config-reloader" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034325 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="config-reloader" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034334 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-thanos" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034343 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-thanos" Jun 06 13:06:44.034346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034354 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034360 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034369 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="alertmanager" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034374 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="alertmanager" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034380 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="config-reloader" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034385 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="config-reloader" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034393 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034409 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034466 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034478 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-metric" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034487 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034493 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy-thanos" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034500 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="prom-label-proxy" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034509 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="thanos-sidecar" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034517 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a83b9db-3de2-4638-947a-567751343ebe" containerName="registry" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034526 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="kube-rbac-proxy-web" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034533 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="config-reloader" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034543 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="alertmanager" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034551 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8475d7-9951-47ea-8bea-4f038cc25654" containerName="config-reloader" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034560 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="prometheus" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034570 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf04d606-b13f-4d52-b0cf-2610e363c2cb" containerName="console" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034582 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" containerName="kube-rbac-proxy" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034591 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef48070c-a193-4ccf-8021-1aa4a96c2c47" containerName="console" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034649 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034666 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034942 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.034960 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.035235 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.035620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.035258 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.036910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.035496 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.036910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.035511 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037088 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037116 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037349 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037368 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037548 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.037747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.037566 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.038218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038171 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.038218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038194 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.038469 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038450 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.038521 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038470 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.038682 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038666 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.038726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038682 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.038913 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038892 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.038965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.038915 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.039173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039156 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.039214 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039173 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.039374 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039355 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.039437 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039374 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.039584 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039568 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.039626 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039585 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.039788 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039768 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.039788 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.039786 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.040052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040036 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.040104 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040051 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.040240 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040225 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.040283 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040240 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.040444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040425 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.040510 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040445 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.040694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040673 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.040762 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040697 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.040975 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040903 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.040975 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040929 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.040975 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.040949 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.041551 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.041525 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.041693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.041553 2550 scope.go:117] "RemoveContainer" containerID="3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7" Jun 06 13:06:44.041922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.041887 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7"} err="failed to get container status \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": rpc error: code = NotFound desc = could not find container \"3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7\": container with ID starting with 3f89b7b862aed5edbb8395d1b16778df63b623ba1a10677b4bb96cd95c0999f7 not found: ID does not exist" Jun 06 13:06:44.041922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.041912 2550 scope.go:117] "RemoveContainer" containerID="b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5" Jun 06 13:06:44.042320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042248 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5"} err="failed to get container status \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": rpc error: code = NotFound desc = could not find container \"b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5\": container with ID starting with b4c5fd131e0755fe230faab3e5e19fba16c433972085890473b75dfffbd7eda5 not found: ID does not exist" Jun 06 13:06:44.042320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042277 2550 scope.go:117] "RemoveContainer" containerID="74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191" Jun 06 13:06:44.042543 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042511 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191"} err="failed to get container status \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": rpc error: code = NotFound desc = could not find container \"74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191\": container with ID starting with 74cb2d955eb22902c8173cd5292241410c7a96fcb939a8891f7b53ac614ff191 not found: ID does not exist" Jun 06 13:06:44.042543 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042530 2550 scope.go:117] "RemoveContainer" containerID="a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f" Jun 06 13:06:44.042747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042732 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f"} err="failed to get container status \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": rpc error: code = NotFound desc = could not find container \"a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f\": container with ID starting with a73b9ceaaa0642fac257fdd4eb892cb3e33901fb81675b38c79a2b908e89784f not found: ID does not exist" Jun 06 13:06:44.042747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042746 2550 scope.go:117] "RemoveContainer" containerID="3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0" Jun 06 13:06:44.042964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042926 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0"} err="failed to get container status \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": rpc error: code = NotFound desc = could not find container \"3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0\": container with ID starting with 3e6ca05d7e7f4a57fba02ce9c608cef3b56fc3f0d4e110054654e92c3224fef0 not found: ID does not exist" Jun 06 13:06:44.042964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.042964 2550 scope.go:117] "RemoveContainer" containerID="ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a" Jun 06 13:06:44.043251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.043232 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a"} err="failed to get container status \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": rpc error: code = NotFound desc = could not find container \"ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a\": container with ID starting with ec60b292474548069409b06a8bf0887b2a7e5906ad46e90ea79edf2529cbc61a not found: ID does not exist" Jun 06 13:06:44.043251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.043248 2550 scope.go:117] "RemoveContainer" containerID="65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5" Jun 06 13:06:44.043582 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.043516 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5"} err="failed to get container status \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": rpc error: code = NotFound desc = could not find container \"65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5\": container with ID starting with 65a3a1689542b3cf6f59353a94df7b1e9f7a85c0b353caefacd45cfe695a53b5 not found: ID does not exist" Jun 06 13:06:44.043582 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.043532 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 13:06:44.043748 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.043733 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 13:06:44.044073 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044054 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 13:06:44.044166 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044076 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 13:06:44.044224 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044190 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 13:06:44.044276 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044259 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 13:06:44.044351 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044332 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 13:06:44.044351 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044343 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 13:06:44.044457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044348 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l8lfq\"" Jun 06 13:06:44.044714 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044694 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ced53du6bg2o9\"" Jun 06 13:06:44.044805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044733 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 13:06:44.044876 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.044839 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 13:06:44.045868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.045053 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 13:06:44.045868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.045275 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 13:06:44.045868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.045371 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 13:06:44.053853 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.053830 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 13:06:44.054842 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.054820 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:44.055437 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.055418 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 13:06:44.138709 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138622 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138709 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138659 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138709 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138686 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138732 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138774 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138807 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138844 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138867 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.138943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138915 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138946 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.138975 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pvl\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-kube-api-access-b9pvl\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139062 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139088 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139115 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139162 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139193 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139220 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139238 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139255 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.139344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.139280 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240284 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240323 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240536 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240345 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240585 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240659 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240618 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240659 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240652 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240784 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240684 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.240784 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.240710 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241243 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241216 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241259 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241282 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241292 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241350 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pvl\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-kube-api-access-b9pvl\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241391 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241418 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241463 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241512 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241544 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241574 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241599 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241625 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.241934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241746 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.242128 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.241939 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.243253 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.242555 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.243253 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.243220 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.243253 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.243218 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.243467 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.243392 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244225 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244199 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244319 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244281 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244319 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244301 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244440 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244385 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244493 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244451 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244678 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244653 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.244812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.244790 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.245950 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.245931 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.246090 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.246067 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.246376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.246360 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.246583 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.246566 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.246767 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.246750 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.249495 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.249475 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pvl\" (UniqueName: \"kubernetes.io/projected/9193330a-d0f7-4e7b-b58c-1eaf68edd58a-kube-api-access-b9pvl\") pod \"prometheus-k8s-0\" (UID: \"9193330a-d0f7-4e7b-b58c-1eaf68edd58a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.356449 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.356419 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:44.408966 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.408929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:44.488322 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.488289 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:06:44.490216 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.490182 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:44.491527 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:06:44.491506 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9193330a_d0f7_4e7b_b58c_1eaf68edd58a.slice/crio-772e239cac0fbb6811eb5589a014d7d8ad8ad0714d7d21caa24f0ada15eec553 WatchSource:0}: Error finding container 772e239cac0fbb6811eb5589a014d7d8ad8ad0714d7d21caa24f0ada15eec553: Status 404 returned error can't find the container with id 772e239cac0fbb6811eb5589a014d7d8ad8ad0714d7d21caa24f0ada15eec553 Jun 06 13:06:44.543435 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.543413 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:44.986062 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.986026 2550 generic.go:356] "Generic (PLEG): container finished" podID="9193330a-d0f7-4e7b-b58c-1eaf68edd58a" containerID="e8dd91e79f465975befa6ca3ca014ed0fb140ded351bdc242a019f175b26b458" exitCode=0 Jun 06 13:06:44.986255 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.986109 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerDied","Data":"e8dd91e79f465975befa6ca3ca014ed0fb140ded351bdc242a019f175b26b458"} Jun 06 13:06:44.986255 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:44.986188 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"772e239cac0fbb6811eb5589a014d7d8ad8ad0714d7d21caa24f0ada15eec553"} Jun 06 13:06:45.546720 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.546637 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:45.597046 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.597008 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:45.608665 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.608641 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d835be-1176-40e0-872d-faa1c2a0cbab" path="/var/lib/kubelet/pods/c2d835be-1176-40e0-872d-faa1c2a0cbab/volumes" Jun 06 13:06:45.646710 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.646679 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:45.693312 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.693281 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:45.995325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995293 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"721cb8e4a5a9d2afaf1a7f91a2fa2ad52b5fc92c65b028add00bd1ae5bdbd1a4"} Jun 06 13:06:45.995518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995371 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"eff617f0a494ee14e37ce26077103c0d66469286a9501a27ecb70330b13a284e"} Jun 06 13:06:45.995518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995407 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"f70568954801d9d099a01a0b0edacfd30dc7b49c9f9466dcdf9ba3a5a43a86d5"} Jun 06 13:06:45.995518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995447 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"92c73cfb2447c0cf969619824aeca8d317d7e43e83a51bf35080406fa117d41c"} Jun 06 13:06:45.995518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995483 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"efcf37430aac3a824b77e7f4b202267044b1596cf1d282c40eb069ccdfaa409f"} Jun 06 13:06:45.995518 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:45.995516 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9193330a-d0f7-4e7b-b58c-1eaf68edd58a","Type":"ContainerStarted","Data":"ddef278ee2020fa3c81f1b1e95077ca1392e998423a7e67f72e34feedc884980"} Jun 06 13:06:46.021000 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:46.020932 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.004067167 podStartE2EDuration="2.020916242s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.849075ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:06:46.019199646 +0000 UTC m=+344.879282066" watchObservedRunningTime="2026-06-06 13:06:46.020916242 +0000 UTC m=+344.880998651" Jun 06 13:06:49.356964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:49.356883 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:06:49.476509 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:49.476476 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:49.532307 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:49.532276 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:58.271912 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:58.271879 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:06:58.372005 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:06:58.371956 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:07:21.541033 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:21.541000 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:07:21.587465 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:21.587429 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:07:44.356908 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:44.356869 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:07:44.372708 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:44.372682 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:07:45.254968 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:45.254926 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:07:50.257269 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:50.257239 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:07:50.360018 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:07:50.359968 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:11.783782 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:11.783746 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:12.568256 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:12.568210 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:14.735455 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:14.735429 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:15.154693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:15.154661 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:15.211312 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:15.211250 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:18.138406 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:18.138331 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:18.243407 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:18.243378 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:18.352695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:18.352662 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:21.713713 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:21.713678 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:22.098625 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:22.098598 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:22.189864 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:22.189831 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:22.246646 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:22.246614 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:29.108116 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:29.108086 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:29.621369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:29.621333 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:29.721318 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:29.721291 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:31.316610 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.316575 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f"] Jun 06 13:08:31.318687 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.318669 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.321036 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.321015 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:08:31.321036 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.321033 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-chctn\"" Jun 06 13:08:31.321964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.321945 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 13:08:31.327117 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.327098 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f"] Jun 06 13:08:31.427828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.427794 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9jq\" (UniqueName: \"kubernetes.io/projected/af1ee094-d47a-4ea9-9f11-30b600f46928-kube-api-access-sc9jq\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.427828 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.427832 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1ee094-d47a-4ea9-9f11-30b600f46928-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.441128 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.441101 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvhgw"] Jun 06 13:08:31.443400 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.443386 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.445643 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.445621 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 13:08:31.445727 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.445683 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-khkfv\"" Jun 06 13:08:31.445858 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.445844 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 13:08:31.451255 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.451234 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvhgw"] Jun 06 13:08:31.528908 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.528867 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlm9d\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-kube-api-access-wlm9d\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.529101 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.528963 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-bound-sa-token\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.529101 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.529024 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9jq\" (UniqueName: \"kubernetes.io/projected/af1ee094-d47a-4ea9-9f11-30b600f46928-kube-api-access-sc9jq\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.529101 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.529049 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1ee094-d47a-4ea9-9f11-30b600f46928-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.529496 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.529477 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1ee094-d47a-4ea9-9f11-30b600f46928-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.537330 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.537304 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9jq\" (UniqueName: \"kubernetes.io/projected/af1ee094-d47a-4ea9-9f11-30b600f46928-kube-api-access-sc9jq\") pod \"openshift-lws-operator-fd8ccff4c-rnt9f\" (UID: \"af1ee094-d47a-4ea9-9f11-30b600f46928\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.630223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.630148 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-bound-sa-token\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.630223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.630207 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlm9d\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-kube-api-access-wlm9d\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.638887 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.638859 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-bound-sa-token\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.639113 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.639093 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlm9d\" (UniqueName: \"kubernetes.io/projected/6034121b-8722-4312-b859-94a95338f21b-kube-api-access-wlm9d\") pod \"cert-manager-59c77684cc-lvhgw\" (UID: \"6034121b-8722-4312-b859-94a95338f21b\") " pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.640730 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.640716 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" Jun 06 13:08:31.752591 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.752563 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lvhgw" Jun 06 13:08:31.763538 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.763514 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f"] Jun 06 13:08:31.767370 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:08:31.767340 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf1ee094_d47a_4ea9_9f11_30b600f46928.slice/crio-cd8b306dc8df6c17e972d18cbd1e379d9f06017be9c770bcc684fc2ab2f04ed9 WatchSource:0}: Error finding container cd8b306dc8df6c17e972d18cbd1e379d9f06017be9c770bcc684fc2ab2f04ed9: Status 404 returned error can't find the container with id cd8b306dc8df6c17e972d18cbd1e379d9f06017be9c770bcc684fc2ab2f04ed9 Jun 06 13:08:31.769134 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.769113 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:08:31.875413 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:31.875390 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvhgw"] Jun 06 13:08:31.877541 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:08:31.877515 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6034121b_8722_4312_b859_94a95338f21b.slice/crio-ecb9448cb51f991192827b130a2dfe0e88aa7c3aff89f4b850451004d8bf6bf8 WatchSource:0}: Error finding container ecb9448cb51f991192827b130a2dfe0e88aa7c3aff89f4b850451004d8bf6bf8: Status 404 returned error can't find the container with id ecb9448cb51f991192827b130a2dfe0e88aa7c3aff89f4b850451004d8bf6bf8 Jun 06 13:08:32.428784 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:32.428746 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" event={"ID":"af1ee094-d47a-4ea9-9f11-30b600f46928","Type":"ContainerStarted","Data":"cd8b306dc8df6c17e972d18cbd1e379d9f06017be9c770bcc684fc2ab2f04ed9"} Jun 06 13:08:32.430206 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:32.430171 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lvhgw" event={"ID":"6034121b-8722-4312-b859-94a95338f21b","Type":"ContainerStarted","Data":"ecb9448cb51f991192827b130a2dfe0e88aa7c3aff89f4b850451004d8bf6bf8"} Jun 06 13:08:36.454066 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:36.454021 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" event={"ID":"af1ee094-d47a-4ea9-9f11-30b600f46928","Type":"ContainerStarted","Data":"111d4a982dace8efe87833ecb6df5f19e082d3b6dd8e278c434ba40722d2b302"} Jun 06 13:08:36.455640 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:36.455607 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lvhgw" event={"ID":"6034121b-8722-4312-b859-94a95338f21b","Type":"ContainerStarted","Data":"79fe50493790db8ab3f3dab9319b8931d2f1634bb6c4d44f5ed6e9cbe11d8619"} Jun 06 13:08:36.470605 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:36.470560 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rnt9f" podStartSLOduration=1.246436417 podStartE2EDuration="5.470546826s" totalImagesPullingTime="4.224110409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:08:36.469452583 +0000 UTC m=+455.329534994" watchObservedRunningTime="2026-06-06 13:08:36.470546826 +0000 UTC m=+455.330629236" Jun 06 13:08:36.486581 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:36.486537 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-lvhgw" podStartSLOduration=1.323180128 podStartE2EDuration="5.486527573s" totalImagesPullingTime="4.163347445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:08:36.486014263 +0000 UTC m=+455.346096670" watchObservedRunningTime="2026-06-06 13:08:36.486527573 +0000 UTC m=+455.346609983" Jun 06 13:08:37.180819 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:37.180783 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:37.280402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:37.280371 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:37.789931 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:37.789896 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:39.017213 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:39.017174 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:44.722920 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:44.722883 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:44.770671 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:44.770633 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:08:59.990036 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:08:59.989979 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:00.088915 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:00.088881 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:00.610012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:00.609956 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:00.869813 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:00.869722 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:00.978322 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:00.978287 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.043669 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.043633 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj"] Jun 06 13:09:01.047606 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.047579 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.050435 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.050410 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 13:09:01.050686 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.050661 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 13:09:01.050800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.050695 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 13:09:01.050800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.050716 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qx5bl\"" Jun 06 13:09:01.050800 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.050783 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 13:09:01.062524 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.062498 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj"] Jun 06 13:09:01.070970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.070940 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.070970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.070973 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.071237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.071083 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.071237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.071124 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.071237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.071207 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x448z\" (UniqueName: \"kubernetes.io/projected/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-kube-api-access-x448z\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.142947 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.142860 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.171795 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.171756 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.171944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.171833 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.171944 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.171879 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.172099 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.171956 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x448z\" (UniqueName: \"kubernetes.io/projected/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-kube-api-access-x448z\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.172099 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.172025 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.172333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.172309 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.174158 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.174134 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.174427 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.174407 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.174506 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.174466 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.179630 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.179608 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x448z\" (UniqueName: \"kubernetes.io/projected/95c713f9-ad61-4bf0-b3a8-c9323aa7133e-kube-api-access-x448z\") pod \"opendatahub-operator-controller-manager-58dc9788b4-jx9lj\" (UID: \"95c713f9-ad61-4bf0-b3a8-c9323aa7133e\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.241194 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.241163 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.341692 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.341662 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.358272 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.358235 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:01.443670 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.443640 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.506574 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:09:01.506543 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c713f9_ad61_4bf0_b3a8_c9323aa7133e.slice/crio-277455a910d329e200fa4295796fe9dec0507baa55bf3d6c6e68259bc5d52b07 WatchSource:0}: Error finding container 277455a910d329e200fa4295796fe9dec0507baa55bf3d6c6e68259bc5d52b07: Status 404 returned error can't find the container with id 277455a910d329e200fa4295796fe9dec0507baa55bf3d6c6e68259bc5d52b07 Jun 06 13:09:01.511326 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.511218 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj"] Jun 06 13:09:01.542237 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.542210 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:01.558723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:01.558689 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" event={"ID":"95c713f9-ad61-4bf0-b3a8-c9323aa7133e","Type":"ContainerStarted","Data":"277455a910d329e200fa4295796fe9dec0507baa55bf3d6c6e68259bc5d52b07"} Jun 06 13:09:04.576876 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:04.576836 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" event={"ID":"95c713f9-ad61-4bf0-b3a8-c9323aa7133e","Type":"ContainerStarted","Data":"3a48e0ebb3b387490ae79f07f0604c38a614df6ceb074cd6d3da1b1028243bf9"} Jun 06 13:09:05.287993 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:05.287941 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:05.385963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:05.385934 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:05.583151 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:05.583122 2550 generic.go:356] "Generic (PLEG): container finished" podID="95c713f9-ad61-4bf0-b3a8-c9323aa7133e" containerID="3a48e0ebb3b387490ae79f07f0604c38a614df6ceb074cd6d3da1b1028243bf9" exitCode=0 Jun 06 13:09:05.583531 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:05.583199 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" event={"ID":"95c713f9-ad61-4bf0-b3a8-c9323aa7133e","Type":"ContainerDied","Data":"3a48e0ebb3b387490ae79f07f0604c38a614df6ceb074cd6d3da1b1028243bf9"} Jun 06 13:09:06.588979 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:06.588944 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" event={"ID":"95c713f9-ad61-4bf0-b3a8-c9323aa7133e","Type":"ContainerStarted","Data":"287fa0cfd8327282e1245734863e10f37d505d617bb6ab7edcb8a7eca996b0bf"} Jun 06 13:09:06.589353 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:06.589049 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:06.609605 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:06.609559 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" podStartSLOduration=1.485677354 podStartE2EDuration="5.609543394s" totalImagesPullingTime="3.195344575s" totalInitContainerRuntime="928.521465ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:06.607426956 +0000 UTC m=+485.467509378" watchObservedRunningTime="2026-06-06 13:09:06.609543394 +0000 UTC m=+485.469625803" Jun 06 13:09:12.200874 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:12.200843 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:12.299007 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:12.298962 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:17.594939 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:17.594912 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-jx9lj" Jun 06 13:09:19.908322 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:19.908286 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.062612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.062577 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.185356 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.185281 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.285003 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.284964 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.388689 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.388657 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.611475 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.611446 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.711798 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.711762 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.811467 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.811429 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:20.915781 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:20.915690 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:21.032906 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:21.032871 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:21.258397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:21.258316 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:28.765330 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.765301 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5498bc6445-snc67"] Jun 06 13:09:28.770346 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.770326 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.773671 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.773639 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gxrrj\"" Jun 06 13:09:28.773818 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.773690 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 13:09:28.773818 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.773640 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 13:09:28.773818 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.773730 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 13:09:28.777119 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.777099 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5498bc6445-snc67"] Jun 06 13:09:28.829055 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.829025 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0646e337-30c6-4140-a2fb-83834484b13c-manager-config\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.829218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.829071 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.829218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.829122 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlhg\" (UniqueName: \"kubernetes.io/projected/0646e337-30c6-4140-a2fb-83834484b13c-kube-api-access-7qlhg\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.829218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.829159 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-metrics-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.929696 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.929661 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-metrics-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.929922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.929762 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0646e337-30c6-4140-a2fb-83834484b13c-manager-config\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.929922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.929794 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.929922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.929846 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlhg\" (UniqueName: \"kubernetes.io/projected/0646e337-30c6-4140-a2fb-83834484b13c-kube-api-access-7qlhg\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.930491 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.930463 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0646e337-30c6-4140-a2fb-83834484b13c-manager-config\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.932300 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.932271 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-metrics-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.932393 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.932300 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0646e337-30c6-4140-a2fb-83834484b13c-cert\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:28.937655 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:28.937631 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlhg\" (UniqueName: \"kubernetes.io/projected/0646e337-30c6-4140-a2fb-83834484b13c-kube-api-access-7qlhg\") pod \"lws-controller-manager-5498bc6445-snc67\" (UID: \"0646e337-30c6-4140-a2fb-83834484b13c\") " pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:29.081481 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:29.081165 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:29.237117 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:29.237094 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5498bc6445-snc67"] Jun 06 13:09:29.239692 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:09:29.239665 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0646e337_30c6_4140_a2fb_83834484b13c.slice/crio-eb7ae8ac35a56ff20c7102859284bd152fb9db94264d5e5752fbae87ac97ffd9 WatchSource:0}: Error finding container eb7ae8ac35a56ff20c7102859284bd152fb9db94264d5e5752fbae87ac97ffd9: Status 404 returned error can't find the container with id eb7ae8ac35a56ff20c7102859284bd152fb9db94264d5e5752fbae87ac97ffd9 Jun 06 13:09:29.700883 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:29.700594 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" event={"ID":"0646e337-30c6-4140-a2fb-83834484b13c","Type":"ContainerStarted","Data":"eb7ae8ac35a56ff20c7102859284bd152fb9db94264d5e5752fbae87ac97ffd9"} Jun 06 13:09:29.739804 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:29.739776 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:29.814730 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:29.814694 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:30.001387 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:30.001298 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:30.102232 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:30.102186 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:30.959372 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:30.959333 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:31.065576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:31.065541 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:31.187435 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:31.187354 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:31.711249 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:31.711211 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" event={"ID":"0646e337-30c6-4140-a2fb-83834484b13c","Type":"ContainerStarted","Data":"e9b1b6c6eb7dc8cd9eb9a7bd408b74c7594eec73b941b9d0e1304521f9468bca"} Jun 06 13:09:31.711469 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:31.711303 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:31.727623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:31.727576 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" podStartSLOduration=2.124101499 podStartE2EDuration="3.727562207s" totalImagesPullingTime="1.603460708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:31.726631573 +0000 UTC m=+510.586714001" watchObservedRunningTime="2026-06-06 13:09:31.727562207 +0000 UTC m=+510.587644617" Jun 06 13:09:35.514627 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:35.514593 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:35.614245 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:35.614214 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:36.675650 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:36.675618 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:37.471284 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:37.471247 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:37.565863 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:37.565804 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:38.055580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:38.055550 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:42.718610 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:42.718579 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5498bc6445-snc67" Jun 06 13:09:48.189780 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:48.189697 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:48.294268 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:48.294232 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:50.719265 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.719234 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-76sg7"] Jun 06 13:09:50.722618 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.722562 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.725694 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.725671 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qnc8c\"" Jun 06 13:09:50.725955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.725937 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 13:09:50.731434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.731410 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-76sg7"] Jun 06 13:09:50.745576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.745552 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:09:50.822805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.822766 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9pn\" (UniqueName: \"kubernetes.io/projected/0eda7592-a78c-4243-8f5d-0cc90871c81a-kube-api-access-xc9pn\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.823002 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.822826 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eda7592-a78c-4243-8f5d-0cc90871c81a-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.923287 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.923242 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9pn\" (UniqueName: \"kubernetes.io/projected/0eda7592-a78c-4243-8f5d-0cc90871c81a-kube-api-access-xc9pn\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.923484 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.923303 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eda7592-a78c-4243-8f5d-0cc90871c81a-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.924108 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.924088 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eda7592-a78c-4243-8f5d-0cc90871c81a-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:50.930637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:50.930614 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9pn\" (UniqueName: \"kubernetes.io/projected/0eda7592-a78c-4243-8f5d-0cc90871c81a-kube-api-access-xc9pn\") pod \"dashboard-redirect-6cd8c57d44-76sg7\" (UID: \"0eda7592-a78c-4243-8f5d-0cc90871c81a\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:51.038716 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:51.038634 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" Jun 06 13:09:51.163732 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:51.163630 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-76sg7"] Jun 06 13:09:51.166457 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:09:51.166423 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eda7592_a78c_4243_8f5d_0cc90871c81a.slice/crio-24ab5b06f153edbbfba42fb60516299fedb6d99b01b4d095c6ec42d355ab2479 WatchSource:0}: Error finding container 24ab5b06f153edbbfba42fb60516299fedb6d99b01b4d095c6ec42d355ab2479: Status 404 returned error can't find the container with id 24ab5b06f153edbbfba42fb60516299fedb6d99b01b4d095c6ec42d355ab2479 Jun 06 13:09:51.800531 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:51.800484 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" event={"ID":"0eda7592-a78c-4243-8f5d-0cc90871c81a","Type":"ContainerStarted","Data":"24ab5b06f153edbbfba42fb60516299fedb6d99b01b4d095c6ec42d355ab2479"} Jun 06 13:09:53.812136 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:53.812098 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" event={"ID":"0eda7592-a78c-4243-8f5d-0cc90871c81a","Type":"ContainerStarted","Data":"8f3685f8c985d890dd5c9a88bb2635618d2453a0bc3c1afcb150c086ea463b0b"} Jun 06 13:09:53.834107 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:09:53.834055 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6cd8c57d44-76sg7" podStartSLOduration=1.847863003 podStartE2EDuration="3.834038662s" totalImagesPullingTime="1.986175659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:53.832351076 +0000 UTC m=+532.692433515" watchObservedRunningTime="2026-06-06 13:09:53.834038662 +0000 UTC m=+532.694121073" Jun 06 13:10:08.320654 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:08.320623 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:08.384805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:08.384771 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:08.738206 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:08.738130 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:12.587880 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.587839 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:12.688084 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.688054 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:12.848685 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.848492 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj"] Jun 06 13:10:12.852652 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.852629 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:12.855143 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.855114 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 13:10:12.855279 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.855254 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qnsk5\"" Jun 06 13:10:12.855279 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.855267 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 13:10:12.855382 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.855291 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 13:10:12.862677 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.862651 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj"] Jun 06 13:10:12.878495 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:12.878466 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:13.007748 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007722 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007748 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007753 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007778 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbg2\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-kube-api-access-7sbg2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007857 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c3d3bea-08d6-4963-97e8-f11cce75f297-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007903 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007921 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.007970 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007959 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.008213 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.007975 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.032114 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.032082 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:13.108637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108592 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108615 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbg2\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-kube-api-access-7sbg2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108727 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c3d3bea-08d6-4963-97e8-f11cce75f297-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108761 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108803 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108831 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108890 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.108934 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.108913 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.109217 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.109032 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.109217 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.109133 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.109289 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.109238 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.109361 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.109338 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.109497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.109478 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c3d3bea-08d6-4963-97e8-f11cce75f297-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.111190 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.111169 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.111333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.111316 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.115667 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.115647 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.115855 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.115833 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbg2\" (UniqueName: \"kubernetes.io/projected/3c3d3bea-08d6-4963-97e8-f11cce75f297-kube-api-access-7sbg2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795t5dzj\" (UID: \"3c3d3bea-08d6-4963-97e8-f11cce75f297\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.130272 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.130246 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:13.165132 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.165104 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:13.297006 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.296969 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj"] Jun 06 13:10:13.299317 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:13.299285 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3d3bea_08d6_4963_97e8_f11cce75f297.slice/crio-aef5afef5093f0f19d33d316c71ed7a0df20554d5ee4bdd8d720927390d81bad WatchSource:0}: Error finding container aef5afef5093f0f19d33d316c71ed7a0df20554d5ee4bdd8d720927390d81bad: Status 404 returned error can't find the container with id aef5afef5093f0f19d33d316c71ed7a0df20554d5ee4bdd8d720927390d81bad Jun 06 13:10:13.657674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.657631 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:13.899591 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:13.899555 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" event={"ID":"3c3d3bea-08d6-4963-97e8-f11cce75f297","Type":"ContainerStarted","Data":"aef5afef5093f0f19d33d316c71ed7a0df20554d5ee4bdd8d720927390d81bad"} Jun 06 13:10:17.043106 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:17.043060 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:10:17.043486 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:17.043151 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:10:17.043486 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:17.043198 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:10:17.920228 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:17.920189 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" event={"ID":"3c3d3bea-08d6-4963-97e8-f11cce75f297","Type":"ContainerStarted","Data":"1f09b205122b14ca3a04bf42f8b5c5340bdbe020248ad407367385f53f71174c"} Jun 06 13:10:17.940330 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:17.940279 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" podStartSLOduration=2.198948347 podStartE2EDuration="5.940263345s" totalImagesPullingTime="3.741314998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:17.938466867 +0000 UTC m=+556.798549305" watchObservedRunningTime="2026-06-06 13:10:17.940263345 +0000 UTC m=+556.800345821" Jun 06 13:10:18.165331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:18.165293 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:18.169964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:18.169941 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:18.924301 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:18.924269 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:18.925315 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:18.925297 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795t5dzj" Jun 06 13:10:21.442460 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.442401 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:21.538811 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.538778 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:21.563622 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.563589 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:21.567154 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.567132 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:21.569682 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.569657 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 13:10:21.570557 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.570534 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-pvrs5\"" Jun 06 13:10:21.570686 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.570584 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 13:10:21.576298 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.575803 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:21.581379 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.581356 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn5s\" (UniqueName: \"kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s\") pod \"kuadrant-operator-catalog-bds9n\" (UID: \"ff2c76eb-1c99-4622-8c68-fc0dd5377237\") " pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:21.600675 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.600654 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:21.682593 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.682560 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn5s\" (UniqueName: \"kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s\") pod \"kuadrant-operator-catalog-bds9n\" (UID: \"ff2c76eb-1c99-4622-8c68-fc0dd5377237\") " pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:21.691342 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.691315 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn5s\" (UniqueName: \"kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s\") pod \"kuadrant-operator-catalog-bds9n\" (UID: \"ff2c76eb-1c99-4622-8c68-fc0dd5377237\") " pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:21.878539 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.878511 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:21.933468 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:21.933439 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:22.001122 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.001085 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:22.003297 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:22.003273 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2c76eb_1c99_4622_8c68_fc0dd5377237.slice/crio-2f10a5406f1bb9c7a1588cb1f02b3fedf0dee2eea6599609d064deede5ee931b WatchSource:0}: Error finding container 2f10a5406f1bb9c7a1588cb1f02b3fedf0dee2eea6599609d064deede5ee931b: Status 404 returned error can't find the container with id 2f10a5406f1bb9c7a1588cb1f02b3fedf0dee2eea6599609d064deede5ee931b Jun 06 13:10:22.142854 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.142795 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wb48q"] Jun 06 13:10:22.147052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.147036 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:22.153419 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.153383 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wb48q"] Jun 06 13:10:22.187106 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.187078 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdkwl\" (UniqueName: \"kubernetes.io/projected/1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61-kube-api-access-gdkwl\") pod \"kuadrant-operator-catalog-wb48q\" (UID: \"1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61\") " pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:22.287587 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.287560 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdkwl\" (UniqueName: \"kubernetes.io/projected/1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61-kube-api-access-gdkwl\") pod \"kuadrant-operator-catalog-wb48q\" (UID: \"1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61\") " pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:22.295069 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.295046 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdkwl\" (UniqueName: \"kubernetes.io/projected/1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61-kube-api-access-gdkwl\") pod \"kuadrant-operator-catalog-wb48q\" (UID: \"1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61\") " pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:22.457527 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.457465 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:22.586951 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.586925 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wb48q"] Jun 06 13:10:22.623177 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:22.623146 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca7307a_ab9c_4d7b_a537_ee8ab60bfa61.slice/crio-eb81e0fda0ae8e412a43416d9d093a14ed22a36b5b90f061791b45821c66d14b WatchSource:0}: Error finding container eb81e0fda0ae8e412a43416d9d093a14ed22a36b5b90f061791b45821c66d14b: Status 404 returned error can't find the container with id eb81e0fda0ae8e412a43416d9d093a14ed22a36b5b90f061791b45821c66d14b Jun 06 13:10:22.945003 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.944956 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" event={"ID":"1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61","Type":"ContainerStarted","Data":"eb81e0fda0ae8e412a43416d9d093a14ed22a36b5b90f061791b45821c66d14b"} Jun 06 13:10:22.946221 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:22.946193 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" event={"ID":"ff2c76eb-1c99-4622-8c68-fc0dd5377237","Type":"ContainerStarted","Data":"2f10a5406f1bb9c7a1588cb1f02b3fedf0dee2eea6599609d064deede5ee931b"} Jun 06 13:10:24.956705 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:24.956659 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" event={"ID":"ff2c76eb-1c99-4622-8c68-fc0dd5377237","Type":"ContainerStarted","Data":"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a"} Jun 06 13:10:24.956705 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:24.956689 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" podUID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" containerName="registry-server" containerID="cri-o://6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a" gracePeriod=2 Jun 06 13:10:24.958180 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:24.958157 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" event={"ID":"1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61","Type":"ContainerStarted","Data":"5ad4bc7477fb97ba03bf5530e1102b869b45e4b642d4081ffdb2f93387a58f88"} Jun 06 13:10:24.971497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:24.971454 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" podStartSLOduration=1.765873661 podStartE2EDuration="3.971438938s" totalImagesPullingTime="2.205565277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:24.970277551 +0000 UTC m=+563.830359973" watchObservedRunningTime="2026-06-06 13:10:24.971438938 +0000 UTC m=+563.831521406" Jun 06 13:10:24.984415 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:24.984375 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" podStartSLOduration=1.395774179 podStartE2EDuration="2.98436183s" totalImagesPullingTime="1.588587651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:24.982766511 +0000 UTC m=+563.842848922" watchObservedRunningTime="2026-06-06 13:10:24.98436183 +0000 UTC m=+563.844444240" Jun 06 13:10:25.203630 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.203606 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:25.211646 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.211590 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kn5s\" (UniqueName: \"kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s\") pod \"ff2c76eb-1c99-4622-8c68-fc0dd5377237\" (UID: \"ff2c76eb-1c99-4622-8c68-fc0dd5377237\") " Jun 06 13:10:25.213513 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.213490 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s" (OuterVolumeSpecName: "kube-api-access-4kn5s") pod "ff2c76eb-1c99-4622-8c68-fc0dd5377237" (UID: "ff2c76eb-1c99-4622-8c68-fc0dd5377237"). InnerVolumeSpecName "kube-api-access-4kn5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:10:25.312720 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.312693 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kn5s\" (UniqueName: \"kubernetes.io/projected/ff2c76eb-1c99-4622-8c68-fc0dd5377237-kube-api-access-4kn5s\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:10:25.965245 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.965155 2550 generic.go:356] "Generic (PLEG): container finished" podID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" containerID="6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a" exitCode=0 Jun 06 13:10:25.965245 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.965205 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" Jun 06 13:10:25.965751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.965244 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" event={"ID":"ff2c76eb-1c99-4622-8c68-fc0dd5377237","Type":"ContainerDied","Data":"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a"} Jun 06 13:10:25.965751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.965296 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bds9n" event={"ID":"ff2c76eb-1c99-4622-8c68-fc0dd5377237","Type":"ContainerDied","Data":"2f10a5406f1bb9c7a1588cb1f02b3fedf0dee2eea6599609d064deede5ee931b"} Jun 06 13:10:25.965751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.965324 2550 scope.go:117] "RemoveContainer" containerID="6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a" Jun 06 13:10:25.974333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.974316 2550 scope.go:117] "RemoveContainer" containerID="6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a" Jun 06 13:10:25.974589 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:10:25.974563 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a\": container with ID starting with 6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a not found: ID does not exist" containerID="6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a" Jun 06 13:10:25.974665 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.974601 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a"} err="failed to get container status \"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a\": rpc error: code = NotFound desc = could not find container \"6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a\": container with ID starting with 6c2b5046c7d9954c68b160666829e882479f2944a549bade7b59bcbff3a55e0a not found: ID does not exist" Jun 06 13:10:25.979038 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.979007 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:25.982576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:25.982555 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bds9n"] Jun 06 13:10:27.609745 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:27.609703 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" path="/var/lib/kubelet/pods/ff2c76eb-1c99-4622-8c68-fc0dd5377237/volumes" Jun 06 13:10:32.458595 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:32.458561 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:32.458978 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:32.458619 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:32.480747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:32.480723 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:33.020475 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.020450 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wb48q" Jun 06 13:10:33.611132 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.611100 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b79b557f5-c99gp"] Jun 06 13:10:33.611497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.611417 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" containerName="registry-server" Jun 06 13:10:33.611497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.611428 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" containerName="registry-server" Jun 06 13:10:33.611573 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.611502 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2c76eb-1c99-4622-8c68-fc0dd5377237" containerName="registry-server" Jun 06 13:10:33.616097 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.616079 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.618624 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.618593 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 13:10:33.618624 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.618605 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8jlbh\"" Jun 06 13:10:33.618864 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.618605 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 13:10:33.619119 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.619096 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b79b557f5-c99gp"] Jun 06 13:10:33.619537 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.619497 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 13:10:33.619793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.619773 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 13:10:33.620103 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.620086 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 13:10:33.628752 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.628569 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 13:10:33.658476 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.658449 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:33.682825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682799 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-service-ca\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.682921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682837 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.682921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682899 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-oauth-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.683005 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682939 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-trusted-ca-bundle\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.683005 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682959 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-oauth-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.683005 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.682998 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.683116 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.683082 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pl8z\" (UniqueName: \"kubernetes.io/projected/3f548412-8de4-4dc7-8d34-e189f687bc5a-kube-api-access-9pl8z\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.703078 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.703052 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:33.784321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784299 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-oauth-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784340 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-trusted-ca-bundle\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784368 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-oauth-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784405 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784441 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pl8z\" (UniqueName: \"kubernetes.io/projected/3f548412-8de4-4dc7-8d34-e189f687bc5a-kube-api-access-9pl8z\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784488 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-service-ca\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.784657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.784528 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.785278 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.785251 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-oauth-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.785399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.785302 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.785399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.785382 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-service-ca\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.785526 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.785459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f548412-8de4-4dc7-8d34-e189f687bc5a-trusted-ca-bundle\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.786867 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.786839 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-serving-cert\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.787006 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.786964 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f548412-8de4-4dc7-8d34-e189f687bc5a-console-oauth-config\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.791757 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.791740 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pl8z\" (UniqueName: \"kubernetes.io/projected/3f548412-8de4-4dc7-8d34-e189f687bc5a-kube-api-access-9pl8z\") pod \"console-b79b557f5-c99gp\" (UID: \"3f548412-8de4-4dc7-8d34-e189f687bc5a\") " pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:33.929766 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:33.929702 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:34.062853 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:34.062796 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b79b557f5-c99gp"] Jun 06 13:10:34.065233 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:34.065203 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f548412_8de4_4dc7_8d34_e189f687bc5a.slice/crio-29676d0e1a701f6e6635d4c21c88f315d83841548db71fedc41d676d67efddee WatchSource:0}: Error finding container 29676d0e1a701f6e6635d4c21c88f315d83841548db71fedc41d676d67efddee: Status 404 returned error can't find the container with id 29676d0e1a701f6e6635d4c21c88f315d83841548db71fedc41d676d67efddee Jun 06 13:10:35.010886 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:35.010853 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79b557f5-c99gp" event={"ID":"3f548412-8de4-4dc7-8d34-e189f687bc5a","Type":"ContainerStarted","Data":"0f27468a9a1fe57473c87ba30a018e7f9852c1f0c490ff1091791a84849af932"} Jun 06 13:10:35.011387 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:35.010902 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79b557f5-c99gp" event={"ID":"3f548412-8de4-4dc7-8d34-e189f687bc5a","Type":"ContainerStarted","Data":"29676d0e1a701f6e6635d4c21c88f315d83841548db71fedc41d676d67efddee"} Jun 06 13:10:35.028390 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:35.028343 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b79b557f5-c99gp" podStartSLOduration=2.028327967 podStartE2EDuration="2.028327967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:35.026540829 +0000 UTC m=+573.886623252" watchObservedRunningTime="2026-06-06 13:10:35.028327967 +0000 UTC m=+573.888410452" Jun 06 13:10:43.930702 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:43.930665 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:43.931145 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:43.930743 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:43.935633 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:43.935609 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:44.055332 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:44.055306 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b79b557f5-c99gp" Jun 06 13:10:44.228737 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:44.228666 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:44.327036 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:44.326992 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:44.426049 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:44.426014 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:44.565410 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:44.565385 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:45.367657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:45.367628 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:46.637721 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:46.637656 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:48.457355 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.457320 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dmww"] Jun 06 13:10:48.463675 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.463654 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:48.466489 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.466465 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2987p\"" Jun 06 13:10:48.475894 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.475874 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dmww"] Jun 06 13:10:48.517226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.517197 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cztwj\" (UniqueName: \"kubernetes.io/projected/341bf209-290b-478a-a104-bf5b5d36ea04-kube-api-access-cztwj\") pod \"authorino-operator-75cc8d5cb7-6dmww\" (UID: \"341bf209-290b-478a-a104-bf5b5d36ea04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:48.618551 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.618526 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cztwj\" (UniqueName: \"kubernetes.io/projected/341bf209-290b-478a-a104-bf5b5d36ea04-kube-api-access-cztwj\") pod \"authorino-operator-75cc8d5cb7-6dmww\" (UID: \"341bf209-290b-478a-a104-bf5b5d36ea04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:48.628957 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.628932 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cztwj\" (UniqueName: \"kubernetes.io/projected/341bf209-290b-478a-a104-bf5b5d36ea04-kube-api-access-cztwj\") pod \"authorino-operator-75cc8d5cb7-6dmww\" (UID: \"341bf209-290b-478a-a104-bf5b5d36ea04\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:48.773613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.773535 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:48.903347 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:48.903313 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dmww"] Jun 06 13:10:48.906369 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:48.906344 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341bf209_290b_478a_a104_bf5b5d36ea04.slice/crio-3eca78316e1f91a451c031e3c8b48418a51acc6c473a84d5068d22b79dd27157 WatchSource:0}: Error finding container 3eca78316e1f91a451c031e3c8b48418a51acc6c473a84d5068d22b79dd27157: Status 404 returned error can't find the container with id 3eca78316e1f91a451c031e3c8b48418a51acc6c473a84d5068d22b79dd27157 Jun 06 13:10:49.074826 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:49.074790 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" event={"ID":"341bf209-290b-478a-a104-bf5b5d36ea04","Type":"ContainerStarted","Data":"3eca78316e1f91a451c031e3c8b48418a51acc6c473a84d5068d22b79dd27157"} Jun 06 13:10:49.577105 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:49.577077 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:52.090431 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:52.090387 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" event={"ID":"341bf209-290b-478a-a104-bf5b5d36ea04","Type":"ContainerStarted","Data":"6c7a940a2485bf480dbac763029e9ad5371ab2566e40294f663f8c9067498c8d"} Jun 06 13:10:52.090890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:52.090509 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:10:52.115692 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:52.115649 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" podStartSLOduration=1.719655086 podStartE2EDuration="4.115636304s" totalImagesPullingTime="2.395981218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:52.115458259 +0000 UTC m=+590.975540697" watchObservedRunningTime="2026-06-06 13:10:52.115636304 +0000 UTC m=+590.975718713" Jun 06 13:10:52.235547 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:52.235508 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:52.636938 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:52.636910 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:53.368417 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:53.368364 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:53.830594 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:53.830561 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:55.610677 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.610647 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx"] Jun 06 13:10:55.614222 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.614206 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.616910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.616878 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-28c2l\"" Jun 06 13:10:55.625105 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.625084 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx"] Jun 06 13:10:55.782207 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.782175 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.782360 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.782285 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d5kx\" (UniqueName: \"kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.882724 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.882653 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d5kx\" (UniqueName: \"kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.882859 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.882793 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.883192 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.883172 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.890003 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.889957 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d5kx\" (UniqueName: \"kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:55.924830 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:55.924808 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:10:56.069389 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:56.069359 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx"] Jun 06 13:10:56.071899 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:10:56.071872 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3527b80c_28a0_4808_8ec5_ad8e29251ab9.slice/crio-f5d8e24bd1be27e1355975eb9c686ba49376e1846bed6b9898304ac1b3c818d0 WatchSource:0}: Error finding container f5d8e24bd1be27e1355975eb9c686ba49376e1846bed6b9898304ac1b3c818d0: Status 404 returned error can't find the container with id f5d8e24bd1be27e1355975eb9c686ba49376e1846bed6b9898304ac1b3c818d0 Jun 06 13:10:56.109045 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:56.109017 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" event={"ID":"3527b80c-28a0-4808-8ec5-ad8e29251ab9","Type":"ContainerStarted","Data":"f5d8e24bd1be27e1355975eb9c686ba49376e1846bed6b9898304ac1b3c818d0"} Jun 06 13:10:56.178781 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:56.178696 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:57.641861 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:57.641765 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:59.182239 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:59.182198 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:59.276392 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:59.276357 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:59.580288 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:59.580255 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:10:59.680974 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:10:59.680936 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:01.139441 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:01.139405 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" event={"ID":"3527b80c-28a0-4808-8ec5-ad8e29251ab9","Type":"ContainerStarted","Data":"1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729"} Jun 06 13:11:01.139868 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:01.139557 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:01.157612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:01.157559 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" podStartSLOduration=1.681262437 podStartE2EDuration="6.1575416s" totalImagesPullingTime="4.476279163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:01.15652677 +0000 UTC m=+600.016609213" watchObservedRunningTime="2026-06-06 13:11:01.1575416 +0000 UTC m=+600.017624010" Jun 06 13:11:01.595638 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:01.595598 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:11:01.595638 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:01.595626 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:11:03.097286 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:03.097258 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dmww" Jun 06 13:11:03.276765 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:03.276738 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:03.387739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:03.387642 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:03.486215 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:03.486174 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:03.589747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:03.589718 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:07.186948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:07.186917 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:08.583624 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:08.583592 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:08.699397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:08.699366 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:12.147535 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:12.147500 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:13.062251 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.062209 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9"] Jun 06 13:11:13.065866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.065842 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.084025 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.083996 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9"] Jun 06 13:11:13.133321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.133283 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.133321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.133338 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56d9j\" (UniqueName: \"kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.234041 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.234011 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.234389 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.234063 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56d9j\" (UniqueName: \"kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.234389 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.234355 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.245291 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.245269 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56d9j\" (UniqueName: \"kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.375332 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.375250 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:13.516374 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.516349 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9"] Jun 06 13:11:13.522883 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:11:13.522854 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb4ebdb_0b30_4cb3_90dd_e4a3faa691f7.slice/crio-801424e5794dc06b9008aff672e56eff8e882072a57a459c93fc20ebd8557aa9 WatchSource:0}: Error finding container 801424e5794dc06b9008aff672e56eff8e882072a57a459c93fc20ebd8557aa9: Status 404 returned error can't find the container with id 801424e5794dc06b9008aff672e56eff8e882072a57a459c93fc20ebd8557aa9 Jun 06 13:11:13.760536 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.760451 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9"] Jun 06 13:11:13.764549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.764522 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9"] Jun 06 13:11:13.774937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.774913 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx"] Jun 06 13:11:13.775130 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.775107 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" containerName="manager" containerID="cri-o://1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729" gracePeriod=2 Jun 06 13:11:13.777771 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.777743 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:13.778296 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.778275 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" containerName="manager" Jun 06 13:11:13.778404 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.778301 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" containerName="manager" Jun 06 13:11:13.778463 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.778428 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" containerName="manager" Jun 06 13:11:13.781952 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.781927 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.799199 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:13.799155 2550 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3527b80c-28a0-4808-8ec5-ad8e29251ab9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-g48cx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:13.801718 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.801689 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx"] Jun 06 13:11:13.804932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.804911 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:13.806940 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.806916 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:13.807337 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.807321 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" containerName="manager" Jun 06 13:11:13.807415 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.807339 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" containerName="manager" Jun 06 13:11:13.807472 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.807450 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" containerName="manager" Jun 06 13:11:13.810471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.810453 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.823654 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:13.823620 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:13.826455 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.826434 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:13.839818 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.839791 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.840029 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.839830 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.840029 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.839882 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxvq\" (UniqueName: \"kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.840029 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.839973 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvq4j\" (UniqueName: \"kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.858511 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:13.858480 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:13.940556 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940523 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.940556 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940558 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.940805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940587 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxvq\" (UniqueName: \"kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.940805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940635 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvq4j\" (UniqueName: \"kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.941016 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940974 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.941091 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.940975 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:13.948765 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.948741 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxvq\" (UniqueName: \"kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqbdp\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:13.948872 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:13.948790 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvq4j\" (UniqueName: \"kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mzxh\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:14.007998 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.007965 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.013402 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.013357 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.041722 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.041699 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d5kx\" (UniqueName: \"kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx\") pod \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " Jun 06 13:11:14.041810 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.041789 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume\") pod \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\" (UID: \"3527b80c-28a0-4808-8ec5-ad8e29251ab9\") " Jun 06 13:11:14.042141 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.042121 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3527b80c-28a0-4808-8ec5-ad8e29251ab9" (UID: "3527b80c-28a0-4808-8ec5-ad8e29251ab9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:11:14.043643 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.043623 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx" (OuterVolumeSpecName: "kube-api-access-6d5kx") pod "3527b80c-28a0-4808-8ec5-ad8e29251ab9" (UID: "3527b80c-28a0-4808-8ec5-ad8e29251ab9"). InnerVolumeSpecName "kube-api-access-6d5kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:14.142716 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.142697 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:14.142946 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.142926 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527b80c-28a0-4808-8ec5-ad8e29251ab9-extensions-socket-volume\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:14.143012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.142949 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d5kx\" (UniqueName: \"kubernetes.io/projected/3527b80c-28a0-4808-8ec5-ad8e29251ab9-kube-api-access-6d5kx\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:14.148490 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.148470 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:14.211769 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.211730 2550 generic.go:356] "Generic (PLEG): container finished" podID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" containerID="1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729" exitCode=0 Jun 06 13:11:14.211769 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.211770 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.212000 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.211826 2550 scope.go:117] "RemoveContainer" containerID="1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729" Jun 06 13:11:14.214205 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.214167 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.215745 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.215668 2550 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" container="manager" Jun 06 13:11:14.217807 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.217771 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.219612 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.219582 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:14.222482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.222357 2550 scope.go:117] "RemoveContainer" containerID="1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729" Jun 06 13:11:14.222730 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.222701 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729\": container with ID starting with 1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729 not found: ID does not exist" containerID="1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729" Jun 06 13:11:14.222824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.222736 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729"} err="failed to get container status \"1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729\": rpc error: code = NotFound desc = could not find container \"1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729\": container with ID starting with 1590503a6781faf41661267d714bb9dcde3c677788f3d769a736d55b96d76729 not found: ID does not exist" Jun 06 13:11:14.225013 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.224968 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:14.227103 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:14.227074 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:14.297139 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.297071 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:14.300688 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:11:14.300663 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a201d9f_0c4c_4d1d_b703_c14e336aaba3.slice/crio-8a7c974c735f4c74e0ab6b774fa9dc265ffabf8b6c47f0c4af86806683bd00f1 WatchSource:0}: Error finding container 8a7c974c735f4c74e0ab6b774fa9dc265ffabf8b6c47f0c4af86806683bd00f1: Status 404 returned error can't find the container with id 8a7c974c735f4c74e0ab6b774fa9dc265ffabf8b6c47f0c4af86806683bd00f1 Jun 06 13:11:14.311947 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.311924 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:14.314283 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:11:14.314262 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dad7bcd_8fa8_4e3a_9ee6_96cddc895266.slice/crio-a7bfa6692d95f71fd6ed8904a832dcbcdf7b365662c44e5af861841e907425c5 WatchSource:0}: Error finding container a7bfa6692d95f71fd6ed8904a832dcbcdf7b365662c44e5af861841e907425c5: Status 404 returned error can't find the container with id a7bfa6692d95f71fd6ed8904a832dcbcdf7b365662c44e5af861841e907425c5 Jun 06 13:11:14.780710 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.780676 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:14.886032 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:14.885975 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:15.222028 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.221967 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" containerName="manager" containerID="cri-o://050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a" gracePeriod=2 Jun 06 13:11:15.223691 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.223661 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" event={"ID":"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266","Type":"ContainerStarted","Data":"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c"} Jun 06 13:11:15.223838 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.223717 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:15.223838 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.223735 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" event={"ID":"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266","Type":"ContainerStarted","Data":"a7bfa6692d95f71fd6ed8904a832dcbcdf7b365662c44e5af861841e907425c5"} Jun 06 13:11:15.224315 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.224279 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:15.226809 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.226209 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:15.226809 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.226445 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" event={"ID":"8a201d9f-0c4c-4d1d-b703-c14e336aaba3","Type":"ContainerStarted","Data":"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1"} Jun 06 13:11:15.226809 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.226490 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" event={"ID":"8a201d9f-0c4c-4d1d-b703-c14e336aaba3","Type":"ContainerStarted","Data":"8a7c974c735f4c74e0ab6b774fa9dc265ffabf8b6c47f0c4af86806683bd00f1"} Jun 06 13:11:15.226809 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.226531 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:15.228094 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.228070 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:15.230190 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.230168 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:15.254247 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.254195 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" podStartSLOduration=2.254176594 podStartE2EDuration="2.254176594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:15.250719839 +0000 UTC m=+614.110802250" watchObservedRunningTime="2026-06-06 13:11:15.254176594 +0000 UTC m=+614.114259004" Jun 06 13:11:15.274215 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.274176 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" podStartSLOduration=2.274163393 podStartE2EDuration="2.274163393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:15.272591117 +0000 UTC m=+614.132673546" watchObservedRunningTime="2026-06-06 13:11:15.274163393 +0000 UTC m=+614.134245803" Jun 06 13:11:15.274589 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.274555 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:15.276407 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.276386 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:15.477129 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.477068 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:15.479249 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.479213 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g48cx\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g48cx" Jun 06 13:11:15.481110 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:15.481089 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:15.555715 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.555690 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume\") pod \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " Jun 06 13:11:15.555838 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.555762 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56d9j\" (UniqueName: \"kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j\") pod \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\" (UID: \"0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7\") " Jun 06 13:11:15.555998 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.555958 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" (UID: "0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:11:15.557701 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.557675 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j" (OuterVolumeSpecName: "kube-api-access-56d9j") pod "0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" (UID: "0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7"). InnerVolumeSpecName "kube-api-access-56d9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:15.610334 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.610296 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" path="/var/lib/kubelet/pods/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7/volumes" Jun 06 13:11:15.610706 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.610690 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3527b80c-28a0-4808-8ec5-ad8e29251ab9" path="/var/lib/kubelet/pods/3527b80c-28a0-4808-8ec5-ad8e29251ab9/volumes" Jun 06 13:11:15.656604 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.656578 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-extensions-socket-volume\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:15.656604 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:15.656602 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56d9j\" (UniqueName: \"kubernetes.io/projected/0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7-kube-api-access-56d9j\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:16.233173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:16.233138 2550 generic.go:356] "Generic (PLEG): container finished" podID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" containerID="050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a" exitCode=2 Jun 06 13:11:16.233363 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:16.233184 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:16.233363 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:16.233238 2550 scope.go:117] "RemoveContainer" containerID="050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a" Jun 06 13:11:16.237536 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:16.237505 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-247l9\" is forbidden: User \"system:node:ip-10-0-131-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-83.ec2.internal' and this object" podUID="0bb4ebdb-0b30-4cb3-90dd-e4a3faa691f7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-247l9" Jun 06 13:11:16.241817 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:16.241799 2550 scope.go:117] "RemoveContainer" containerID="050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a" Jun 06 13:11:16.242082 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:16.242063 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a\": container with ID starting with 050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a not found: ID does not exist" containerID="050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a" Jun 06 13:11:16.242130 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:16.242089 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a"} err="failed to get container status \"050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a\": rpc error: code = NotFound desc = could not find container \"050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a\": container with ID starting with 050f63c2cd03a76facd077c643f6c0bcd047bc7a4521de79f52a48e2d6ace70a not found: ID does not exist" Jun 06 13:11:18.552756 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:18.552662 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:18.652558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:18.652529 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:18.949959 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:18.949913 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:19.049075 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:19.049041 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:21.554162 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:21.554112 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:21.603697 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:21.603668 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:26.235211 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.235179 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:26.235613 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.235258 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:26.304284 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.304254 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:26.304474 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.304438 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" podUID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" containerName="manager" containerID="cri-o://6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c" gracePeriod=10 Jun 06 13:11:26.551792 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.551761 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp"] Jun 06 13:11:26.553548 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.553531 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:26.555356 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.555327 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.568793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.568770 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp"] Jun 06 13:11:26.648478 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.648452 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume\") pod \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " Jun 06 13:11:26.648739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.648492 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxxvq\" (UniqueName: \"kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq\") pod \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\" (UID: \"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266\") " Jun 06 13:11:26.648739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.648635 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec4f298e-f0f1-4288-91ec-44a5d45865ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.648739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.648660 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhb8\" (UniqueName: \"kubernetes.io/projected/ec4f298e-f0f1-4288-91ec-44a5d45865ee-kube-api-access-gzhb8\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.648923 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.648811 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" (UID: "2dad7bcd-8fa8-4e3a-9ee6-96cddc895266"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:11:26.650375 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.650341 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq" (OuterVolumeSpecName: "kube-api-access-rxxvq") pod "2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" (UID: "2dad7bcd-8fa8-4e3a-9ee6-96cddc895266"). InnerVolumeSpecName "kube-api-access-rxxvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:26.749851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.749823 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec4f298e-f0f1-4288-91ec-44a5d45865ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.749955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.749863 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhb8\" (UniqueName: \"kubernetes.io/projected/ec4f298e-f0f1-4288-91ec-44a5d45865ee-kube-api-access-gzhb8\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.749955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.749912 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-extensions-socket-volume\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:26.749955 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.749925 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxxvq\" (UniqueName: \"kubernetes.io/projected/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266-kube-api-access-rxxvq\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:26.750169 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.750150 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec4f298e-f0f1-4288-91ec-44a5d45865ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.761333 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.761313 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhb8\" (UniqueName: \"kubernetes.io/projected/ec4f298e-f0f1-4288-91ec-44a5d45865ee-kube-api-access-gzhb8\") pod \"kuadrant-operator-controller-manager-86878c769f-n6rkp\" (UID: \"ec4f298e-f0f1-4288-91ec-44a5d45865ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.865090 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.865059 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:26.960150 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:26.960121 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:27.002311 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.002283 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp"] Jun 06 13:11:27.005730 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:11:27.005702 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4f298e_f0f1_4288_91ec_44a5d45865ee.slice/crio-74cd1385405fe44569ff334625072c07754441aae7f202c9b88e8b320d818185 WatchSource:0}: Error finding container 74cd1385405fe44569ff334625072c07754441aae7f202c9b88e8b320d818185: Status 404 returned error can't find the container with id 74cd1385405fe44569ff334625072c07754441aae7f202c9b88e8b320d818185 Jun 06 13:11:27.060695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.060673 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:27.299193 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.299113 2550 generic.go:356] "Generic (PLEG): container finished" podID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" containerID="6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c" exitCode=0 Jun 06 13:11:27.299193 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.299159 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" Jun 06 13:11:27.299699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.299197 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" event={"ID":"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266","Type":"ContainerDied","Data":"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c"} Jun 06 13:11:27.299699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.299254 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp" event={"ID":"2dad7bcd-8fa8-4e3a-9ee6-96cddc895266","Type":"ContainerDied","Data":"a7bfa6692d95f71fd6ed8904a832dcbcdf7b365662c44e5af861841e907425c5"} Jun 06 13:11:27.299699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.299283 2550 scope.go:117] "RemoveContainer" containerID="6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c" Jun 06 13:11:27.300962 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.300941 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" event={"ID":"ec4f298e-f0f1-4288-91ec-44a5d45865ee","Type":"ContainerStarted","Data":"1fffa330fdd0655af280f89f13ce30c9b90f4751ecc1f5e60e704e4592397f1f"} Jun 06 13:11:27.301273 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.300994 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" event={"ID":"ec4f298e-f0f1-4288-91ec-44a5d45865ee","Type":"ContainerStarted","Data":"74cd1385405fe44569ff334625072c07754441aae7f202c9b88e8b320d818185"} Jun 06 13:11:27.301273 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.301102 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:27.308871 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.308696 2550 scope.go:117] "RemoveContainer" containerID="6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c" Jun 06 13:11:27.308941 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:27.308924 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c\": container with ID starting with 6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c not found: ID does not exist" containerID="6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c" Jun 06 13:11:27.308998 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.308943 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c"} err="failed to get container status \"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c\": rpc error: code = NotFound desc = could not find container \"6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c\": container with ID starting with 6e95deb64ea7c462127705ff0ed152f0b19549407509c404ae977657bde8d91c not found: ID does not exist" Jun 06 13:11:27.319209 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.319157 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" podStartSLOduration=1.319146109 podStartE2EDuration="1.319146109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:27.31834647 +0000 UTC m=+626.178428911" watchObservedRunningTime="2026-06-06 13:11:27.319146109 +0000 UTC m=+626.179228513" Jun 06 13:11:27.335241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.335214 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:27.348845 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.348824 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqbdp"] Jun 06 13:11:27.610567 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:27.610540 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" path="/var/lib/kubelet/pods/2dad7bcd-8fa8-4e3a-9ee6-96cddc895266/volumes" Jun 06 13:11:33.559893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:33.559855 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:33.660139 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:33.660111 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:38.309266 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.309229 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6rkp" Jun 06 13:11:38.358399 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.358372 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:38.358657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.358625 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" podUID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" containerName="manager" containerID="cri-o://7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1" gracePeriod=10 Jun 06 13:11:38.612827 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.612802 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:38.754397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.754361 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume\") pod \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " Jun 06 13:11:38.754397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.754402 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvq4j\" (UniqueName: \"kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j\") pod \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\" (UID: \"8a201d9f-0c4c-4d1d-b703-c14e336aaba3\") " Jun 06 13:11:38.754737 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.754715 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8a201d9f-0c4c-4d1d-b703-c14e336aaba3" (UID: "8a201d9f-0c4c-4d1d-b703-c14e336aaba3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:11:38.756454 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.756430 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j" (OuterVolumeSpecName: "kube-api-access-tvq4j") pod "8a201d9f-0c4c-4d1d-b703-c14e336aaba3" (UID: "8a201d9f-0c4c-4d1d-b703-c14e336aaba3"). InnerVolumeSpecName "kube-api-access-tvq4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:38.855723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.855650 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-extensions-socket-volume\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:38.855723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:38.855676 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvq4j\" (UniqueName: \"kubernetes.io/projected/8a201d9f-0c4c-4d1d-b703-c14e336aaba3-kube-api-access-tvq4j\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:11:39.362028 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.361996 2550 generic.go:356] "Generic (PLEG): container finished" podID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" containerID="7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1" exitCode=0 Jun 06 13:11:39.362452 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.362048 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" event={"ID":"8a201d9f-0c4c-4d1d-b703-c14e336aaba3","Type":"ContainerDied","Data":"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1"} Jun 06 13:11:39.362452 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.362055 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" Jun 06 13:11:39.362452 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.362102 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh" event={"ID":"8a201d9f-0c4c-4d1d-b703-c14e336aaba3","Type":"ContainerDied","Data":"8a7c974c735f4c74e0ab6b774fa9dc265ffabf8b6c47f0c4af86806683bd00f1"} Jun 06 13:11:39.362452 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.362134 2550 scope.go:117] "RemoveContainer" containerID="7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1" Jun 06 13:11:39.373012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.372969 2550 scope.go:117] "RemoveContainer" containerID="7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1" Jun 06 13:11:39.373321 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:11:39.373301 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1\": container with ID starting with 7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1 not found: ID does not exist" containerID="7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1" Jun 06 13:11:39.373387 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.373329 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1"} err="failed to get container status \"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1\": rpc error: code = NotFound desc = could not find container \"7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1\": container with ID starting with 7bbf7b241023cb8b05c5ac70ca57478e78c1c70330efb9d28599aded238c99c1 not found: ID does not exist" Jun 06 13:11:39.384867 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.384827 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:39.390299 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.390273 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mzxh"] Jun 06 13:11:39.610736 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:39.610707 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" path="/var/lib/kubelet/pods/8a201d9f-0c4c-4d1d-b703-c14e336aaba3/volumes" Jun 06 13:11:42.530769 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.530736 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh"] Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531313 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" containerName="manager" Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531332 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" containerName="manager" Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531343 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" containerName="manager" Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531350 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" containerName="manager" Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531469 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dad7bcd-8fa8-4e3a-9ee6-96cddc895266" containerName="manager" Jun 06 13:11:42.531597 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.531482 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a201d9f-0c4c-4d1d-b703-c14e336aaba3" containerName="manager" Jun 06 13:11:42.535691 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.535671 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.538044 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.538016 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jg9tz\"" Jun 06 13:11:42.545619 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.545597 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh"] Jun 06 13:11:42.565960 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.565933 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:42.663309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.663256 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:42.688431 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688406 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688435 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688465 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688576 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688566 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/212c1294-ed5f-4d51-b0db-d4aa773510e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688738 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688603 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688738 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688624 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688738 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688691 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjlz\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-kube-api-access-gvjlz\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688855 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688735 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.688855 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.688782 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789475 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789396 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789475 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789446 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/212c1294-ed5f-4d51-b0db-d4aa773510e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789476 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789498 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789517 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjlz\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-kube-api-access-gvjlz\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789548 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789577 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.789672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789658 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790048 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789700 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790048 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789923 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790048 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.789955 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.790090 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790294 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.790273 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.790332 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.790309 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/212c1294-ed5f-4d51-b0db-d4aa773510e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.791830 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.791809 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.792115 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.792096 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.797029 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.797007 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.797198 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.797182 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjlz\" (UniqueName: \"kubernetes.io/projected/212c1294-ed5f-4d51-b0db-d4aa773510e9-kube-api-access-gvjlz\") pod \"maas-default-gateway-openshift-default-687ff6996-c6jfh\" (UID: \"212c1294-ed5f-4d51-b0db-d4aa773510e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.847923 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.847893 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:42.982431 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.982385 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh"] Jun 06 13:11:42.985844 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:11:42.985816 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212c1294_ed5f_4d51_b0db_d4aa773510e9.slice/crio-24d01f5c519e1c68183f76a31a38b161862c5ce7466fe3373fc3d2012590d5ec WatchSource:0}: Error finding container 24d01f5c519e1c68183f76a31a38b161862c5ce7466fe3373fc3d2012590d5ec: Status 404 returned error can't find the container with id 24d01f5c519e1c68183f76a31a38b161862c5ce7466fe3373fc3d2012590d5ec Jun 06 13:11:42.987760 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.987726 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:11:42.987861 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.987795 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:11:42.987861 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:42.987827 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:11:43.388816 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:43.388783 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" event={"ID":"212c1294-ed5f-4d51-b0db-d4aa773510e9","Type":"ContainerStarted","Data":"4726eba3de02e428368c7c6c110f48f69f826daa89c05b7bef1509213cd53596"} Jun 06 13:11:43.389014 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:43.388836 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" event={"ID":"212c1294-ed5f-4d51-b0db-d4aa773510e9","Type":"ContainerStarted","Data":"24d01f5c519e1c68183f76a31a38b161862c5ce7466fe3373fc3d2012590d5ec"} Jun 06 13:11:43.407132 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:43.407085 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" podStartSLOduration=1.407069412 podStartE2EDuration="1.407069412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:43.405263337 +0000 UTC m=+642.265345749" watchObservedRunningTime="2026-06-06 13:11:43.407069412 +0000 UTC m=+642.267151825" Jun 06 13:11:43.848461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:43.848428 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:44.854055 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:44.854015 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:45.399052 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:45.399010 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:45.399896 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:45.399878 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:11:46.549862 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:46.549834 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:59.488358 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:59.488330 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:59.596135 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:59.596100 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:11:59.648697 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:11:59.648669 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:00.298519 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.298491 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:00.398626 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.398600 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:00.484827 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.484794 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:12:00.488314 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.488291 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:12:00.490672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.490647 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntbqk\"" Jun 06 13:12:00.493201 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.493175 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:12:00.639719 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.639687 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbdn\" (UniqueName: \"kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn\") pod \"authorino-75d556bd77-2gncz\" (UID: \"7b86414f-e4e3-473b-aed7-123e655c5218\") " pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:12:00.740636 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.740607 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbdn\" (UniqueName: \"kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn\") pod \"authorino-75d556bd77-2gncz\" (UID: \"7b86414f-e4e3-473b-aed7-123e655c5218\") " pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:12:00.748177 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.748151 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbdn\" (UniqueName: \"kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn\") pod \"authorino-75d556bd77-2gncz\" (UID: \"7b86414f-e4e3-473b-aed7-123e655c5218\") " pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:12:00.798827 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.798803 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:12:00.926755 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:00.926729 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:12:00.928656 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:12:00.928625 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b86414f_e4e3_473b_aed7_123e655c5218.slice/crio-45b3691778fe41133bb3fd11668baa67a4e1dcc5a9802052cba2cace4702ad1f WatchSource:0}: Error finding container 45b3691778fe41133bb3fd11668baa67a4e1dcc5a9802052cba2cace4702ad1f: Status 404 returned error can't find the container with id 45b3691778fe41133bb3fd11668baa67a4e1dcc5a9802052cba2cace4702ad1f Jun 06 13:12:01.480058 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:01.479980 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2gncz" event={"ID":"7b86414f-e4e3-473b-aed7-123e655c5218","Type":"ContainerStarted","Data":"45b3691778fe41133bb3fd11668baa67a4e1dcc5a9802052cba2cace4702ad1f"} Jun 06 13:12:04.498263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:04.498229 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2gncz" event={"ID":"7b86414f-e4e3-473b-aed7-123e655c5218","Type":"ContainerStarted","Data":"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72"} Jun 06 13:12:04.512877 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:04.512834 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2gncz" podStartSLOduration=1.695159691 podStartE2EDuration="4.512820322s" totalImagesPullingTime="2.817660631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:12:04.510655999 +0000 UTC m=+663.370738409" watchObservedRunningTime="2026-06-06 13:12:04.512820322 +0000 UTC m=+663.372902732" Jun 06 13:12:18.239457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:18.239420 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:18.341354 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:18.341324 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:18.595733 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:18.595691 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:32.552168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:32.552130 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:32.653329 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:32.653277 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:32.791509 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:32.791478 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:55.537817 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:55.537734 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:55.639375 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:55.639345 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:12:56.035182 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.035152 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:12:56.038568 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.038550 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:12:56.040780 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.040762 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 13:12:56.041699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.041683 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8w9jr\"" Jun 06 13:12:56.041782 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.041724 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 13:12:56.041836 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.041731 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 13:12:56.049103 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.049084 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:12:56.144793 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.144751 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrr9x\" (UniqueName: \"kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x\") pod \"maas-keycloak-0\" (UID: \"f18024ae-0199-46e1-914c-0c018cb51b55\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:12:56.245722 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.245693 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrr9x\" (UniqueName: \"kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x\") pod \"maas-keycloak-0\" (UID: \"f18024ae-0199-46e1-914c-0c018cb51b55\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:12:56.253681 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.253648 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrr9x\" (UniqueName: \"kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x\") pod \"maas-keycloak-0\" (UID: \"f18024ae-0199-46e1-914c-0c018cb51b55\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:12:56.348352 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.348318 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:12:56.479351 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.479321 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:12:56.481644 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:12:56.481613 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18024ae_0199_46e1_914c_0c018cb51b55.slice/crio-eb3996124f047e968f4ac76716b58c769273ebffdcc81becfbdb83d97139da1c WatchSource:0}: Error finding container eb3996124f047e968f4ac76716b58c769273ebffdcc81becfbdb83d97139da1c: Status 404 returned error can't find the container with id eb3996124f047e968f4ac76716b58c769273ebffdcc81becfbdb83d97139da1c Jun 06 13:12:56.747171 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:12:56.747076 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f18024ae-0199-46e1-914c-0c018cb51b55","Type":"ContainerStarted","Data":"eb3996124f047e968f4ac76716b58c769273ebffdcc81becfbdb83d97139da1c"} Jun 06 13:13:01.785526 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:01.785481 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f18024ae-0199-46e1-914c-0c018cb51b55","Type":"ContainerStarted","Data":"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0"} Jun 06 13:13:01.803775 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:01.803715 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.21951866 podStartE2EDuration="5.803697858s" totalImagesPullingTime="4.584179198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:13:01.801912234 +0000 UTC m=+720.661994647" watchObservedRunningTime="2026-06-06 13:13:01.803697858 +0000 UTC m=+720.663780268" Jun 06 13:13:02.349270 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:02.349223 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 13:13:02.350831 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:02.350797 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:03.349489 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:03.349440 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:04.349617 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:04.349564 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:05.349219 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:05.348733 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:06.349313 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:06.349212 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 13:13:06.350309 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:06.350272 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:07.349482 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:07.349434 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:08.349205 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:08.349154 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:09.349021 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:09.348968 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:10.349755 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:10.349693 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:11.349292 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:11.349233 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:12.349063 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:12.349007 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:13.348740 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:13.348701 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 06 13:13:14.454111 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:14.454070 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 13:13:14.469589 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:14.469540 2550 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 13:13:24.460131 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:24.460089 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 13:13:25.112872 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.112837 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:25.321627 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.321593 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:25.328366 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.328339 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:25.332170 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.332143 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:25.337921 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.337896 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:25.356851 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.356829 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxf65\" (UniqueName: \"kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65\") pod \"authorino-5d4b67c446-zx2jg\" (UID: \"22daefb3-80ae-4f5a-b05e-1da41c3cef59\") " pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:25.458043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.457964 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxf65\" (UniqueName: \"kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65\") pod \"authorino-5d4b67c446-zx2jg\" (UID: \"22daefb3-80ae-4f5a-b05e-1da41c3cef59\") " pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:25.466644 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.466620 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxf65\" (UniqueName: \"kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65\") pod \"authorino-5d4b67c446-zx2jg\" (UID: \"22daefb3-80ae-4f5a-b05e-1da41c3cef59\") " pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:25.554728 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.554695 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:25.554956 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.554944 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:25.581930 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.581905 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-546b685b7b-dkl7s"] Jun 06 13:13:25.585887 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.585870 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:25.591798 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.591776 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-546b685b7b-dkl7s"] Jun 06 13:13:25.660272 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.660239 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m858\" (UniqueName: \"kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858\") pod \"authorino-546b685b7b-dkl7s\" (UID: \"b1848498-b853-40a8-86d2-c8dd47db1d22\") " pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:25.690080 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.690052 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-546b685b7b-dkl7s"] Jun 06 13:13:25.690330 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:25.690310 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2m858], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-546b685b7b-dkl7s" podUID="b1848498-b853-40a8-86d2-c8dd47db1d22" Jun 06 13:13:25.696880 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.696852 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:25.700520 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:13:25.700495 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22daefb3_80ae_4f5a_b05e_1da41c3cef59.slice/crio-254e36eb029fbb73ed3c85144df7581f79aca19e5ee9c0f7c4e28c2b78df1995 WatchSource:0}: Error finding container 254e36eb029fbb73ed3c85144df7581f79aca19e5ee9c0f7c4e28c2b78df1995: Status 404 returned error can't find the container with id 254e36eb029fbb73ed3c85144df7581f79aca19e5ee9c0f7c4e28c2b78df1995 Jun 06 13:13:25.709930 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.709877 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:13:25.713887 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.713867 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.716189 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.716169 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 06 13:13:25.719168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.719151 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:13:25.761404 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.761368 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.761563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.761415 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m858\" (UniqueName: \"kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858\") pod \"authorino-546b685b7b-dkl7s\" (UID: \"b1848498-b853-40a8-86d2-c8dd47db1d22\") " pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:25.761563 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.761436 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldmsx\" (UniqueName: \"kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.768787 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.768768 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m858\" (UniqueName: \"kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858\") pod \"authorino-546b685b7b-dkl7s\" (UID: \"b1848498-b853-40a8-86d2-c8dd47db1d22\") " pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:25.862155 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.862120 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.862308 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.862180 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldmsx\" (UniqueName: \"kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.864497 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.864473 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.869307 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.869286 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldmsx\" (UniqueName: \"kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx\") pod \"authorino-7b455c68bd-6n6bd\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:25.942167 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.942150 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:25.942278 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.942192 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" event={"ID":"22daefb3-80ae-4f5a-b05e-1da41c3cef59","Type":"ContainerStarted","Data":"254e36eb029fbb73ed3c85144df7581f79aca19e5ee9c0f7c4e28c2b78df1995"} Jun 06 13:13:25.949355 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:25.949338 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:26.024757 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.024703 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:13:26.063948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.063919 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m858\" (UniqueName: \"kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858\") pod \"b1848498-b853-40a8-86d2-c8dd47db1d22\" (UID: \"b1848498-b853-40a8-86d2-c8dd47db1d22\") " Jun 06 13:13:26.065847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.065819 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858" (OuterVolumeSpecName: "kube-api-access-2m858") pod "b1848498-b853-40a8-86d2-c8dd47db1d22" (UID: "b1848498-b853-40a8-86d2-c8dd47db1d22"). InnerVolumeSpecName "kube-api-access-2m858". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:13:26.154726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.154580 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:13:26.156901 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:13:26.156867 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96c0189b_46fa_4a6a_a08a_f93bbd7d86c3.slice/crio-8681745fd100a3568c95ebddf30db535075ecb71039ba7e940684fac625d1220 WatchSource:0}: Error finding container 8681745fd100a3568c95ebddf30db535075ecb71039ba7e940684fac625d1220: Status 404 returned error can't find the container with id 8681745fd100a3568c95ebddf30db535075ecb71039ba7e940684fac625d1220 Jun 06 13:13:26.164657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.164635 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m858\" (UniqueName: \"kubernetes.io/projected/b1848498-b853-40a8-86d2-c8dd47db1d22-kube-api-access-2m858\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:13:26.948837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.948800 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" event={"ID":"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3","Type":"ContainerStarted","Data":"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede"} Jun 06 13:13:26.948837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.948842 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" event={"ID":"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3","Type":"ContainerStarted","Data":"8681745fd100a3568c95ebddf30db535075ecb71039ba7e940684fac625d1220"} Jun 06 13:13:26.950318 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.950298 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546b685b7b-dkl7s" Jun 06 13:13:26.950444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.950347 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" podUID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" containerName="authorino" containerID="cri-o://5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b" gracePeriod=30 Jun 06 13:13:26.950444 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.950296 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" event={"ID":"22daefb3-80ae-4f5a-b05e-1da41c3cef59","Type":"ContainerStarted","Data":"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b"} Jun 06 13:13:26.963393 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.963353 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" podStartSLOduration=1.585907876 podStartE2EDuration="1.963340268s" totalImagesPullingTime="377.432392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:13:26.962356799 +0000 UTC m=+745.822439220" watchObservedRunningTime="2026-06-06 13:13:26.963340268 +0000 UTC m=+745.823422678" Jun 06 13:13:26.975675 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.975618 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" podStartSLOduration=1.55728573 podStartE2EDuration="1.97559162s" totalImagesPullingTime="418.30589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:13:26.975186966 +0000 UTC m=+745.835269392" watchObservedRunningTime="2026-06-06 13:13:26.97559162 +0000 UTC m=+745.835674026" Jun 06 13:13:26.999454 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.999428 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:13:26.999602 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:26.999584 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2gncz" podUID="7b86414f-e4e3-473b-aed7-123e655c5218" containerName="authorino" containerID="cri-o://4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72" gracePeriod=30 Jun 06 13:13:27.008539 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.008463 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-546b685b7b-dkl7s"] Jun 06 13:13:27.015732 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.015706 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-546b685b7b-dkl7s"] Jun 06 13:13:27.251509 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.251486 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:27.256351 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.256332 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:13:27.377373 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.377347 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbbdn\" (UniqueName: \"kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn\") pod \"7b86414f-e4e3-473b-aed7-123e655c5218\" (UID: \"7b86414f-e4e3-473b-aed7-123e655c5218\") " Jun 06 13:13:27.377560 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.377415 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxf65\" (UniqueName: \"kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65\") pod \"22daefb3-80ae-4f5a-b05e-1da41c3cef59\" (UID: \"22daefb3-80ae-4f5a-b05e-1da41c3cef59\") " Jun 06 13:13:27.379464 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.379432 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn" (OuterVolumeSpecName: "kube-api-access-jbbdn") pod "7b86414f-e4e3-473b-aed7-123e655c5218" (UID: "7b86414f-e4e3-473b-aed7-123e655c5218"). InnerVolumeSpecName "kube-api-access-jbbdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:13:27.379580 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.379539 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65" (OuterVolumeSpecName: "kube-api-access-gxf65") pod "22daefb3-80ae-4f5a-b05e-1da41c3cef59" (UID: "22daefb3-80ae-4f5a-b05e-1da41c3cef59"). InnerVolumeSpecName "kube-api-access-gxf65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:13:27.478398 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.478373 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbbdn\" (UniqueName: \"kubernetes.io/projected/7b86414f-e4e3-473b-aed7-123e655c5218-kube-api-access-jbbdn\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:13:27.478398 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.478397 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxf65\" (UniqueName: \"kubernetes.io/projected/22daefb3-80ae-4f5a-b05e-1da41c3cef59-kube-api-access-gxf65\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:13:27.610386 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.610350 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1848498-b853-40a8-86d2-c8dd47db1d22" path="/var/lib/kubelet/pods/b1848498-b853-40a8-86d2-c8dd47db1d22/volumes" Jun 06 13:13:27.956031 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.955929 2550 generic.go:356] "Generic (PLEG): container finished" podID="7b86414f-e4e3-473b-aed7-123e655c5218" containerID="4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72" exitCode=0 Jun 06 13:13:27.956031 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.955964 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2gncz" Jun 06 13:13:27.956031 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.956015 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2gncz" event={"ID":"7b86414f-e4e3-473b-aed7-123e655c5218","Type":"ContainerDied","Data":"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72"} Jun 06 13:13:27.956564 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.956065 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2gncz" event={"ID":"7b86414f-e4e3-473b-aed7-123e655c5218","Type":"ContainerDied","Data":"45b3691778fe41133bb3fd11668baa67a4e1dcc5a9802052cba2cace4702ad1f"} Jun 06 13:13:27.956564 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.956087 2550 scope.go:117] "RemoveContainer" containerID="4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72" Jun 06 13:13:27.957457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.957344 2550 generic.go:356] "Generic (PLEG): container finished" podID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" containerID="5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b" exitCode=0 Jun 06 13:13:27.957457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.957375 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" event={"ID":"22daefb3-80ae-4f5a-b05e-1da41c3cef59","Type":"ContainerDied","Data":"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b"} Jun 06 13:13:27.957457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.957388 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" Jun 06 13:13:27.957457 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.957413 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zx2jg" event={"ID":"22daefb3-80ae-4f5a-b05e-1da41c3cef59","Type":"ContainerDied","Data":"254e36eb029fbb73ed3c85144df7581f79aca19e5ee9c0f7c4e28c2b78df1995"} Jun 06 13:13:27.964691 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.964672 2550 scope.go:117] "RemoveContainer" containerID="4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72" Jun 06 13:13:27.964926 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:27.964908 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72\": container with ID starting with 4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72 not found: ID does not exist" containerID="4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72" Jun 06 13:13:27.964974 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.964933 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72"} err="failed to get container status \"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72\": rpc error: code = NotFound desc = could not find container \"4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72\": container with ID starting with 4b07747eb730b4b4ed5f529e7404bb4bdc00d3abdfd6c92ee91fcca3da90cb72 not found: ID does not exist" Jun 06 13:13:27.964974 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.964951 2550 scope.go:117] "RemoveContainer" containerID="5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b" Jun 06 13:13:27.972435 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.972418 2550 scope.go:117] "RemoveContainer" containerID="5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b" Jun 06 13:13:27.972663 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:27.972645 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b\": container with ID starting with 5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b not found: ID does not exist" containerID="5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b" Jun 06 13:13:27.972719 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.972668 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b"} err="failed to get container status \"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b\": rpc error: code = NotFound desc = could not find container \"5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b\": container with ID starting with 5b7a440c7f076be6eda52d2220e7ad9a0a5a61d0206edf645d53c2f4030e938b not found: ID does not exist" Jun 06 13:13:27.973032 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.973017 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:27.978433 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.978415 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zx2jg"] Jun 06 13:13:27.986819 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.986800 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:13:27.989091 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:27.989072 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2gncz"] Jun 06 13:13:29.610019 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:29.609975 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" path="/var/lib/kubelet/pods/22daefb3-80ae-4f5a-b05e-1da41c3cef59/volumes" Jun 06 13:13:29.610453 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:29.610306 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b86414f-e4e3-473b-aed7-123e655c5218" path="/var/lib/kubelet/pods/7b86414f-e4e3-473b-aed7-123e655c5218/volumes" Jun 06 13:13:30.477390 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.477359 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:30.488806 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.488781 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:30.489173 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489161 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" containerName="authorino" Jun 06 13:13:30.489222 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489175 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" containerName="authorino" Jun 06 13:13:30.489222 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489197 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b86414f-e4e3-473b-aed7-123e655c5218" containerName="authorino" Jun 06 13:13:30.489222 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489202 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b86414f-e4e3-473b-aed7-123e655c5218" containerName="authorino" Jun 06 13:13:30.489319 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489268 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b86414f-e4e3-473b-aed7-123e655c5218" containerName="authorino" Jun 06 13:13:30.489319 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.489281 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="22daefb3-80ae-4f5a-b05e-1da41c3cef59" containerName="authorino" Jun 06 13:13:30.493616 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.493599 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.496623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.496342 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 13:13:30.496623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.496374 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 13:13:30.496623 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.496400 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vsf55\"" Jun 06 13:13:30.502165 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.502141 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:30.579000 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.578967 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:30.608345 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.608315 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.608477 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.608421 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876tl\" (UniqueName: \"kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.661315 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.661287 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:30.665386 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.665364 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:13:30.668937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.668918 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:30.677466 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.677364 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:13:30.709847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.709822 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876tl\" (UniqueName: \"kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.709959 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.709883 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.710055 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:30.709998 2550 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 06 13:13:30.710101 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:30.710063 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert podName:928b7a1e-f401-4b50-81de-095859f6d6fd nodeName:}" failed. No retries permitted until 2026-06-06 13:13:31.210046985 +0000 UTC m=+750.070129373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert") pod "maas-controller-58478d9c87-2gl89" (UID: "928b7a1e-f401-4b50-81de-095859f6d6fd") : secret "maas-controller-webhook-cert" not found Jun 06 13:13:30.717965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.717945 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-876tl\" (UniqueName: \"kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:30.811179 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.811153 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:30.811273 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.811184 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjrcx\" (UniqueName: \"kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:30.912628 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.912603 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:30.912727 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.912632 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjrcx\" (UniqueName: \"kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:30.912768 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:30.912736 2550 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 06 13:13:30.912806 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:30.912800 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert podName:0ffbf433-c03e-46a8-9e3b-69b435d0915a nodeName:}" failed. No retries permitted until 2026-06-06 13:13:31.41278624 +0000 UTC m=+750.272868631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert") pod "maas-controller-5c58988875-xccr2" (UID: "0ffbf433-c03e-46a8-9e3b-69b435d0915a") : secret "maas-controller-webhook-cert" not found Jun 06 13:13:30.921708 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:30.921684 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjrcx\" (UniqueName: \"kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:31.087978 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.087877 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:31.215114 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.215083 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:31.217460 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.217443 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") pod \"maas-controller-58478d9c87-2gl89\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:31.404224 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.404148 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:31.416391 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.416370 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:31.418653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.418622 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") pod \"maas-controller-5c58988875-xccr2\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:31.534168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.534141 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:31.536099 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:13:31.536077 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928b7a1e_f401_4b50_81de_095859f6d6fd.slice/crio-41df43b6ce793aec4d313d87de5d843e6bbb2d6c36cd995e216cdd4e1eb4175f WatchSource:0}: Error finding container 41df43b6ce793aec4d313d87de5d843e6bbb2d6c36cd995e216cdd4e1eb4175f: Status 404 returned error can't find the container with id 41df43b6ce793aec4d313d87de5d843e6bbb2d6c36cd995e216cdd4e1eb4175f Jun 06 13:13:31.581316 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.581293 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:31.711564 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.711540 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:13:31.713866 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:13:31.713841 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffbf433_c03e_46a8_9e3b_69b435d0915a.slice/crio-46b4087a22a93cc26dd5078eb3b6af14732a999a1b28359e799f24aee2e8c1af WatchSource:0}: Error finding container 46b4087a22a93cc26dd5078eb3b6af14732a999a1b28359e799f24aee2e8c1af: Status 404 returned error can't find the container with id 46b4087a22a93cc26dd5078eb3b6af14732a999a1b28359e799f24aee2e8c1af Jun 06 13:13:31.980350 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.980271 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58478d9c87-2gl89" event={"ID":"928b7a1e-f401-4b50-81de-095859f6d6fd","Type":"ContainerStarted","Data":"41df43b6ce793aec4d313d87de5d843e6bbb2d6c36cd995e216cdd4e1eb4175f"} Jun 06 13:13:31.981365 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:31.981341 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-xccr2" event={"ID":"0ffbf433-c03e-46a8-9e3b-69b435d0915a","Type":"ContainerStarted","Data":"46b4087a22a93cc26dd5078eb3b6af14732a999a1b28359e799f24aee2e8c1af"} Jun 06 13:13:34.402217 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:34.402174 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:34.501292 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:34.501207 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:13:35.003614 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.003577 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-xccr2" event={"ID":"0ffbf433-c03e-46a8-9e3b-69b435d0915a","Type":"ContainerStarted","Data":"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030"} Jun 06 13:13:35.003794 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.003673 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:35.005056 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.005027 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58478d9c87-2gl89" event={"ID":"928b7a1e-f401-4b50-81de-095859f6d6fd","Type":"ContainerStarted","Data":"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9"} Jun 06 13:13:35.005176 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.005153 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:35.022387 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.022345 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c58988875-xccr2" podStartSLOduration=2.506251457 podStartE2EDuration="5.022332677s" totalImagesPullingTime="2.51608122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:13:35.02002862 +0000 UTC m=+753.880111029" watchObservedRunningTime="2026-06-06 13:13:35.022332677 +0000 UTC m=+753.882415065" Jun 06 13:13:35.036017 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:35.035950 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58478d9c87-2gl89" podStartSLOduration=2.354222615 podStartE2EDuration="5.035934378s" totalImagesPullingTime="2.681711763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:13:35.035724842 +0000 UTC m=+753.895807382" watchObservedRunningTime="2026-06-06 13:13:35.035934378 +0000 UTC m=+753.896016787" Jun 06 13:13:46.016263 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.016230 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:13:46.016796 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.016508 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:46.072833 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.072803 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:46.073083 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.073057 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-58478d9c87-2gl89" podUID="928b7a1e-f401-4b50-81de-095859f6d6fd" containerName="manager" containerID="cri-o://10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9" gracePeriod=30 Jun 06 13:13:46.322114 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.322087 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:46.465258 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.465226 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") pod \"928b7a1e-f401-4b50-81de-095859f6d6fd\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " Jun 06 13:13:46.465434 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.465265 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-876tl\" (UniqueName: \"kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl\") pod \"928b7a1e-f401-4b50-81de-095859f6d6fd\" (UID: \"928b7a1e-f401-4b50-81de-095859f6d6fd\") " Jun 06 13:13:46.467461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.467423 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "928b7a1e-f401-4b50-81de-095859f6d6fd" (UID: "928b7a1e-f401-4b50-81de-095859f6d6fd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:13:46.467556 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.467485 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl" (OuterVolumeSpecName: "kube-api-access-876tl") pod "928b7a1e-f401-4b50-81de-095859f6d6fd" (UID: "928b7a1e-f401-4b50-81de-095859f6d6fd"). InnerVolumeSpecName "kube-api-access-876tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:13:46.566712 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.566679 2550 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/928b7a1e-f401-4b50-81de-095859f6d6fd-webhook-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:13:46.566712 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:46.566704 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-876tl\" (UniqueName: \"kubernetes.io/projected/928b7a1e-f401-4b50-81de-095859f6d6fd-kube-api-access-876tl\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:13:47.075969 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.075934 2550 generic.go:356] "Generic (PLEG): container finished" podID="928b7a1e-f401-4b50-81de-095859f6d6fd" containerID="10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9" exitCode=0 Jun 06 13:13:47.076383 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.075995 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58478d9c87-2gl89" Jun 06 13:13:47.076383 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.076014 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58478d9c87-2gl89" event={"ID":"928b7a1e-f401-4b50-81de-095859f6d6fd","Type":"ContainerDied","Data":"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9"} Jun 06 13:13:47.076383 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.076064 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58478d9c87-2gl89" event={"ID":"928b7a1e-f401-4b50-81de-095859f6d6fd","Type":"ContainerDied","Data":"41df43b6ce793aec4d313d87de5d843e6bbb2d6c36cd995e216cdd4e1eb4175f"} Jun 06 13:13:47.076383 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.076085 2550 scope.go:117] "RemoveContainer" containerID="10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9" Jun 06 13:13:47.085389 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.085374 2550 scope.go:117] "RemoveContainer" containerID="10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9" Jun 06 13:13:47.085653 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:13:47.085631 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9\": container with ID starting with 10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9 not found: ID does not exist" containerID="10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9" Jun 06 13:13:47.085751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.085658 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9"} err="failed to get container status \"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9\": rpc error: code = NotFound desc = could not find container \"10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9\": container with ID starting with 10a5ca134d2f268f2443f028a065da4a1504d4e36fe6c72a359f8402f5d0c6e9 not found: ID does not exist" Jun 06 13:13:47.096450 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.096430 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:47.114751 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.114732 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58478d9c87-2gl89"] Jun 06 13:13:47.610241 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:13:47.610212 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="928b7a1e-f401-4b50-81de-095859f6d6fd" path="/var/lib/kubelet/pods/928b7a1e-f401-4b50-81de-095859f6d6fd/volumes" Jun 06 13:14:05.526474 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.526437 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:05.584945 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.584908 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl"] Jun 06 13:14:05.585402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.585374 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="928b7a1e-f401-4b50-81de-095859f6d6fd" containerName="manager" Jun 06 13:14:05.585402 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.585391 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="928b7a1e-f401-4b50-81de-095859f6d6fd" containerName="manager" Jun 06 13:14:05.585549 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.585485 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="928b7a1e-f401-4b50-81de-095859f6d6fd" containerName="manager" Jun 06 13:14:05.590054 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.590039 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.592321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.592294 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 06 13:14:05.592449 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.592346 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 06 13:14:05.593415 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.593272 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 06 13:14:05.593415 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.593299 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-xrg7k\"" Jun 06 13:14:05.602765 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.602737 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl"] Jun 06 13:14:05.639930 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.639899 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.639930 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.639937 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4r8b\" (UniqueName: \"kubernetes.io/projected/1775a62b-81b6-43cb-8a53-44b73ccbcc56-kube-api-access-l4r8b\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.740932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.740884 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.741150 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.740940 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4r8b\" (UniqueName: \"kubernetes.io/projected/1775a62b-81b6-43cb-8a53-44b73ccbcc56-kube-api-access-l4r8b\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.741150 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:14:05.741080 2550 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 06 13:14:05.741239 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:14:05.741159 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls podName:1775a62b-81b6-43cb-8a53-44b73ccbcc56 nodeName:}" failed. No retries permitted until 2026-06-06 13:14:06.241137129 +0000 UTC m=+785.101219520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls") pod "maas-api-6ccf49c998-bvdvl" (UID: "1775a62b-81b6-43cb-8a53-44b73ccbcc56") : secret "maas-api-serving-cert" not found Jun 06 13:14:05.749451 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.749420 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4r8b\" (UniqueName: \"kubernetes.io/projected/1775a62b-81b6-43cb-8a53-44b73ccbcc56-kube-api-access-l4r8b\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:05.847840 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.847803 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:05.951842 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:05.951809 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:06.035706 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.035664 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:06.097830 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.097797 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ksglh"] Jun 06 13:14:06.101730 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.101671 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:06.103928 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.103908 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bkjn7\"" Jun 06 13:14:06.104154 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.104139 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 13:14:06.109870 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.109842 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ksglh"] Jun 06 13:14:06.145963 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.145931 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q97tx\" (UniqueName: \"kubernetes.io/projected/0d3faaa7-475e-4c18-ba93-496571fe78e5-kube-api-access-q97tx\") pod \"payload-processing-7c6c859784-ksglh\" (UID: \"0d3faaa7-475e-4c18-ba93-496571fe78e5\") " pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:06.246858 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.246822 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q97tx\" (UniqueName: \"kubernetes.io/projected/0d3faaa7-475e-4c18-ba93-496571fe78e5-kube-api-access-q97tx\") pod \"payload-processing-7c6c859784-ksglh\" (UID: \"0d3faaa7-475e-4c18-ba93-496571fe78e5\") " pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:06.247054 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.246872 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:06.249413 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.249384 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1775a62b-81b6-43cb-8a53-44b73ccbcc56-maas-api-tls\") pod \"maas-api-6ccf49c998-bvdvl\" (UID: \"1775a62b-81b6-43cb-8a53-44b73ccbcc56\") " pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:06.255203 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.255180 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q97tx\" (UniqueName: \"kubernetes.io/projected/0d3faaa7-475e-4c18-ba93-496571fe78e5-kube-api-access-q97tx\") pod \"payload-processing-7c6c859784-ksglh\" (UID: \"0d3faaa7-475e-4c18-ba93-496571fe78e5\") " pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:06.413916 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.413818 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:06.502663 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.502621 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:06.559083 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.558959 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-ksglh"] Jun 06 13:14:06.567369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.567345 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:14:06.664125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:06.664023 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl"] Jun 06 13:14:06.670161 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:14:06.670109 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1775a62b_81b6_43cb_8a53_44b73ccbcc56.slice/crio-3f11bc67ed9da3f493d9fca08b5ff21d233ee885428eef6717aa1fc667864bd7 WatchSource:0}: Error finding container 3f11bc67ed9da3f493d9fca08b5ff21d233ee885428eef6717aa1fc667864bd7: Status 404 returned error can't find the container with id 3f11bc67ed9da3f493d9fca08b5ff21d233ee885428eef6717aa1fc667864bd7 Jun 06 13:14:07.177644 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:07.177605 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" event={"ID":"1775a62b-81b6-43cb-8a53-44b73ccbcc56","Type":"ContainerStarted","Data":"3f11bc67ed9da3f493d9fca08b5ff21d233ee885428eef6717aa1fc667864bd7"} Jun 06 13:14:07.178877 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:07.178847 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" event={"ID":"0d3faaa7-475e-4c18-ba93-496571fe78e5","Type":"ContainerStarted","Data":"33b51199e4278b8f795d4fc7c4c527f9b23bad292e3b1bbe99c64c9475022c03"} Jun 06 13:14:09.192330 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.192294 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" event={"ID":"1775a62b-81b6-43cb-8a53-44b73ccbcc56","Type":"ContainerStarted","Data":"cd514b3e3de72eef46b1f6a2c3e04f5d51b5d25c4cce727609275baca6b5bce0"} Jun 06 13:14:09.192805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.192386 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:09.193846 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.193822 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" event={"ID":"0d3faaa7-475e-4c18-ba93-496571fe78e5","Type":"ContainerStarted","Data":"275978f2161c05a2e9886ad31c48109aaa57f33b4dfd475095427b534b3b31ba"} Jun 06 13:14:09.193996 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.193944 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:09.210976 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.210936 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" podStartSLOduration=2.359246659 podStartE2EDuration="4.210924333s" totalImagesPullingTime="1.851677674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:14:09.208839465 +0000 UTC m=+788.068921912" watchObservedRunningTime="2026-06-06 13:14:09.210924333 +0000 UTC m=+788.071006743" Jun 06 13:14:09.222507 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:09.222448 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" podStartSLOduration=1.268784359 podStartE2EDuration="3.222433372s" totalImagesPullingTime="1.953649013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:14:09.222301041 +0000 UTC m=+788.082383449" watchObservedRunningTime="2026-06-06 13:14:09.222433372 +0000 UTC m=+788.082515782" Jun 06 13:14:14.228674 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.228641 2550 generic.go:356] "Generic (PLEG): container finished" podID="212c1294-ed5f-4d51-b0db-d4aa773510e9" containerID="4726eba3de02e428368c7c6c110f48f69f826daa89c05b7bef1509213cd53596" exitCode=0 Jun 06 13:14:14.229107 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.228713 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" event={"ID":"212c1294-ed5f-4d51-b0db-d4aa773510e9","Type":"ContainerDied","Data":"4726eba3de02e428368c7c6c110f48f69f826daa89c05b7bef1509213cd53596"} Jun 06 13:14:14.229197 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.229137 2550 scope.go:117] "RemoveContainer" containerID="4726eba3de02e428368c7c6c110f48f69f826daa89c05b7bef1509213cd53596" Jun 06 13:14:14.230248 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.230215 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:14:14.230326 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.230313 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:14:14.230365 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:14.230348 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:14:15.204896 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.204865 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-6ccf49c998-bvdvl" Jun 06 13:14:15.238044 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.238002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" event={"ID":"212c1294-ed5f-4d51-b0db-d4aa773510e9","Type":"ContainerStarted","Data":"04ec76b3275183efd3b41877c919bb0925b1fe9bb7bf7a9f1d5340acc658ccb6"} Jun 06 13:14:15.399468 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.399432 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:14:15.849282 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.849249 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:14:15.849667 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.849642 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6jfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 06 13:14:15.849832 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:15.849810 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" podUID="212c1294-ed5f-4d51-b0db-d4aa773510e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 06 13:14:16.848848 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:16.848798 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6jfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 06 13:14:16.849413 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:16.848888 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" podUID="212c1294-ed5f-4d51-b0db-d4aa773510e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 06 13:14:16.914583 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:16.914546 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:16.914788 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:16.914764 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" containerID="cri-o://7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0" gracePeriod=30 Jun 06 13:14:17.849012 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:17.848952 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6jfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 06 13:14:17.849608 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:17.849574 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" podUID="212c1294-ed5f-4d51-b0db-d4aa773510e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 06 13:14:18.607145 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.607122 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:18.679102 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.679002 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrr9x\" (UniqueName: \"kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x\") pod \"f18024ae-0199-46e1-914c-0c018cb51b55\" (UID: \"f18024ae-0199-46e1-914c-0c018cb51b55\") " Jun 06 13:14:18.681447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.681414 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x" (OuterVolumeSpecName: "kube-api-access-zrr9x") pod "f18024ae-0199-46e1-914c-0c018cb51b55" (UID: "f18024ae-0199-46e1-914c-0c018cb51b55"). InnerVolumeSpecName "kube-api-access-zrr9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:14:18.780145 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.780099 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrr9x\" (UniqueName: \"kubernetes.io/projected/f18024ae-0199-46e1-914c-0c018cb51b55-kube-api-access-zrr9x\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:14:18.850370 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.849905 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6jfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 06 13:14:18.850370 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:18.849962 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" podUID="212c1294-ed5f-4d51-b0db-d4aa773510e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 06 13:14:19.266168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.266132 2550 generic.go:356] "Generic (PLEG): container finished" podID="f18024ae-0199-46e1-914c-0c018cb51b55" containerID="7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0" exitCode=143 Jun 06 13:14:19.266347 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.266177 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.266347 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.266188 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f18024ae-0199-46e1-914c-0c018cb51b55","Type":"ContainerDied","Data":"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0"} Jun 06 13:14:19.266347 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.266234 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f18024ae-0199-46e1-914c-0c018cb51b55","Type":"ContainerDied","Data":"eb3996124f047e968f4ac76716b58c769273ebffdcc81becfbdb83d97139da1c"} Jun 06 13:14:19.266347 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.266256 2550 scope.go:117] "RemoveContainer" containerID="7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0" Jun 06 13:14:19.275887 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.275870 2550 scope.go:117] "RemoveContainer" containerID="7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0" Jun 06 13:14:19.276176 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:14:19.276150 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0\": container with ID starting with 7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0 not found: ID does not exist" containerID="7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0" Jun 06 13:14:19.276281 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.276182 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0"} err="failed to get container status \"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0\": rpc error: code = NotFound desc = could not find container \"7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0\": container with ID starting with 7038a0ae93d5a8c53a24ee78476744858b27dd43efcbef868cf19ee9086529b0 not found: ID does not exist" Jun 06 13:14:19.287271 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.287246 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:19.288974 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.288955 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:19.309043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.309005 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:19.309466 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.309449 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" Jun 06 13:14:19.309544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.309471 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" Jun 06 13:14:19.309625 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.309613 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" containerName="keycloak" Jun 06 13:14:19.312185 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.312167 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.314472 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.314449 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 13:14:19.314575 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.314506 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 13:14:19.314643 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.314578 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8w9jr\"" Jun 06 13:14:19.314699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.314670 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 06 13:14:19.314699 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.314677 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 13:14:19.320861 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.320839 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:19.387395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.387362 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8hjm\" (UniqueName: \"kubernetes.io/projected/8ee413f9-fa10-4ff3-bacf-b968ae44f850-kube-api-access-g8hjm\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.387566 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.387424 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ee413f9-fa10-4ff3-bacf-b968ae44f850-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.488177 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.488143 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8hjm\" (UniqueName: \"kubernetes.io/projected/8ee413f9-fa10-4ff3-bacf-b968ae44f850-kube-api-access-g8hjm\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.488344 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.488195 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ee413f9-fa10-4ff3-bacf-b968ae44f850-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.488858 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.488840 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ee413f9-fa10-4ff3-bacf-b968ae44f850-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.495943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.495921 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8hjm\" (UniqueName: \"kubernetes.io/projected/8ee413f9-fa10-4ff3-bacf-b968ae44f850-kube-api-access-g8hjm\") pod \"maas-keycloak-0\" (UID: \"8ee413f9-fa10-4ff3-bacf-b968ae44f850\") " pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.611369 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.611336 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18024ae-0199-46e1-914c-0c018cb51b55" path="/var/lib/kubelet/pods/f18024ae-0199-46e1-914c-0c018cb51b55/volumes" Jun 06 13:14:19.623461 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.623435 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:19.756657 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.756633 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 13:14:19.758860 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:14:19.758829 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee413f9_fa10_4ff3_bacf_b968ae44f850.slice/crio-d75564f2944168ef12cb44b7476d14756d02bdb10b5aef7c96f6f7944ad56047 WatchSource:0}: Error finding container d75564f2944168ef12cb44b7476d14756d02bdb10b5aef7c96f6f7944ad56047: Status 404 returned error can't find the container with id d75564f2944168ef12cb44b7476d14756d02bdb10b5aef7c96f6f7944ad56047 Jun 06 13:14:19.852513 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.852475 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:14:19.853728 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:19.853705 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6jfh" Jun 06 13:14:20.201890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.201867 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-ksglh" Jun 06 13:14:20.275862 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.275829 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ee413f9-fa10-4ff3-bacf-b968ae44f850","Type":"ContainerStarted","Data":"903c773a20f1a5c91747ac05bf8737bf88507791d788f93966019e28d79db2b6"} Jun 06 13:14:20.276033 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.275880 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ee413f9-fa10-4ff3-bacf-b968ae44f850","Type":"ContainerStarted","Data":"d75564f2944168ef12cb44b7476d14756d02bdb10b5aef7c96f6f7944ad56047"} Jun 06 13:14:20.292609 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.292516 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.914118303 podStartE2EDuration="1.292491797s" totalImagesPullingTime="378.373494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:14:20.292061954 +0000 UTC m=+799.152144364" watchObservedRunningTime="2026-06-06 13:14:20.292491797 +0000 UTC m=+799.152574209" Jun 06 13:14:20.624026 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.623959 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:20.625862 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:20.625821 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:21.624558 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:21.624500 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:22.624002 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:22.623943 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:23.624823 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:23.624777 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:24.624634 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:24.624575 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:25.624010 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:25.623932 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:26.624445 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:26.624391 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:27.624620 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:27.624561 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:28.624162 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:28.624109 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:29.624258 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:29.624224 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:29.624757 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:29.624552 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:30.624822 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:30.624774 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:31.624265 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:31.624221 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:32.624105 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:32.624055 2550 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 06 13:14:33.747770 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:33.747736 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:33.762721 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:33.762675 2550 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8ee413f9-fa10-4ff3-bacf-b968ae44f850" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 13:14:41.692519 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:41.692481 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:41.792158 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:41.792095 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:43.754218 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:43.754186 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 13:14:55.765288 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:55.765249 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:14:55.765790 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:55.765488 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" podUID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" containerName="authorino" containerID="cri-o://dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede" gracePeriod=30 Jun 06 13:14:56.031968 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.031943 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:14:56.162890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.162847 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert\") pod \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " Jun 06 13:14:56.163117 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.162902 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldmsx\" (UniqueName: \"kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx\") pod \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\" (UID: \"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3\") " Jun 06 13:14:56.165047 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.165018 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx" (OuterVolumeSpecName: "kube-api-access-ldmsx") pod "96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" (UID: "96c0189b-46fa-4a6a-a08a-f93bbd7d86c3"). InnerVolumeSpecName "kube-api-access-ldmsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:14:56.175477 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.175448 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" (UID: "96c0189b-46fa-4a6a-a08a-f93bbd7d86c3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:14:56.185111 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.185085 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:56.263957 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.263933 2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-tls-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:14:56.263957 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.263958 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldmsx\" (UniqueName: \"kubernetes.io/projected/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3-kube-api-access-ldmsx\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:14:56.284493 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.284420 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:14:56.507695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.507661 2550 generic.go:356] "Generic (PLEG): container finished" podID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" containerID="dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede" exitCode=0 Jun 06 13:14:56.507695 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.507699 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" Jun 06 13:14:56.507917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.507736 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" event={"ID":"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3","Type":"ContainerDied","Data":"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede"} Jun 06 13:14:56.507917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.507777 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b455c68bd-6n6bd" event={"ID":"96c0189b-46fa-4a6a-a08a-f93bbd7d86c3","Type":"ContainerDied","Data":"8681745fd100a3568c95ebddf30db535075ecb71039ba7e940684fac625d1220"} Jun 06 13:14:56.507917 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.507795 2550 scope.go:117] "RemoveContainer" containerID="dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede" Jun 06 13:14:56.516534 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.516518 2550 scope.go:117] "RemoveContainer" containerID="dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede" Jun 06 13:14:56.516882 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:14:56.516866 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede\": container with ID starting with dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede not found: ID does not exist" containerID="dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede" Jun 06 13:14:56.516945 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.516892 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede"} err="failed to get container status \"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede\": rpc error: code = NotFound desc = could not find container \"dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede\": container with ID starting with dfcbbabf548f2214671d66f5fb320c60c925633b239e6e92c2527d74d32e8ede not found: ID does not exist" Jun 06 13:14:56.530471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.530444 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:14:56.534318 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:56.534296 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b455c68bd-6n6bd"] Jun 06 13:14:57.611158 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:14:57.611121 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" path="/var/lib/kubelet/pods/96c0189b-46fa-4a6a-a08a-f93bbd7d86c3/volumes" Jun 06 13:15:00.136577 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.136533 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:15:00.137068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.136971 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" containerName="authorino" Jun 06 13:15:00.137068 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.136997 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" containerName="authorino" Jun 06 13:15:00.137154 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.137072 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c0189b-46fa-4a6a-a08a-f93bbd7d86c3" containerName="authorino" Jun 06 13:15:00.141739 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.141720 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:15:00.145153 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.145119 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:15:00.304284 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.304242 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gc86\" (UniqueName: \"kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86\") pod \"maas-api-key-cleanup-29679195-hqjrm\" (UID: \"6ea59fdd-bfd8-409c-b139-e8bd34d2401c\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:15:00.405792 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.405695 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gc86\" (UniqueName: \"kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86\") pod \"maas-api-key-cleanup-29679195-hqjrm\" (UID: \"6ea59fdd-bfd8-409c-b139-e8bd34d2401c\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:15:00.413211 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.413178 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gc86\" (UniqueName: \"kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86\") pod \"maas-api-key-cleanup-29679195-hqjrm\" (UID: \"6ea59fdd-bfd8-409c-b139-e8bd34d2401c\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:15:00.455107 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.455083 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:15:00.582632 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:00.582607 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:15:00.584841 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:15:00.584814 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea59fdd_bfd8_409c_b139_e8bd34d2401c.slice/crio-8e75b1af760d33bb952bf0781210f348450849f54cb8c892c09d6dd716540429 WatchSource:0}: Error finding container 8e75b1af760d33bb952bf0781210f348450849f54cb8c892c09d6dd716540429: Status 404 returned error can't find the container with id 8e75b1af760d33bb952bf0781210f348450849f54cb8c892c09d6dd716540429 Jun 06 13:15:01.537048 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:01.537014 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" event={"ID":"6ea59fdd-bfd8-409c-b139-e8bd34d2401c","Type":"ContainerStarted","Data":"8e75b1af760d33bb952bf0781210f348450849f54cb8c892c09d6dd716540429"} Jun 06 13:15:04.556488 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:04.556403 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" event={"ID":"6ea59fdd-bfd8-409c-b139-e8bd34d2401c","Type":"ContainerStarted","Data":"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9"} Jun 06 13:15:04.572544 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:04.572500 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" podStartSLOduration=1.248598886 podStartE2EDuration="4.572484851s" totalImagesPullingTime="3.323885965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:15:04.569821169 +0000 UTC m=+843.429903616" watchObservedRunningTime="2026-06-06 13:15:04.572484851 +0000 UTC m=+843.432567260" Jun 06 13:15:05.461693 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.461652 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn"] Jun 06 13:15:05.465414 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.465397 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.468685 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.468655 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dtnvb\"" Jun 06 13:15:05.468685 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.468668 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 13:15:05.468877 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.468734 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 06 13:15:05.468877 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.468780 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 13:15:05.473123 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.473067 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn"] Jun 06 13:15:05.528707 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.528683 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:05.656884 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.656852 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.656884 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.656889 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.657325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.657057 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.657325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.657084 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4sc\" (UniqueName: \"kubernetes.io/projected/246bb572-5329-42f9-aab5-8795ba998a62-kube-api-access-8d4sc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.657325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.657133 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246bb572-5329-42f9-aab5-8795ba998a62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.657325 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.657177 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758044 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758082 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4sc\" (UniqueName: \"kubernetes.io/projected/246bb572-5329-42f9-aab5-8795ba998a62-kube-api-access-8d4sc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758116 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246bb572-5329-42f9-aab5-8795ba998a62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758164 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758376 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758239 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758530 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758509 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758593 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758532 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.758649 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.758597 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.760476 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.760453 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246bb572-5329-42f9-aab5-8795ba998a62-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.760660 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.760644 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246bb572-5329-42f9-aab5-8795ba998a62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.764869 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.764848 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4sc\" (UniqueName: \"kubernetes.io/projected/246bb572-5329-42f9-aab5-8795ba998a62-kube-api-access-8d4sc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn\" (UID: \"246bb572-5329-42f9-aab5-8795ba998a62\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.777747 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.777723 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:05.915504 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:05.915481 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn"] Jun 06 13:15:05.917754 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:15:05.917725 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246bb572_5329_42f9_aab5_8795ba998a62.slice/crio-64b6f48d4346348a1930e68db9aeeeb21ae89c034e6d6bbfe58ff89a7188612c WatchSource:0}: Error finding container 64b6f48d4346348a1930e68db9aeeeb21ae89c034e6d6bbfe58ff89a7188612c: Status 404 returned error can't find the container with id 64b6f48d4346348a1930e68db9aeeeb21ae89c034e6d6bbfe58ff89a7188612c Jun 06 13:15:06.569847 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:06.569805 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" event={"ID":"246bb572-5329-42f9-aab5-8795ba998a62","Type":"ContainerStarted","Data":"64b6f48d4346348a1930e68db9aeeeb21ae89c034e6d6bbfe58ff89a7188612c"} Jun 06 13:15:09.510555 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:09.510519 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:10.601844 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:10.601801 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" event={"ID":"246bb572-5329-42f9-aab5-8795ba998a62","Type":"ContainerStarted","Data":"b2cead2269bb42c7be5af9cc56b4e8d8a212c309f412820111e080fe4f187e25"} Jun 06 13:15:11.609772 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:11.609732 2550 generic.go:356] "Generic (PLEG): container finished" podID="246bb572-5329-42f9-aab5-8795ba998a62" containerID="b2cead2269bb42c7be5af9cc56b4e8d8a212c309f412820111e080fe4f187e25" exitCode=0 Jun 06 13:15:11.610965 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:11.610892 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" event={"ID":"246bb572-5329-42f9-aab5-8795ba998a62","Type":"ContainerDied","Data":"b2cead2269bb42c7be5af9cc56b4e8d8a212c309f412820111e080fe4f187e25"} Jun 06 13:15:13.621796 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:13.621761 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" event={"ID":"246bb572-5329-42f9-aab5-8795ba998a62","Type":"ContainerStarted","Data":"b3cbc36633a58b2fdd4cdc154b60a40b242a58d27161fd6eefb64280f4ad9e75"} Jun 06 13:15:13.640505 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:13.640451 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" podStartSLOduration=2.208010595 podStartE2EDuration="8.640434634s" totalImagesPullingTime="4.946919635s" totalInitContainerRuntime="1.485504404s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:15:13.637596458 +0000 UTC m=+852.497678867" watchObservedRunningTime="2026-06-06 13:15:13.640434634 +0000 UTC m=+852.500517044" Jun 06 13:15:15.637517 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.637481 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws"] Jun 06 13:15:15.641812 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.641790 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.644470 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.644410 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 06 13:15:15.656960 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.656930 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:15.658653 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.658624 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws"] Jun 06 13:15:15.755336 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755296 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.755336 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755342 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.755552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755364 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbdac33-4552-4df9-afa2-896a51a1c667-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.755552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755478 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.755552 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755518 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.755658 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.755595 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcvn\" (UniqueName: \"kubernetes.io/projected/bbbdac33-4552-4df9-afa2-896a51a1c667-kube-api-access-dmcvn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.778881 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.778847 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:15.779035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.778899 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:15.791837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.791812 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:15.856355 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856312 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856380 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856444 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcvn\" (UniqueName: \"kubernetes.io/projected/bbbdac33-4552-4df9-afa2-896a51a1c667-kube-api-access-dmcvn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856480 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856506 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856532 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856531 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbdac33-4552-4df9-afa2-896a51a1c667-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856796 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856762 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856893 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856868 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.856964 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.856942 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.858738 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.858716 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbdac33-4552-4df9-afa2-896a51a1c667-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.858915 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.858899 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbdac33-4552-4df9-afa2-896a51a1c667-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.864755 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.864735 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcvn\" (UniqueName: \"kubernetes.io/projected/bbbdac33-4552-4df9-afa2-896a51a1c667-kube-api-access-dmcvn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws\" (UID: \"bbbdac33-4552-4df9-afa2-896a51a1c667\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:15.965110 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:15.965017 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:16.103784 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:16.103757 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws"] Jun 06 13:15:16.106054 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:15:16.106019 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbdac33_4552_4df9_afa2_896a51a1c667.slice/crio-f8ed8294fc05af4ebe3ea98140ec1e92eaefc38706830b133b152f953b6692e0 WatchSource:0}: Error finding container f8ed8294fc05af4ebe3ea98140ec1e92eaefc38706830b133b152f953b6692e0: Status 404 returned error can't find the container with id f8ed8294fc05af4ebe3ea98140ec1e92eaefc38706830b133b152f953b6692e0 Jun 06 13:15:16.639514 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:16.639473 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" event={"ID":"bbbdac33-4552-4df9-afa2-896a51a1c667","Type":"ContainerStarted","Data":"492a5e702ae75cb15ea138d042f2abfd5851dc579d54914789376845ee9be067"} Jun 06 13:15:16.640051 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:16.639531 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" event={"ID":"bbbdac33-4552-4df9-afa2-896a51a1c667","Type":"ContainerStarted","Data":"f8ed8294fc05af4ebe3ea98140ec1e92eaefc38706830b133b152f953b6692e0"} Jun 06 13:15:16.651133 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:16.651106 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn" Jun 06 13:15:17.646226 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:17.646187 2550 generic.go:356] "Generic (PLEG): container finished" podID="bbbdac33-4552-4df9-afa2-896a51a1c667" containerID="492a5e702ae75cb15ea138d042f2abfd5851dc579d54914789376845ee9be067" exitCode=0 Jun 06 13:15:17.646622 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:17.646243 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" event={"ID":"bbbdac33-4552-4df9-afa2-896a51a1c667","Type":"ContainerDied","Data":"492a5e702ae75cb15ea138d042f2abfd5851dc579d54914789376845ee9be067"} Jun 06 13:15:18.654007 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:18.653952 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" event={"ID":"bbbdac33-4552-4df9-afa2-896a51a1c667","Type":"ContainerStarted","Data":"176199b11d8734f2799e9740449dc1975ad63ab5ae59a34defa06de10bc6d58c"} Jun 06 13:15:18.671943 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:18.671887 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" podStartSLOduration=2.178452115 podStartE2EDuration="3.671867804s" totalImagesPullingTime="168.835205ms" totalInitContainerRuntime="1.324580484s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:15:18.669825796 +0000 UTC m=+857.529908227" watchObservedRunningTime="2026-06-06 13:15:18.671867804 +0000 UTC m=+857.531950217" Jun 06 13:15:25.965922 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:25.965882 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:25.966322 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:25.965978 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:25.977883 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:25.977858 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:26.705540 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:26.705508 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws" Jun 06 13:15:28.060698 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:28.060662 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:48.625687 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:48.625600 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:55.132948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:55.132903 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:15:58.759774 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:15:58.759735 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:16:00.011300 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:00.011259 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:16:00.011837 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:00.011538 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" podUID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" containerName="cleanup" containerID="cri-o://6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9" gracePeriod=30 Jun 06 13:16:01.633409 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:01.633373 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:16:01.635690 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:01.635669 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:16:30.196423 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:30.196396 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:16:30.283899 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:30.283801 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gc86\" (UniqueName: \"kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86\") pod \"6ea59fdd-bfd8-409c-b139-e8bd34d2401c\" (UID: \"6ea59fdd-bfd8-409c-b139-e8bd34d2401c\") " Jun 06 13:16:30.285937 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:30.285906 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86" (OuterVolumeSpecName: "kube-api-access-6gc86") pod "6ea59fdd-bfd8-409c-b139-e8bd34d2401c" (UID: "6ea59fdd-bfd8-409c-b139-e8bd34d2401c"). InnerVolumeSpecName "kube-api-access-6gc86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:16:30.385182 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:30.385127 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gc86\" (UniqueName: \"kubernetes.io/projected/6ea59fdd-bfd8-409c-b139-e8bd34d2401c-kube-api-access-6gc86\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:16:31.030654 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.030617 2550 generic.go:356] "Generic (PLEG): container finished" podID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" containerID="6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9" exitCode=137 Jun 06 13:16:31.030825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.030662 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" Jun 06 13:16:31.030825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.030700 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" event={"ID":"6ea59fdd-bfd8-409c-b139-e8bd34d2401c","Type":"ContainerDied","Data":"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9"} Jun 06 13:16:31.030825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.030752 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm" event={"ID":"6ea59fdd-bfd8-409c-b139-e8bd34d2401c","Type":"ContainerDied","Data":"8e75b1af760d33bb952bf0781210f348450849f54cb8c892c09d6dd716540429"} Jun 06 13:16:31.030825 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.030783 2550 scope.go:117] "RemoveContainer" containerID="6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9" Jun 06 13:16:31.040013 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.039972 2550 scope.go:117] "RemoveContainer" containerID="6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9" Jun 06 13:16:31.040285 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:16:31.040265 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9\": container with ID starting with 6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9 not found: ID does not exist" containerID="6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9" Jun 06 13:16:31.040382 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.040292 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9"} err="failed to get container status \"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9\": rpc error: code = NotFound desc = could not find container \"6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9\": container with ID starting with 6a6efc52a057a807acb5d2fdb6a277919e047d7d2eaded60fdd348a35b9b70b9 not found: ID does not exist" Jun 06 13:16:31.055113 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.055085 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:16:31.060880 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.060860 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29679195-hqjrm"] Jun 06 13:16:31.615723 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:16:31.615683 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" path="/var/lib/kubelet/pods/6ea59fdd-bfd8-409c-b139-e8bd34d2401c/volumes" Jun 06 13:17:18.205511 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:17:18.205419 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:17:19.283895 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:17:19.283853 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:17:19.378953 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:17:19.378923 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:17:34.349269 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:17:34.349231 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:17:49.995705 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:17:49.995667 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:18:00.329240 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:00.329204 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:18:48.728649 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:48.728575 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:18:48.831698 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:48.831664 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:18:48.831939 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:48.831890 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c58988875-xccr2" podUID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" containerName="manager" containerID="cri-o://a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030" gracePeriod=30 Jun 06 13:18:49.083276 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.083254 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:18:49.164882 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.164848 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjrcx\" (UniqueName: \"kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx\") pod \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " Jun 06 13:18:49.165048 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.164898 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") pod \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\" (UID: \"0ffbf433-c03e-46a8-9e3b-69b435d0915a\") " Jun 06 13:18:49.166824 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.166796 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx" (OuterVolumeSpecName: "kube-api-access-cjrcx") pod "0ffbf433-c03e-46a8-9e3b-69b435d0915a" (UID: "0ffbf433-c03e-46a8-9e3b-69b435d0915a"). InnerVolumeSpecName "kube-api-access-cjrcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:18:49.166951 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.166925 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0ffbf433-c03e-46a8-9e3b-69b435d0915a" (UID: "0ffbf433-c03e-46a8-9e3b-69b435d0915a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:18:49.266188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.266123 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjrcx\" (UniqueName: \"kubernetes.io/projected/0ffbf433-c03e-46a8-9e3b-69b435d0915a-kube-api-access-cjrcx\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:18:49.266188 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.266147 2550 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffbf433-c03e-46a8-9e3b-69b435d0915a-webhook-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\"" Jun 06 13:18:49.755321 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.755286 2550 generic.go:356] "Generic (PLEG): container finished" podID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" containerID="a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030" exitCode=0 Jun 06 13:18:49.755785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.755331 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-xccr2" Jun 06 13:18:49.755785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.755334 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-xccr2" event={"ID":"0ffbf433-c03e-46a8-9e3b-69b435d0915a","Type":"ContainerDied","Data":"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030"} Jun 06 13:18:49.755785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.755459 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-xccr2" event={"ID":"0ffbf433-c03e-46a8-9e3b-69b435d0915a","Type":"ContainerDied","Data":"46b4087a22a93cc26dd5078eb3b6af14732a999a1b28359e799f24aee2e8c1af"} Jun 06 13:18:49.755785 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.755490 2550 scope.go:117] "RemoveContainer" containerID="a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030" Jun 06 13:18:49.764281 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.764264 2550 scope.go:117] "RemoveContainer" containerID="a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030" Jun 06 13:18:49.764545 ip-10-0-131-83 kubenswrapper[2550]: E0606 13:18:49.764525 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030\": container with ID starting with a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030 not found: ID does not exist" containerID="a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030" Jun 06 13:18:49.764592 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.764554 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030"} err="failed to get container status \"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030\": rpc error: code = NotFound desc = could not find container \"a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030\": container with ID starting with a06d255ad8c721ab3bcb29e7a00a38540fda49e77c2e743ce6d828c373773030 not found: ID does not exist" Jun 06 13:18:49.769726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.769706 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:18:49.774212 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:49.774189 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c58988875-xccr2"] Jun 06 13:18:50.407228 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:50.407194 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:18:51.610205 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:18:51.610174 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" path="/var/lib/kubelet/pods/0ffbf433-c03e-46a8-9e3b-69b435d0915a/volumes" Jun 06 13:19:21.737443 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:21.737410 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:21.785250 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:21.785226 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:31.932744 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:31.932710 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:32.030967 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:32.030929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:32.133445 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:32.133416 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:32.625406 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:32.625374 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:32.725593 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:32.725558 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:40.431750 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:40.431720 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:45.942871 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:45.942838 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:19:46.043471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:19:46.043439 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:18.059530 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:18.059445 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:18.164397 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:18.164365 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:18.321610 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:18.321520 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:18.775760 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:18.775668 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:18.875519 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:18.875489 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:42.495822 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:42.495793 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:47.990315 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:47.990279 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:48.038806 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:48.038772 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:48.294524 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:48.294447 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:48.391320 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:48.391288 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:48.547401 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:48.547319 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:20:48.647538 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:20:48.647505 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:01.666682 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:01.666653 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:21:01.671377 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:01.671346 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6lldq_2f08586d-6a3f-4256-9ab4-30beab43d1af/ovn-acl-logging/0.log" Jun 06 13:21:05.873493 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:05.873454 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:05.973316 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:05.973284 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:06.079090 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:06.079052 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:11.613836 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:11.613798 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:11.711701 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:11.711670 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:19.761200 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:19.761156 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:19.859805 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:19.859768 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:19.959082 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:19.959036 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:20.061125 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:20.061097 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:36.558672 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:36.558634 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:36.677016 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:36.676960 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:36.777718 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:36.777688 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:42.502670 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:42.502634 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:42.605142 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:42.605109 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:21:56.309890 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:56.309805 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cd8c57d44-76sg7_0eda7592-a78c-4243-8f5d-0cc90871c81a/nginx/0.log" Jun 06 13:21:57.160537 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:57.160507 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-jx9lj_95c713f9-ad61-4bf0-b3a8-c9323aa7133e/copy-manifests/0.log" Jun 06 13:21:57.172626 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:57.172604 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-jx9lj_95c713f9-ad61-4bf0-b3a8-c9323aa7133e/manager/0.log" Jun 06 13:21:58.844041 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:58.844010 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6dmww_341bf209-290b-478a-a104-bf5b5d36ea04/manager/0.log" Jun 06 13:21:59.194015 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:59.193878 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wb48q_1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61/registry-server/0.log" Jun 06 13:21:59.306972 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:59.306941 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n6rkp_ec4f298e-f0f1-4288-91ec-44a5d45865ee/manager/0.log" Jun 06 13:21:59.886495 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:21:59.886448 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t5dzj_3c3d3bea-08d6-4963-97e8-f11cce75f297/istio-proxy/0.log" Jun 06 13:22:00.352678 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:00.352650 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/1.log" Jun 06 13:22:00.576938 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:00.576907 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ksglh_0d3faaa7-475e-4c18-ba93-496571fe78e5/payload-processing/0.log" Jun 06 13:22:01.041523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:01.041495 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn_246bb572-5329-42f9-aab5-8795ba998a62/storage-initializer/0.log" Jun 06 13:22:01.048627 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:01.048605 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2cztn_246bb572-5329-42f9-aab5-8795ba998a62/main/0.log" Jun 06 13:22:01.286215 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:01.286182 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws_bbbdac33-4552-4df9-afa2-896a51a1c667/storage-initializer/0.log" Jun 06 13:22:01.292629 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:01.292563 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pfsws_bbbdac33-4552-4df9-afa2-896a51a1c667/main/0.log" Jun 06 13:22:06.343862 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:06.343817 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:22:06.397331 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:06.397297 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" limit=1024 Jun 06 13:22:09.173716 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:09.173670 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9lb5w_f4fce606-ff59-486c-aa72-d0b19bfa48b1/global-pull-secret-syncer/0.log" Jun 06 13:22:09.290269 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:09.290221 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n7m48_ace926ca-223f-40fa-b0c8-eb86c9118d76/konnectivity-agent/0.log" Jun 06 13:22:09.378335 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:09.378312 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-83.ec2.internal_bf10e953d29a0f873f55d3801011922b/haproxy/0.log" Jun 06 13:22:14.353176 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:14.353148 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6dmww_341bf209-290b-478a-a104-bf5b5d36ea04/manager/0.log" Jun 06 13:22:14.437637 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:14.437605 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wb48q_1ca7307a-ab9c-4d7b-a537-ee8ab60bfa61/registry-server/0.log" Jun 06 13:22:14.477777 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:14.477725 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n6rkp_ec4f298e-f0f1-4288-91ec-44a5d45865ee/manager/0.log" Jun 06 13:22:16.406040 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.406009 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-dcn7s_a19efd4e-8f57-4585-ba4e-a1b8f8d88331/cluster-monitoring-operator/0.log" Jun 06 13:22:16.556465 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.556374 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-tdlsr_e32c53a0-afe8-4893-bfee-94f1a679579b/monitoring-plugin/0.log" Jun 06 13:22:16.737761 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.737733 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/node-exporter/0.log" Jun 06 13:22:16.756609 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.756584 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/kube-rbac-proxy/0.log" Jun 06 13:22:16.777744 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.777703 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlqlz_9e844808-bca2-4cb4-b7a5-f49f03348354/init-textfile/0.log" Jun 06 13:22:16.894717 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.894688 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/prometheus/0.log" Jun 06 13:22:16.917150 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.917109 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/config-reloader/0.log" Jun 06 13:22:16.936815 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.936790 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/thanos-sidecar/0.log" Jun 06 13:22:16.959535 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.959512 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/kube-rbac-proxy-web/0.log" Jun 06 13:22:16.983904 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:16.983883 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/kube-rbac-proxy/0.log" Jun 06 13:22:17.006565 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.006544 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/kube-rbac-proxy-thanos/0.log" Jun 06 13:22:17.028035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.028012 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9193330a-d0f7-4e7b-b58c-1eaf68edd58a/init-config-reloader/0.log" Jun 06 13:22:17.053962 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.053940 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpdgl_d809561d-2496-45fc-8f33-21c5a8de3a9c/prometheus-operator/0.log" Jun 06 13:22:17.073907 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.073885 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpdgl_d809561d-2496-45fc-8f33-21c5a8de3a9c/kube-rbac-proxy/0.log" Jun 06 13:22:17.097109 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.097076 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-v6zlh_93e7747a-5252-4b51-9e5e-9b73bbf7b08a/prometheus-operator-admission-webhook/0.log" Jun 06 13:22:17.223600 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.223513 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/thanos-query/0.log" Jun 06 13:22:17.246630 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.246597 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-web/0.log" Jun 06 13:22:17.269299 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.269270 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy/0.log" Jun 06 13:22:17.288948 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.288922 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/prom-label-proxy/0.log" Jun 06 13:22:17.311174 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.311145 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-rules/0.log" Jun 06 13:22:17.330472 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:17.330424 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bfd5bc44-xkkvr_9c5d0f07-f0df-4a0c-8ced-d2ab08f825c8/kube-rbac-proxy-metrics/0.log" Jun 06 13:22:19.614527 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.614493 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb"] Jun 06 13:22:19.614932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.614910 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" containerName="manager" Jun 06 13:22:19.614932 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.614924 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" containerName="manager" Jun 06 13:22:19.615043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.614941 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" containerName="cleanup" Jun 06 13:22:19.615043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.614947 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" containerName="cleanup" Jun 06 13:22:19.615043 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.615041 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea59fdd-bfd8-409c-b139-e8bd34d2401c" containerName="cleanup" Jun 06 13:22:19.615164 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.615051 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffbf433-c03e-46a8-9e3b-69b435d0915a" containerName="manager" Jun 06 13:22:19.617815 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.617800 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.620022 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.619999 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m7bjs\"/\"default-dockercfg-7sktr\"" Jun 06 13:22:19.620022 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.620018 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m7bjs\"/\"kube-root-ca.crt\"" Jun 06 13:22:19.620855 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.620839 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m7bjs\"/\"openshift-service-ca.crt\"" Jun 06 13:22:19.624360 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.624338 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb"] Jun 06 13:22:19.727436 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.727385 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b79b557f5-c99gp_3f548412-8de4-4dc7-8d34-e189f687bc5a/console/0.log" Jun 06 13:22:19.754911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.754883 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-podres\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.754911 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.754915 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-lib-modules\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.755126 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.754943 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jms2\" (UniqueName: \"kubernetes.io/projected/78c15dce-074e-46a8-9f17-e4d99330c9f3-kube-api-access-9jms2\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.755126 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.755047 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-proc\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.755126 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.755097 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-sys\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.773632 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.773604 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-wqrx6_5beb5589-a262-4f57-aaa3-f681ef7801f6/download-server/0.log" Jun 06 13:22:19.855687 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855654 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-podres\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.855866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855695 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-lib-modules\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.855866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855736 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jms2\" (UniqueName: \"kubernetes.io/projected/78c15dce-074e-46a8-9f17-e4d99330c9f3-kube-api-access-9jms2\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.855866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-proc\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.855866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855830 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-podres\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.855866 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855830 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-sys\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.856119 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855870 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-sys\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.856119 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855900 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-lib-modules\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.856119 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.855909 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78c15dce-074e-46a8-9f17-e4d99330c9f3-proc\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.863395 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.863368 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jms2\" (UniqueName: \"kubernetes.io/projected/78c15dce-074e-46a8-9f17-e4d99330c9f3-kube-api-access-9jms2\") pod \"perf-node-gather-daemonset-wd6lb\" (UID: \"78c15dce-074e-46a8-9f17-e4d99330c9f3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:19.928630 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:19.928553 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:20.063298 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:20.063271 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb"] Jun 06 13:22:20.065431 ip-10-0-131-83 kubenswrapper[2550]: W0606 13:22:20.065406 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78c15dce_074e_46a8_9f17_e4d99330c9f3.slice/crio-6098372ac7e14722fdd21f592dbf81379cb1d6f5f3e3d411f87c929a6083ff15 WatchSource:0}: Error finding container 6098372ac7e14722fdd21f592dbf81379cb1d6f5f3e3d411f87c929a6083ff15: Status 404 returned error can't find the container with id 6098372ac7e14722fdd21f592dbf81379cb1d6f5f3e3d411f87c929a6083ff15 Jun 06 13:22:20.854574 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:20.854539 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" event={"ID":"78c15dce-074e-46a8-9f17-e4d99330c9f3","Type":"ContainerStarted","Data":"7715bc9dca90081bfa99dc2d6e3b8a030894ed7305c991e59b432fd0050ff13c"} Jun 06 13:22:20.855007 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:20.854627 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:20.855007 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:20.854645 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" event={"ID":"78c15dce-074e-46a8-9f17-e4d99330c9f3","Type":"ContainerStarted","Data":"6098372ac7e14722fdd21f592dbf81379cb1d6f5f3e3d411f87c929a6083ff15"} Jun 06 13:22:20.870846 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:20.870798 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" podStartSLOduration=1.8707849909999998 podStartE2EDuration="1.870784991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:22:20.868220732 +0000 UTC m=+1279.728303141" watchObservedRunningTime="2026-06-06 13:22:20.870784991 +0000 UTC m=+1279.730867451" Jun 06 13:22:21.600648 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:21.600621 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bstc6_b6c058b0-a11a-450b-997e-78810d873a47/dns/0.log" Jun 06 13:22:21.619749 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:21.619725 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bstc6_b6c058b0-a11a-450b-997e-78810d873a47/kube-rbac-proxy/0.log" Jun 06 13:22:21.745771 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:21.745739 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kn46z_812616d7-e431-4994-9d41-36a329a8aa27/dns-node-resolver/0.log" Jun 06 13:22:22.343467 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:22.343440 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxqt8_04ab0a67-e8b2-4b52-a2ad-89af7fbd9185/node-ca/0.log" Jun 06 13:22:23.241268 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:23.241237 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t5dzj_3c3d3bea-08d6-4963-97e8-f11cce75f297/istio-proxy/0.log" Jun 06 13:22:23.385882 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:23.385849 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/0.log" Jun 06 13:22:23.393274 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:23.393247 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/1.log" Jun 06 13:22:23.459604 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:23.459565 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ksglh_0d3faaa7-475e-4c18-ba93-496571fe78e5/payload-processing/0.log" Jun 06 13:22:24.040709 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.040683 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56skw_5b934b99-dced-4990-a1bf-2f906fe62350/serve-healthcheck-canary/0.log" Jun 06 13:22:24.571238 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.571207 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wlpwq_ad949d75-ea87-4266-a0db-3b853235aedf/insights-operator/0.log" Jun 06 13:22:24.573126 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.573108 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wlpwq_ad949d75-ea87-4266-a0db-3b853235aedf/insights-operator/1.log" Jun 06 13:22:24.593409 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.593389 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2gfb_ba87e7d4-86ce-4caa-b40c-8b9d9372d73d/kube-rbac-proxy/0.log" Jun 06 13:22:24.618949 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.618924 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2gfb_ba87e7d4-86ce-4caa-b40c-8b9d9372d73d/exporter/0.log" Jun 06 13:22:24.639160 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:24.639132 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2gfb_ba87e7d4-86ce-4caa-b40c-8b9d9372d73d/extractor/0.log" Jun 06 13:22:26.869610 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:26.869575 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-wd6lb" Jun 06 13:22:26.951726 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:26.951696 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cd8c57d44-76sg7_0eda7592-a78c-4243-8f5d-0cc90871c81a/nginx/0.log" Jun 06 13:22:27.232035 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:27.231941 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-jx9lj_95c713f9-ad61-4bf0-b3a8-c9323aa7133e/manager/0.log" Jun 06 13:22:27.248743 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:27.248722 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-jx9lj_95c713f9-ad61-4bf0-b3a8-c9323aa7133e/copy-manifests/0.log" Jun 06 13:22:28.967168 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:28.967143 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5498bc6445-snc67_0646e337-30c6-4140-a2fb-83834484b13c/manager/0.log" Jun 06 13:22:28.991503 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:28.991472 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rnt9f_af1ee094-d47a-4ea9-9f11-30b600f46928/openshift-lws-operator/0.log" Jun 06 13:22:33.397803 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:33.397772 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t5dzj_3c3d3bea-08d6-4963-97e8-f11cce75f297/istio-proxy/0.log" Jun 06 13:22:33.514910 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:33.514877 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/0.log" Jun 06 13:22:33.522850 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:33.522827 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/1.log" Jun 06 13:22:33.574663 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:33.574616 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ksglh_0d3faaa7-475e-4c18-ba93-496571fe78e5/payload-processing/0.log" Jun 06 13:22:34.360471 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.360439 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7d55w_6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb/kube-storage-version-migrator-operator/1.log" Jun 06 13:22:34.361641 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.361624 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7d55w_6a230fb2-9d92-4f8d-bf56-a9ac5a4338cb/kube-storage-version-migrator-operator/0.log" Jun 06 13:22:34.613447 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.613359 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t5dzj_3c3d3bea-08d6-4963-97e8-f11cce75f297/istio-proxy/0.log" Jun 06 13:22:34.725892 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.725859 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/0.log" Jun 06 13:22:34.733025 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.732999 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/1.log" Jun 06 13:22:34.783578 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:34.783554 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ksglh_0d3faaa7-475e-4c18-ba93-496571fe78e5/payload-processing/0.log" Jun 06 13:22:35.557578 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.557552 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/kube-multus-additional-cni-plugins/0.log" Jun 06 13:22:35.577945 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.577918 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/egress-router-binary-copy/0.log" Jun 06 13:22:35.598612 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.598582 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/cni-plugins/0.log" Jun 06 13:22:35.617524 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.617498 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/bond-cni-plugin/0.log" Jun 06 13:22:35.638523 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.638506 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/routeoverride-cni/0.log" Jun 06 13:22:35.657223 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.657199 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/whereabouts-cni-bincopy/0.log" Jun 06 13:22:35.676132 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.676107 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkk7d_ab5b8420-d2a4-449b-ae91-72a21e6eec29/whereabouts-cni/0.log" Jun 06 13:22:35.854305 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.854270 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s8b82_6e4f884b-e9c1-48cf-9567-31550adbb472/kube-multus/0.log" Jun 06 13:22:35.935584 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.935557 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2l27h_c0adce35-ec50-4eba-89ba-88fde6e1ea16/network-metrics-daemon/0.log" Jun 06 13:22:35.953760 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:35.953738 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2l27h_c0adce35-ec50-4eba-89ba-88fde6e1ea16/kube-rbac-proxy/0.log" Jun 06 13:22:36.299377 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:36.299300 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795t5dzj_3c3d3bea-08d6-4963-97e8-f11cce75f297/istio-proxy/0.log" Jun 06 13:22:36.406790 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:36.406753 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/0.log" Jun 06 13:22:36.413710 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:36.413687 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6jfh_212c1294-ed5f-4d51-b0db-d4aa773510e9/istio-proxy/1.log" Jun 06 13:22:36.459614 ip-10-0-131-83 kubenswrapper[2550]: I0606 13:22:36.459589 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-ksglh_0d3faaa7-475e-4c18-ba93-496571fe78e5/payload-processing/0.log"