Jun 15 08:15:50.412715 ip-10-0-134-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 08:15:50.412727 ip-10-0-134-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 08:15:50.412734 ip-10-0-134-160 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 08:15:50.412983 ip-10-0-134-160 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 08:16:00.540281 ip-10-0-134-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 08:16:00.540297 ip-10-0-134-160 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 55e62148d85d4e1f98998f7835b70171 -- Jun 15 08:18:34.611148 ip-10-0-134-160 systemd[1]: Starting Kubernetes Kubelet... Jun 15 08:18:35.034459 ip-10-0-134-160 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:35.034459 ip-10-0-134-160 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 08:18:35.034459 ip-10-0-134-160 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:35.034459 ip-10-0-134-160 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 08:18:35.034459 ip-10-0-134-160 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:35.036166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.036081 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 08:18:35.040674 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040658 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.040674 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040673 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040677 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040680 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040683 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040686 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040689 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040691 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040694 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040697 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040701 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040704 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040707 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040709 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040713 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040716 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040719 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040722 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040724 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040727 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040730 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.040740 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040732 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040737 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040742 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040745 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040748 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040752 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040755 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040758 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040760 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040763 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040766 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040769 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040771 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040775 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040777 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040780 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040783 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040786 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040789 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.041241 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040791 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040794 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040796 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040799 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040801 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040804 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040806 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040809 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040811 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040815 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040817 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040821 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040825 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040828 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040831 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040834 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040837 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040840 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040842 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.041698 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040845 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040848 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040851 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040853 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040856 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040858 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040875 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040878 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040881 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040884 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040886 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040889 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040891 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040894 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040896 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040899 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040901 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040904 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040907 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.042176 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040909 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040913 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040915 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040918 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040920 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040923 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040925 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040929 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040932 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040935 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040938 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040941 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040944 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040947 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040950 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040953 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040955 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040958 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040960 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.042637 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040963 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.040967 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042687 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042695 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042699 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042702 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042705 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042709 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042712 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042715 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042717 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042720 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042723 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042727 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042730 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042733 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042735 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042738 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.043111 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042740 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042743 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042745 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042748 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042753 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042757 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042760 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042763 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042766 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042768 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042771 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042774 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042777 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042781 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042784 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042786 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042789 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042792 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042795 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.043595 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042797 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042801 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042807 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042809 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042812 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042815 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042817 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042820 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042822 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042825 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042827 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042830 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042832 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042835 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042837 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042840 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042843 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042846 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042849 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042851 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.044081 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042854 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042857 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042860 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042876 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042879 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042882 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042885 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042888 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042891 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042894 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042896 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042899 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042901 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042904 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042906 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042909 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042912 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042916 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042919 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042922 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.044566 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042925 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042928 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042931 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042934 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042937 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042939 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042943 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042947 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042950 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042953 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042956 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042959 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042962 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042964 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042967 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042969 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042972 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042974 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042977 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042980 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.045092 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042982 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042985 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.042988 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043371 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043376 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043379 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043382 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043385 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043388 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043391 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043393 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043396 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043399 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043401 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043404 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043407 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043410 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043412 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043415 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043417 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.045579 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043420 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043422 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043425 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043428 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043431 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043433 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043436 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043438 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043443 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043446 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043450 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043453 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043456 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043458 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043461 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043463 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043466 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043468 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043471 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.046192 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043473 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043476 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043479 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043481 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043484 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043486 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043489 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043491 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043494 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043497 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043501 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043503 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043505 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043508 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043511 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043514 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043517 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043520 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043522 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.046697 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043525 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043527 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043530 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043532 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043535 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043538 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043540 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043544 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043547 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043551 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043553 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043556 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043558 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043561 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043564 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043567 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043573 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043576 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043579 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043581 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.047178 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043584 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043586 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043589 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043592 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043594 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043597 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043600 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043603 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043605 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043608 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043610 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043613 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043615 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043618 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043621 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043623 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043626 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043629 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043632 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043634 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.047711 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043637 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043639 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043642 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.043644 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043713 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043720 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043734 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043739 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043755 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043759 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043763 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043767 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043771 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043774 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043777 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043780 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043783 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043786 2564 flags.go:64] FLAG: --cgroup-root="" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043789 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043792 2564 flags.go:64] FLAG: --client-ca-file="" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043795 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043797 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043804 2564 flags.go:64] FLAG: --cluster-domain="" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043806 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 08:18:35.048213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043809 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043812 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043816 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043819 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043824 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043827 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043830 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043834 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043837 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043840 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043843 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043846 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043850 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043853 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043856 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043858 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043876 2564 flags.go:64] FLAG: --enable-server="true" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043886 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043893 2564 flags.go:64] FLAG: --event-burst="100" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043896 2564 flags.go:64] FLAG: --event-qps="50" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043899 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043902 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043906 2564 flags.go:64] FLAG: --eviction-hard="" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043910 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 08:18:35.048779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043912 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043915 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043918 2564 flags.go:64] FLAG: --eviction-soft="" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043921 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043924 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043927 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043930 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043933 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043936 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043939 2564 flags.go:64] FLAG: --feature-gates="" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043942 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043945 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043953 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043957 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043960 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043963 2564 flags.go:64] FLAG: --help="false" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043966 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043969 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043972 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043975 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043978 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043981 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043984 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 08:18:35.049356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043987 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043990 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.043992 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044001 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044004 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044007 2564 flags.go:64] FLAG: --kube-reserved="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044009 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044012 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044015 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044018 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044021 2564 flags.go:64] FLAG: --lock-file="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044024 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044027 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044030 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044039 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044042 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044045 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044047 2564 flags.go:64] FLAG: --logging-format="text" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044050 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044053 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044056 2564 flags.go:64] FLAG: --manifest-url="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044061 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044066 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044069 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044073 2564 flags.go:64] FLAG: --max-pods="110" Jun 15 08:18:35.049944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044076 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044079 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044082 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044085 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044088 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044091 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044094 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044101 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044104 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044107 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044110 2564 flags.go:64] FLAG: --pod-cidr="" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044114 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044119 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044122 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044125 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044128 2564 flags.go:64] FLAG: --port="10250" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044131 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044134 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ffd0de9a22cab4b8" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044137 2564 flags.go:64] FLAG: --qos-reserved="" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044140 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044142 2564 flags.go:64] FLAG: --register-node="true" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044145 2564 flags.go:64] FLAG: --register-with-taints="" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044149 2564 flags.go:64] FLAG: --registry-burst="10" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044151 2564 flags.go:64] FLAG: --registry-qps="5" Jun 15 08:18:35.050556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044154 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044157 2564 flags.go:64] FLAG: --reserved-memory="" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044161 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044164 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044168 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044171 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044175 2564 flags.go:64] FLAG: --runonce="false" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044178 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044181 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044184 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044187 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044190 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044193 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044196 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044199 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044202 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044205 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044208 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044211 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044215 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044218 2564 flags.go:64] FLAG: --system-cgroups="" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044221 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044226 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044229 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044232 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 08:18:35.051204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044238 2564 flags.go:64] FLAG: --tls-min-version="" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044241 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044244 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044247 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044250 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044253 2564 flags.go:64] FLAG: --v="2" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044256 2564 flags.go:64] FLAG: --version="false" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044260 2564 flags.go:64] FLAG: --vmodule="" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044264 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.044267 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044382 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044387 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044391 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044395 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044398 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044400 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044403 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044405 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044408 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044411 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044413 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044416 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.051817 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044418 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044421 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044424 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044427 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044429 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044432 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044435 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044437 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044440 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044442 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044445 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044447 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044450 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044452 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044454 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044457 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044459 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044462 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044465 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044467 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.052443 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044469 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044473 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044477 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044482 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044486 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044490 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044493 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044495 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044501 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044504 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044507 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044510 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044513 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044516 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044519 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044523 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044526 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044529 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.052948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044533 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044535 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044538 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044541 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044544 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044546 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044549 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044552 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044555 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044557 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044560 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044563 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044565 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044568 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044572 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044575 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044580 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044585 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044589 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044593 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.053416 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044597 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044631 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044639 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044643 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044646 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044650 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044653 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044658 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044661 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044664 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044667 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044670 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044673 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044676 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044679 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044682 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044687 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044692 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044695 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.053912 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044698 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044701 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044704 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044707 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044710 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044712 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044716 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044719 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.044722 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.045276 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.051714 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.051729 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.051748 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.051757 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051815 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.054383 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051821 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051825 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051828 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051831 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051834 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051837 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051839 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051842 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051845 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051847 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051850 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051853 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051856 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051859 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051888 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051891 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051894 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051897 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051900 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051903 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.054753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051906 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051909 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051912 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051915 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051917 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051920 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051922 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051925 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051928 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051931 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051934 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051937 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051940 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051943 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051945 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051948 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051951 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051953 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051956 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051958 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.055262 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051960 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051963 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051965 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051968 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051970 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051973 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051975 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051978 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051980 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051983 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051986 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051988 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051991 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051993 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.051997 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052001 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052004 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052007 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052010 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052013 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.055736 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052017 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052019 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052022 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052026 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052030 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052033 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052036 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052039 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052042 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052044 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052047 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052049 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052052 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052055 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052058 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052060 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052063 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052065 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052068 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.056298 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052070 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052073 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052075 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052078 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052080 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052083 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052085 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052088 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052090 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052093 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052095 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052098 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052100 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052104 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052108 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052111 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052114 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052117 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.056767 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052120 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.052125 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052239 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052244 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052247 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052249 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052253 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052256 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052259 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052261 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052264 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052266 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052269 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052271 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:35.057261 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052274 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052276 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052279 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052281 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052284 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052286 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052289 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052292 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052294 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052297 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052299 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052302 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052304 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052307 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052310 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052313 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052315 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052318 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052320 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052323 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:35.057611 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052326 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052329 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052332 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052334 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052337 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052339 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052342 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052344 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052347 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052349 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052352 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052354 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052357 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052359 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052362 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052366 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052369 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052372 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052375 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:35.058101 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052377 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052380 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052382 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052385 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052388 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052390 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052393 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052396 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052398 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052400 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052403 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052405 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052408 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052411 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052414 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052417 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052419 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052422 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052424 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052427 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:35.058563 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052430 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052433 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052436 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052439 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052441 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052444 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052447 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052450 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052453 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052455 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052458 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052460 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052463 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052465 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052467 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052470 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052472 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052475 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052477 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052480 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:35.059067 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052483 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052486 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052488 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052491 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052493 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052495 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052498 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:35.052501 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.052506 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.052608 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.054540 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.056279 2564 server.go:1019] "Starting client certificate rotation" Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.056382 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.056413 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 08:18:35.059556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.058656 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 08:18:35.062770 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.062742 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 08:18:35.075973 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.075955 2564 log.go:25] "Validated CRI v1 runtime API" Jun 15 08:18:35.078875 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.078850 2564 log.go:25] "Validated CRI v1 image API" Jun 15 08:18:35.080387 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.080371 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 08:18:35.082810 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.082787 2564 fs.go:135] Filesystem UUIDs: map[0f251665-8f13-4edf-8720-91a054bec1bd:/dev/nvme0n1p4 56145786-083b-485c-a520-8839fc48c46d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 15 08:18:35.082894 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.082808 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 08:18:35.085930 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.085912 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 08:18:35.087830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.087718 2564 manager.go:216] Machine: {Timestamp:2026-06-15 08:18:35.086517635 +0000 UTC m=+0.352137617 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098683 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dc17c20465e7821a37db0602fb9a0 SystemUUID:ec2dc17c-2046-5e78-21a3-7db0602fb9a0 BootID:55e62148-d85d-4e1f-9899-8f7835b70171 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:bd:06:5f:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:bd:06:5f:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:d5:86:9d:09:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 08:18:35.087830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.087825 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 08:18:35.088004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.087913 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 08:18:35.091219 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.091184 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 08:18:35.091359 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.091223 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 08:18:35.091909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.091900 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 08:18:35.091947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.091913 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 08:18:35.091947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.091920 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 08:18:35.092690 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.092680 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 08:18:35.094180 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.094170 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 08:18:35.097945 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.097933 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 15 08:18:35.098058 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098049 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 08:18:35.098095 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098078 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 15 08:18:35.098095 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098088 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 08:18:35.098168 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098102 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 08:18:35.098168 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098112 2564 kubelet.go:398] "Adding apiserver pod source" Jun 15 08:18:35.098168 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098120 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 08:18:35.098466 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098455 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 08:18:35.098503 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.098474 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 08:18:35.100610 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.100595 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 08:18:35.102126 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102113 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 08:18:35.102172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102143 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 08:18:35.102296 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102285 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 08:18:35.102336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102305 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 08:18:35.102336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102315 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 08:18:35.102336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102323 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 08:18:35.102336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102334 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 08:18:35.102441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.102342 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.103934 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104044 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104058 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104069 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104082 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104098 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 08:18:35.104117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104101 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5v47" Jun 15 08:18:35.104998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104978 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 08:18:35.104998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.104998 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 08:18:35.108488 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.108470 2564 server.go:1268] "Started kubelet" Jun 15 08:18:35.108583 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.108534 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 08:18:35.108650 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.108595 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 08:18:35.108704 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.108669 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 08:18:35.109146 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.109123 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 08:18:35.109252 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.109160 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 08:18:35.109252 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.109197 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 08:18:35.109475 ip-10-0-134-160 systemd[1]: Started Kubernetes Kubelet. Jun 15 08:18:35.110552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.110440 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 08:18:35.111007 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.110994 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 15 08:18:35.111431 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.111416 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5v47" Jun 15 08:18:35.114121 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.113154 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-160.ec2.internal.18b93348bd4e60f2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-160.ec2.internal,UID:ip-10-0-134-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-160.ec2.internal,},FirstTimestamp:2026-06-15 08:18:35.108434162 +0000 UTC m=+0.374054123,LastTimestamp:2026-06-15 08:18:35.108434162 +0000 UTC m=+0.374054123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-160.ec2.internal,}" Jun 15 08:18:35.115424 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.115404 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 08:18:35.115424 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.115415 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 08:18:35.115566 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.115498 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.116109 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116084 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 08:18:35.116189 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116130 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 08:18:35.116189 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116144 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 08:18:35.116189 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116147 2564 factory.go:55] Registering systemd factory Jun 15 08:18:35.116189 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116161 2564 factory.go:223] Registration of the systemd container factory successfully Jun 15 08:18:35.116372 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.116212 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 08:18:35.116372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116224 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 15 08:18:35.116372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116233 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 15 08:18:35.116372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116366 2564 factory.go:153] Registering CRI-O factory Jun 15 08:18:35.116538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116377 2564 factory.go:223] Registration of the crio container factory successfully Jun 15 08:18:35.116538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116463 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 08:18:35.116538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116496 2564 factory.go:103] Registering Raw factory Jun 15 08:18:35.116538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116510 2564 manager.go:1196] Started watching for new ooms in manager Jun 15 08:18:35.116929 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.116912 2564 manager.go:349] Starting recovery of all containers Jun 15 08:18:35.127577 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.127419 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:35.127907 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.127892 2564 manager.go:354] Recovery completed Jun 15 08:18:35.129891 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.129850 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-160.ec2.internal\" not found" node="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.133119 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.133104 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.134838 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.134821 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.134943 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.134849 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.134943 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.134859 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.135366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.135349 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 08:18:35.135366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.135364 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 08:18:35.135473 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.135370 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.135473 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.135381 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 15 08:18:35.136175 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.136162 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.136216 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.136187 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.136216 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.136197 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.137372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.137360 2564 policy_none.go:49] "None policy: Start" Jun 15 08:18:35.137411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.137375 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 08:18:35.137411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.137386 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 08:18:35.139181 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.139171 2564 policy_none.go:47] "Start" Jun 15 08:18:35.173527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.173510 2564 manager.go:337] "Starting Device Plugin manager" Jun 15 08:18:35.173626 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.173548 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 08:18:35.173626 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.173561 2564 server.go:87] "Starting device plugin registration server" Jun 15 08:18:35.173809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.173795 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 08:18:35.173880 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.173810 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 08:18:35.173984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.173966 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 08:18:35.174061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.174049 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 08:18:35.174130 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.174062 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 08:18:35.174751 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.174731 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 08:18:35.174809 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.174785 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.191960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.191932 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 08:18:35.206390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.193069 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 08:18:35.206390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.193113 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 08:18:35.206390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.193138 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 08:18:35.206390 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.193174 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 08:18:35.206390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.195258 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:35.274450 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.274418 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.275459 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.275440 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.275561 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.275475 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.275561 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.275484 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.275561 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.275508 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.284279 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.284264 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.284325 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.284289 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-160.ec2.internal\": node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.293308 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.293256 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal"] Jun 15 08:18:35.293382 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.293318 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.294271 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.294257 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.294380 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.294284 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.294380 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.294297 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.296517 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.296505 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.296631 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.296616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.296662 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.296647 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.297216 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297199 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.297301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297230 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.297301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297204 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.297301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297240 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.297301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297265 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.297301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.297277 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.299350 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.299334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.299435 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.299361 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:35.300068 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.300055 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:35.300125 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.300080 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:35.300125 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.300089 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:35.301504 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.301489 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.317579 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.317561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.317666 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.317595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.317666 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.317610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb99caa2341a0560c862ba7933daeb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-160.ec2.internal\" (UID: \"5fb99caa2341a0560c862ba7933daeb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.328520 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.328498 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-160.ec2.internal\" not found" node="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.332843 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.332830 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-160.ec2.internal\" not found" node="ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.402224 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.402193 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.417988 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.417969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.418074 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.417995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.418074 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.418018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb99caa2341a0560c862ba7933daeb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-160.ec2.internal\" (UID: \"5fb99caa2341a0560c862ba7933daeb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.418074 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.418060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb99caa2341a0560c862ba7933daeb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-160.ec2.internal\" (UID: \"5fb99caa2341a0560c862ba7933daeb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.418179 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.418084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.418179 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.418102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51d3242e3ab3d512ffb1c8c48c9fa0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal\" (UID: \"c51d3242e3ab3d512ffb1c8c48c9fa0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.502703 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.502651 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.603586 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.603514 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.631012 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.630985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.636975 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:35.636957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:35.704412 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.704377 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.804909 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.804859 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:35.905468 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:35.905387 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:36.006021 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:36.005986 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:36.055587 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.055547 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 08:18:36.056194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.055739 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 08:18:36.056194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.055752 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 08:18:36.082973 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.082946 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:36.107015 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:36.106984 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:36.116837 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.116803 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 08:13:35 +0000 UTC" deadline="2028-01-15 13:05:37.404536215 +0000 UTC" Jun 15 08:18:36.116940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.116840 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13900h47m1.287701141s" Jun 15 08:18:36.168040 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:36.168011 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51d3242e3ab3d512ffb1c8c48c9fa0d.slice/crio-fb12608620d6116a7eb2b7c7b4b8f2dfafebbb88d1829564185b6ede42ea795e WatchSource:0}: Error finding container fb12608620d6116a7eb2b7c7b4b8f2dfafebbb88d1829564185b6ede42ea795e: Status 404 returned error can't find the container with id fb12608620d6116a7eb2b7c7b4b8f2dfafebbb88d1829564185b6ede42ea795e Jun 15 08:18:36.168422 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:36.168407 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb99caa2341a0560c862ba7933daeb2.slice/crio-f6932c60358a78d0240e1f36dfc88eff46bdf20a55d4ae5abe48903684460bd1 WatchSource:0}: Error finding container f6932c60358a78d0240e1f36dfc88eff46bdf20a55d4ae5abe48903684460bd1: Status 404 returned error can't find the container with id f6932c60358a78d0240e1f36dfc88eff46bdf20a55d4ae5abe48903684460bd1 Jun 15 08:18:36.174480 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.174464 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:18:36.196114 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.196064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" event={"ID":"5fb99caa2341a0560c862ba7933daeb2","Type":"ContainerStarted","Data":"f6932c60358a78d0240e1f36dfc88eff46bdf20a55d4ae5abe48903684460bd1"} Jun 15 08:18:36.197097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.197078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" event={"ID":"c51d3242e3ab3d512ffb1c8c48c9fa0d","Type":"ContainerStarted","Data":"fb12608620d6116a7eb2b7c7b4b8f2dfafebbb88d1829564185b6ede42ea795e"} Jun 15 08:18:36.207248 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:36.207225 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-160.ec2.internal\" not found" Jun 15 08:18:36.217622 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.217604 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:36.315734 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.315708 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" Jun 15 08:18:36.327145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.327126 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 08:18:36.328132 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.328119 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" Jun 15 08:18:36.336940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.336917 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 08:18:36.935384 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:36.935346 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:37.099919 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.099892 2564 apiserver.go:52] "Watching apiserver" Jun 15 08:18:37.105947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.105919 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 08:18:37.108593 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.108564 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-cqbv7","openshift-multus/multus-additional-cni-plugins-r9vq2","openshift-multus/network-metrics-daemon-82dnt","openshift-network-diagnostics/network-check-target-8vwkk","openshift-network-operator/iptables-alerter-sbq4p","openshift-ovn-kubernetes/ovnkube-node-7827g","kube-system/global-pull-secret-syncer-rvs4s","kube-system/konnectivity-agent-4zdpm","kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59","openshift-cluster-node-tuning-operator/tuned-mczq2","openshift-dns/node-resolver-fqdtl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal","openshift-multus/multus-f99qb"] Jun 15 08:18:37.111166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.111144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.111294 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.111240 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:37.113262 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.113236 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.115715 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.115376 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.115715 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.115693 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.115951 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.115925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r22r6\"" Jun 15 08:18:37.116463 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.116442 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 08:18:37.116688 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.116664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.116802 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.116748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:37.117762 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.117735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:37.117891 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.117846 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:37.120087 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.120062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.122783 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.122502 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.124170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.124148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.124263 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.124200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 08:18:37.124588 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.124315 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.124588 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.124402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zxvxt\"" Jun 15 08:18:37.124856 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.124837 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.125198 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125183 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.125241 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125195 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 08:18:37.125464 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125451 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 08:18:37.125747 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pgkj7\"" Jun 15 08:18:37.125830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125731 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 08:18:37.125830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125821 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.125953 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.125731 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 08:18:37.127032 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.127015 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.127732 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.127697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.128436 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128415 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 08:18:37.128613 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-conf\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.128711 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-systemd\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.128711 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-sys\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.128711 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-host\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.128711 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128696 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zp6dt\"" Jun 15 08:18:37.128960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.128747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbw72\" (UniqueName: \"kubernetes.io/projected/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-kube-api-access-jbw72\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-tuned\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdk6\" (UniqueName: \"kubernetes.io/projected/fa0a4420-accc-4ebf-80b1-2440a419320f-kube-api-access-6jdk6\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-run\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-lib-modules\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-var-lib-kubelet\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-tmp\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysconfig\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-kubernetes\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.129967 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.129902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-kubelet-config\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.131615 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.130640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-dbus\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.131615 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.130685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-modprobe-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.131615 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.130698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.131615 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.131023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 08:18:37.131960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.131845 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wf6pr\"" Jun 15 08:18:37.133500 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.132118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.133500 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.132151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 08:18:37.133500 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.132309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 08:18:37.133694 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.133662 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 08:18:37.134565 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.134200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.135411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.135385 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 08:18:37.135766 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.135385 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-74nrm\"" Jun 15 08:18:37.135849 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.135803 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 08:18:37.136713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.136419 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.136713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.136473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.136713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.136490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 08:18:37.136713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.136528 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.136713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.136548 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-brnwx\"" Jun 15 08:18:37.138594 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.138567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 08:18:37.139082 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.139063 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l6cwt\"" Jun 15 08:18:37.139179 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.139128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.139179 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.139130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.139388 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.139374 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.141901 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.141754 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 08:18:37.141976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.141772 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 08:18:37.141976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.141966 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f729b\"" Jun 15 08:18:37.156274 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.156252 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tpbzr" Jun 15 08:18:37.165581 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.165559 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tpbzr" Jun 15 08:18:37.217527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.217449 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 08:18:37.231553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-kubelet-config\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.231553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-modprobe-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-host\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-multus-certs\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchw7\" (UniqueName: \"kubernetes.io/projected/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kube-api-access-hchw7\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-kubelet\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-kubelet-config\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231670 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-host\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5273e8f5-cc36-4d0f-b3aa-703c939dd650-hosts-file\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-modprobe-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-lib-modules\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.231809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-cnibin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-socket-dir-parent\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-config\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-lib-modules\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.231989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-device-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-multus\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-sys\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbw72\" (UniqueName: \"kubernetes.io/projected/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-kube-api-access-jbw72\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdk6\" (UniqueName: \"kubernetes.io/projected/fa0a4420-accc-4ebf-80b1-2440a419320f-kube-api-access-6jdk6\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.232233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-systemd-units\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-sys\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-var-lib-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-kubelet\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-netd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-env-overrides\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-etc-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.232536 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.232610 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:18:37.732580362 +0000 UTC m=+2.998200313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-daemon-config\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5273e8f5-cc36-4d0f-b3aa-703c939dd650-tmp-dir\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.232656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-run\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-systemd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-ovn\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-node-log\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-run\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-etc-kubernetes\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-netns\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxj6n\" (UniqueName: \"kubernetes.io/projected/5830691a-6638-49a1-ab61-978776f82fe1-kube-api-access-bxj6n\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-konnectivity-ca\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.232979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-conf\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-bin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-conf-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv685\" (UniqueName: \"kubernetes.io/projected/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-kube-api-access-zv685\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.233264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-tuned\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5830691a-6638-49a1-ab61-978776f82fe1-ovn-node-metrics-cert\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-conf\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-system-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-cni-binary-copy\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-k8s-cni-cncf-io\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-tmp\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-agent-certs\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233590 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-socket-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-log-socket\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-script-lib\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-cnibin\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd2d\" (UniqueName: \"kubernetes.io/projected/5273e8f5-cc36-4d0f-b3aa-703c939dd650-kube-api-access-mcd2d\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.234009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-dbus\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.233908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-systemd\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683c8a7b-1b83-4c75-a141-beced7358e33-host-slash\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5674de82-e968-492d-a50b-e494a202d456-dbus\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-os-release\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-hostroot\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-os-release\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-serviceca\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-systemd\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683c8a7b-1b83-4c75-a141-beced7358e33-iptables-alerter-script\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dp5x\" (UniqueName: \"kubernetes.io/projected/683c8a7b-1b83-4c75-a141-beced7358e33-kube-api-access-5dp5x\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysctl-d\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v892m\" (UniqueName: \"kubernetes.io/projected/d577f33d-6aec-4bad-95aa-1db237caa85b-kube-api-access-v892m\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-registration-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-sys-fs\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.234756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-var-lib-kubelet\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-netns\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-bin\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.234772 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rrn\" (UniqueName: \"kubernetes.io/projected/d74470f1-b459-4c15-8eec-922ea338ea16-kube-api-access-79rrn\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysconfig\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.234835 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:37.734813754 +0000 UTC m=+3.000433701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-sysconfig\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-kubernetes\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-slash\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234931 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-kubernetes\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-host\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.235507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.234988 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-var-lib-kubelet\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.236727 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.236707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-etc-tuned\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.236815 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.236739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-tmp\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.240974 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.240944 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:37.240974 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.240968 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:37.241129 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.240992 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:37.241129 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.241048 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:37.74103353 +0000 UTC m=+3.006653497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:37.243056 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.242999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbw72\" (UniqueName: \"kubernetes.io/projected/411db35f-9980-4f2a-ae4b-512cd5e0b2aa-kube-api-access-jbw72\") pod \"tuned-mczq2\" (UID: \"411db35f-9980-4f2a-ae4b-512cd5e0b2aa\") " pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.243268 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.243237 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdk6\" (UniqueName: \"kubernetes.io/projected/fa0a4420-accc-4ebf-80b1-2440a419320f-kube-api-access-6jdk6\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.270034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.270003 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:37.335417 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.335417 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-bin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-conf-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv685\" (UniqueName: \"kubernetes.io/projected/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-kube-api-access-zv685\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5830691a-6638-49a1-ab61-978776f82fe1-ovn-node-metrics-cert\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-system-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-bin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-cni-binary-copy\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-k8s-cni-cncf-io\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-system-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-agent-certs\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.335659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-socket-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-log-socket\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-script-lib\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335530 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-conf-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-cnibin\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335780 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-cnibin\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd2d\" (UniqueName: \"kubernetes.io/projected/5273e8f5-cc36-4d0f-b3aa-703c939dd650-kube-api-access-mcd2d\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683c8a7b-1b83-4c75-a141-beced7358e33-host-slash\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-os-release\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-hostroot\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-os-release\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-serviceca\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683c8a7b-1b83-4c75-a141-beced7358e33-iptables-alerter-script\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dp5x\" (UniqueName: \"kubernetes.io/projected/683c8a7b-1b83-4c75-a141-beced7358e33-kube-api-access-5dp5x\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683c8a7b-1b83-4c75-a141-beced7358e33-host-slash\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.336253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.335988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v892m\" (UniqueName: \"kubernetes.io/projected/d577f33d-6aec-4bad-95aa-1db237caa85b-kube-api-access-v892m\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-registration-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-sys-fs\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336101 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-os-release\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-hostroot\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-cni-binary-copy\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-netns\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-bin\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79rrn\" (UniqueName: \"kubernetes.io/projected/d74470f1-b459-4c15-8eec-922ea338ea16-kube-api-access-79rrn\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-k8s-cni-cncf-io\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-slash\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-host\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-multus-certs\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchw7\" (UniqueName: \"kubernetes.io/projected/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kube-api-access-hchw7\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.337098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-log-socket\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-kubelet\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-kubelet\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-run-netns\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-bin\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-socket-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5273e8f5-cc36-4d0f-b3aa-703c939dd650-hosts-file\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-os-release\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-cnibin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-socket-dir-parent\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-config\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-device-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-multus\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-systemd-units\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-var-lib-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.337926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-multus-certs\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-host\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-kubelet\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-netd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336802 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-kubelet\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-env-overrides\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-etc-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5273e8f5-cc36-4d0f-b3aa-703c939dd650-hosts-file\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-daemon-config\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-serviceca\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5273e8f5-cc36-4d0f-b3aa-703c939dd650-tmp-dir\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.336985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-cnibin\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-systemd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-script-lib\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-ovn\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-node-log\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.338708 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-etc-kubernetes\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-netns\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxj6n\" (UniqueName: \"kubernetes.io/projected/5830691a-6638-49a1-ab61-978776f82fe1-kube-api-access-bxj6n\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-konnectivity-ca\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-env-overrides\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5830691a-6638-49a1-ab61-978776f82fe1-ovnkube-config\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-etc-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-device-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-sys-fs\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-var-lib-cni-multus\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337618 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683c8a7b-1b83-4c75-a141-beced7358e33-iptables-alerter-script\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337651 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-slash\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.339609 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337687 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-socket-dir-parent\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-systemd-units\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-var-lib-openvswitch\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-cni-dir\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d74470f1-b459-4c15-8eec-922ea338ea16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-host-cni-netd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-systemd\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d577f33d-6aec-4bad-95aa-1db237caa85b-multus-daemon-config\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337963 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-etc-kubernetes\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d74470f1-b459-4c15-8eec-922ea338ea16-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd4094ec-7476-4d85-a3e7-d264bcbe847a-registration-dir\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-node-log\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.337091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5830691a-6638-49a1-ab61-978776f82fe1-run-ovn\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d577f33d-6aec-4bad-95aa-1db237caa85b-host-run-netns\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5273e8f5-cc36-4d0f-b3aa-703c939dd650-tmp-dir\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-konnectivity-ca\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.338676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48d6b96b-95f6-4958-89ed-5e7abb05ae4d-agent-certs\") pod \"konnectivity-agent-4zdpm\" (UID: \"48d6b96b-95f6-4958-89ed-5e7abb05ae4d\") " pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.340404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.339476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5830691a-6638-49a1-ab61-978776f82fe1-ovn-node-metrics-cert\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.345201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.345148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dp5x\" (UniqueName: \"kubernetes.io/projected/683c8a7b-1b83-4c75-a141-beced7358e33-kube-api-access-5dp5x\") pod \"iptables-alerter-sbq4p\" (UID: \"683c8a7b-1b83-4c75-a141-beced7358e33\") " pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.345318 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.345259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv685\" (UniqueName: \"kubernetes.io/projected/287d5ac4-6d9a-4c70-94ea-1a03da6bd642-kube-api-access-zv685\") pod \"node-ca-cqbv7\" (UID: \"287d5ac4-6d9a-4c70-94ea-1a03da6bd642\") " pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.345763 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.345712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v892m\" (UniqueName: \"kubernetes.io/projected/d577f33d-6aec-4bad-95aa-1db237caa85b-kube-api-access-v892m\") pod \"multus-f99qb\" (UID: \"d577f33d-6aec-4bad-95aa-1db237caa85b\") " pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.345891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.345782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd2d\" (UniqueName: \"kubernetes.io/projected/5273e8f5-cc36-4d0f-b3aa-703c939dd650-kube-api-access-mcd2d\") pod \"node-resolver-fqdtl\" (UID: \"5273e8f5-cc36-4d0f-b3aa-703c939dd650\") " pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.345947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.345901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rrn\" (UniqueName: \"kubernetes.io/projected/d74470f1-b459-4c15-8eec-922ea338ea16-kube-api-access-79rrn\") pod \"multus-additional-cni-plugins-r9vq2\" (UID: \"d74470f1-b459-4c15-8eec-922ea338ea16\") " pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.346182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.346157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxj6n\" (UniqueName: \"kubernetes.io/projected/5830691a-6638-49a1-ab61-978776f82fe1-kube-api-access-bxj6n\") pod \"ovnkube-node-7827g\" (UID: \"5830691a-6638-49a1-ab61-978776f82fe1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.346415 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.346395 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchw7\" (UniqueName: \"kubernetes.io/projected/cd4094ec-7476-4d85-a3e7-d264bcbe847a-kube-api-access-hchw7\") pod \"aws-ebs-csi-driver-node-vwm59\" (UID: \"cd4094ec-7476-4d85-a3e7-d264bcbe847a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.426390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.426364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mczq2" Jun 15 08:18:37.437850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.437824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sbq4p" Jun 15 08:18:37.445813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.445795 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:18:37.451548 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.451526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f99qb" Jun 15 08:18:37.457352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.457334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:18:37.462820 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.462799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" Jun 15 08:18:37.469519 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.469473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" Jun 15 08:18:37.475994 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.475974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cqbv7" Jun 15 08:18:37.481486 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.481469 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqdtl" Jun 15 08:18:37.739580 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.739499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:37.739580 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.739557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:37.739773 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.739639 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:37.739773 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.739651 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:37.739773 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.739699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.73968545 +0000 UTC m=+4.005305402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:37.739773 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.739713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.739706868 +0000 UTC m=+4.005326817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:37.839892 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:37.839850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:37.840055 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.840017 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:37.840055 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.840038 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:37.840055 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.840055 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:37.840225 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:37.840114 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.840097124 +0000 UTC m=+4.105717072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:38.145223 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.145196 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4094ec_7476_4d85_a3e7_d264bcbe847a.slice/crio-9c604531cffbc8773d5a00496f19070195f8b26c16d90c8c1be2f57280b5ca41 WatchSource:0}: Error finding container 9c604531cffbc8773d5a00496f19070195f8b26c16d90c8c1be2f57280b5ca41: Status 404 returned error can't find the container with id 9c604531cffbc8773d5a00496f19070195f8b26c16d90c8c1be2f57280b5ca41 Jun 15 08:18:38.146609 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.146588 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287d5ac4_6d9a_4c70_94ea_1a03da6bd642.slice/crio-378c7a8ae70f8ed1a2724d2f9d9e964d3a984455d8aed4b18341579aad562806 WatchSource:0}: Error finding container 378c7a8ae70f8ed1a2724d2f9d9e964d3a984455d8aed4b18341579aad562806: Status 404 returned error can't find the container with id 378c7a8ae70f8ed1a2724d2f9d9e964d3a984455d8aed4b18341579aad562806 Jun 15 08:18:38.147887 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.147855 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74470f1_b459_4c15_8eec_922ea338ea16.slice/crio-779cd9027f567fa7bbe30118d35724c84945b9ae23b8edac219c8cf5839450b2 WatchSource:0}: Error finding container 779cd9027f567fa7bbe30118d35724c84945b9ae23b8edac219c8cf5839450b2: Status 404 returned error can't find the container with id 779cd9027f567fa7bbe30118d35724c84945b9ae23b8edac219c8cf5839450b2 Jun 15 08:18:38.168485 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.168458 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 08:13:37 +0000 UTC" deadline="2027-12-10 12:22:00.095876956 +0000 UTC" Jun 15 08:18:38.168485 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.168483 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13036h3m21.927397255s" Jun 15 08:18:38.169926 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.169858 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd577f33d_6aec_4bad_95aa_1db237caa85b.slice/crio-9d422dd64262966fa10c7cdd15d64a841b245699fb4a3e689da5ebdf5e63a6b8 WatchSource:0}: Error finding container 9d422dd64262966fa10c7cdd15d64a841b245699fb4a3e689da5ebdf5e63a6b8: Status 404 returned error can't find the container with id 9d422dd64262966fa10c7cdd15d64a841b245699fb4a3e689da5ebdf5e63a6b8 Jun 15 08:18:38.173253 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.173147 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683c8a7b_1b83_4c75_a141_beced7358e33.slice/crio-3248282a7a4f35b2cecc623df37d73cbf7df994512d019b3ed1c03e49e0c7e72 WatchSource:0}: Error finding container 3248282a7a4f35b2cecc623df37d73cbf7df994512d019b3ed1c03e49e0c7e72: Status 404 returned error can't find the container with id 3248282a7a4f35b2cecc623df37d73cbf7df994512d019b3ed1c03e49e0c7e72 Jun 15 08:18:38.174110 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.174085 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411db35f_9980_4f2a_ae4b_512cd5e0b2aa.slice/crio-17092ec872bb3d835d9ea56d5b099bcd1c207d8f9efca8c4c18d9bb215b78277 WatchSource:0}: Error finding container 17092ec872bb3d835d9ea56d5b099bcd1c207d8f9efca8c4c18d9bb215b78277: Status 404 returned error can't find the container with id 17092ec872bb3d835d9ea56d5b099bcd1c207d8f9efca8c4c18d9bb215b78277 Jun 15 08:18:38.175012 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.174991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5273e8f5_cc36_4d0f_b3aa_703c939dd650.slice/crio-a8441770f8342bc6d73cc7a5b69978d56c96011515e43e03a4b1cfc1f612d885 WatchSource:0}: Error finding container a8441770f8342bc6d73cc7a5b69978d56c96011515e43e03a4b1cfc1f612d885: Status 404 returned error can't find the container with id a8441770f8342bc6d73cc7a5b69978d56c96011515e43e03a4b1cfc1f612d885 Jun 15 08:18:38.175663 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.175574 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d6b96b_95f6_4958_89ed_5e7abb05ae4d.slice/crio-d8c859393c81cbf16dc65d8c2a90e6239771624e17fdff44516d45c86530ac2a WatchSource:0}: Error finding container d8c859393c81cbf16dc65d8c2a90e6239771624e17fdff44516d45c86530ac2a: Status 404 returned error can't find the container with id d8c859393c81cbf16dc65d8c2a90e6239771624e17fdff44516d45c86530ac2a Jun 15 08:18:38.176662 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:18:38.176430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5830691a_6638_49a1_ab61_978776f82fe1.slice/crio-5f7c6fe2923ca6e5e5bd7b007be0c3c72a2ebbaff72c7ca4e0da10cff690860d WatchSource:0}: Error finding container 5f7c6fe2923ca6e5e5bd7b007be0c3c72a2ebbaff72c7ca4e0da10cff690860d: Status 404 returned error can't find the container with id 5f7c6fe2923ca6e5e5bd7b007be0c3c72a2ebbaff72c7ca4e0da10cff690860d Jun 15 08:18:38.193970 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.193814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:38.194074 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.194056 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:38.203271 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.203247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"5f7c6fe2923ca6e5e5bd7b007be0c3c72a2ebbaff72c7ca4e0da10cff690860d"} Jun 15 08:18:38.208754 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.208733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zdpm" event={"ID":"48d6b96b-95f6-4958-89ed-5e7abb05ae4d","Type":"ContainerStarted","Data":"d8c859393c81cbf16dc65d8c2a90e6239771624e17fdff44516d45c86530ac2a"} Jun 15 08:18:38.210440 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.210416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sbq4p" event={"ID":"683c8a7b-1b83-4c75-a141-beced7358e33","Type":"ContainerStarted","Data":"3248282a7a4f35b2cecc623df37d73cbf7df994512d019b3ed1c03e49e0c7e72"} Jun 15 08:18:38.212728 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.212696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f99qb" event={"ID":"d577f33d-6aec-4bad-95aa-1db237caa85b","Type":"ContainerStarted","Data":"9d422dd64262966fa10c7cdd15d64a841b245699fb4a3e689da5ebdf5e63a6b8"} Jun 15 08:18:38.214564 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.214539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerStarted","Data":"779cd9027f567fa7bbe30118d35724c84945b9ae23b8edac219c8cf5839450b2"} Jun 15 08:18:38.216017 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.215995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" event={"ID":"cd4094ec-7476-4d85-a3e7-d264bcbe847a","Type":"ContainerStarted","Data":"9c604531cffbc8773d5a00496f19070195f8b26c16d90c8c1be2f57280b5ca41"} Jun 15 08:18:38.217068 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.217049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqdtl" event={"ID":"5273e8f5-cc36-4d0f-b3aa-703c939dd650","Type":"ContainerStarted","Data":"a8441770f8342bc6d73cc7a5b69978d56c96011515e43e03a4b1cfc1f612d885"} Jun 15 08:18:38.222919 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.222896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mczq2" event={"ID":"411db35f-9980-4f2a-ae4b-512cd5e0b2aa","Type":"ContainerStarted","Data":"17092ec872bb3d835d9ea56d5b099bcd1c207d8f9efca8c4c18d9bb215b78277"} Jun 15 08:18:38.225304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.225285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cqbv7" event={"ID":"287d5ac4-6d9a-4c70-94ea-1a03da6bd642","Type":"ContainerStarted","Data":"378c7a8ae70f8ed1a2724d2f9d9e964d3a984455d8aed4b18341579aad562806"} Jun 15 08:18:38.747780 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.747683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:38.747780 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.747769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:38.748036 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.747913 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:38.748036 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.747975 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:40.747956354 +0000 UTC m=+6.013576306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:38.748714 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.748605 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:38.748714 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.748662 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:18:40.748644884 +0000 UTC m=+6.014264841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:38.848610 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:38.848568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:38.848796 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.848781 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:38.848857 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.848803 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:38.848857 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.848815 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:38.849010 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:38.848892 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:40.848856855 +0000 UTC m=+6.114476805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:39.168954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.168812 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 08:13:37 +0000 UTC" deadline="2028-02-19 04:09:26.119673599 +0000 UTC" Jun 15 08:18:39.168954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.168889 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14731h50m46.950788541s" Jun 15 08:18:39.195751 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.195274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:39.195751 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.195298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:39.195751 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:39.195409 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:39.195751 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:39.195511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:39.240205 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.239959 2564 generic.go:356] "Generic (PLEG): container finished" podID="c51d3242e3ab3d512ffb1c8c48c9fa0d" containerID="3c6ab28034a7866d286e984fbd9e6788ca2c07cb31ff0a99abcc0f064acabd1d" exitCode=0 Jun 15 08:18:39.240205 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.240069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" event={"ID":"c51d3242e3ab3d512ffb1c8c48c9fa0d","Type":"ContainerDied","Data":"3c6ab28034a7866d286e984fbd9e6788ca2c07cb31ff0a99abcc0f064acabd1d"} Jun 15 08:18:39.258925 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:39.258693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" event={"ID":"5fb99caa2341a0560c862ba7933daeb2","Type":"ContainerStarted","Data":"1292f9921aa898f303b7fb9e73837e1d931ab7c8f8e021be94c0713a7a8cd5eb"} Jun 15 08:18:40.194630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.194099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:40.194630 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.194245 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:40.287980 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.287931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" event={"ID":"c51d3242e3ab3d512ffb1c8c48c9fa0d","Type":"ContainerStarted","Data":"ef07830768644ae67f9651fcb5dd722f17e9dac572597038c57555e203b3e13b"} Jun 15 08:18:40.310738 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.310666 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-160.ec2.internal" podStartSLOduration=4.310642649 podStartE2EDuration="4.310642649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:39.309690754 +0000 UTC m=+4.575310725" watchObservedRunningTime="2026-06-15 08:18:40.310642649 +0000 UTC m=+5.576262611" Jun 15 08:18:40.766090 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.766049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:40.766329 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.766125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:40.766329 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.766289 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:40.766466 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.766353 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:18:44.766335223 +0000 UTC m=+10.031955186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:40.766466 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.766427 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:40.766466 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.766463 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:44.766451668 +0000 UTC m=+10.032071622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:40.871934 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:40.866909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:40.871934 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.867104 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:40.871934 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.867128 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:40.871934 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.867141 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:40.871934 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:40.867205 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:44.867181541 +0000 UTC m=+10.132801491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:41.194976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:41.194879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:41.194976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:41.194909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:41.195449 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:41.195003 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:41.195449 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:41.195128 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:42.193839 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:42.193805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:42.194054 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:42.193975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:43.194224 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:43.193490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:43.194224 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:43.193676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:43.194224 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:43.193693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:43.194224 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:43.193810 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:44.194259 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:44.194222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:44.194749 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.194366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:44.801782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:44.801897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.802046 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.802111 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:52.802090739 +0000 UTC m=+18.067710694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.802516 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:44.802606 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.802569 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:18:52.802552684 +0000 UTC m=+18.068172649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:44.902904 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:44.902852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:44.903073 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.903039 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:44.903073 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.903061 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:44.903073 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.903074 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:44.903208 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:44.903132 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:52.903113415 +0000 UTC m=+18.168733379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:45.194769 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:45.194681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:45.194769 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:45.194718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:45.195326 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:45.194844 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:45.195326 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:45.195005 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:46.194009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:46.193969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:46.194169 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:46.194121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:47.194272 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:47.194226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:47.194719 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:47.194344 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:47.194784 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:47.194737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:47.194844 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:47.194829 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:48.193776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:48.193738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:48.193954 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:48.193892 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:49.194220 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:49.194142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:49.194624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:49.194149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:49.194624 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:49.194278 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:49.194624 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:49.194348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:50.193550 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:50.193515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:50.193732 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:50.193647 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:51.193392 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:51.193355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:51.193894 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:51.193490 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:51.193894 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:51.193536 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:51.193894 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:51.193646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:52.193778 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:52.193745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:52.194276 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.193905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:52.862279 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:52.862240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:52.862455 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:52.862311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:52.862455 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.862408 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:52.862455 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.862409 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:52.862583 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.862475 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:08.862456571 +0000 UTC m=+34.128076534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:52.862583 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.862494 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:19:08.862483574 +0000 UTC m=+34.128103524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:52.963657 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:52.963617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:52.963840 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.963796 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:52.963840 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.963814 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:52.963840 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.963824 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:52.964000 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:52.963893 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:08.963878169 +0000 UTC m=+34.229498130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:53.194429 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:53.194356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:53.194429 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:53.194372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:53.194792 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:53.194494 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:53.194792 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:53.194503 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:54.193614 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:54.193578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:54.193797 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:54.193726 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:55.194312 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:55.194275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:55.194910 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:55.194386 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:55.194910 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:55.194427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:55.194910 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:55.194569 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:56.194079 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:56.194049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:56.194280 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:56.194159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:57.193927 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:57.193897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:57.194254 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:57.194011 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:57.194254 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:57.194068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:57.194254 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:57.194172 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:58.194097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.193723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:18:58.194846 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:58.194158 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:18:58.325673 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.325643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mczq2" event={"ID":"411db35f-9980-4f2a-ae4b-512cd5e0b2aa","Type":"ContainerStarted","Data":"32a1d70b54b28ffa2f2fb77796dbc64725c1c88e7e91d1f3155d8c03864a65c4"} Jun 15 08:18:58.327077 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.327046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cqbv7" event={"ID":"287d5ac4-6d9a-4c70-94ea-1a03da6bd642","Type":"ContainerStarted","Data":"c3afa9d6263e79e6f858babb1410e6d367da7e7042dc8352ca296d46425e17df"} Jun 15 08:18:58.329468 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:18:58.329775 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329755 2564 generic.go:356] "Generic (PLEG): container finished" podID="5830691a-6638-49a1-ab61-978776f82fe1" containerID="e8c8eec954264ad914a2a483563b2dbf6a1fe373f901506175d81da0d7980b86" exitCode=1 Jun 15 08:18:58.329879 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"a6c8ab0599ffbbd861e65c85904ccadcd1368e7a6dd75ab060c8688b6913b727"} Jun 15 08:18:58.329939 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"468150cab32362f9d50bbbebb49e99f71411b7e3c56dfdc858f9ed9517468c40"} Jun 15 08:18:58.329939 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"0f48a4263fcabb06f20a5be339ec8b9396312608d9508daded9e9dcba6130d78"} Jun 15 08:18:58.330014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.329972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"1307ddc14887be034014a931ca2d2aa8fbde8d5ab1339d6d29f5f977e3620b0a"} Jun 15 08:18:58.330014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.330005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerDied","Data":"e8c8eec954264ad914a2a483563b2dbf6a1fe373f901506175d81da0d7980b86"} Jun 15 08:18:58.330087 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.330050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"716009d337fa5f9c600674ae8b839d9137cbeac40cf31cd6971f2c60dfcbec6e"} Jun 15 08:18:58.331058 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.331036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zdpm" event={"ID":"48d6b96b-95f6-4958-89ed-5e7abb05ae4d","Type":"ContainerStarted","Data":"89f52442985514aa6ef336dde4780e8020782b0e55eee071e953c3ca60015d93"} Jun 15 08:18:58.332399 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.332374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f99qb" event={"ID":"d577f33d-6aec-4bad-95aa-1db237caa85b","Type":"ContainerStarted","Data":"d2c107b3e006d71021ae82c71e967a1b7896df9c7916b869a9a91621c3497d75"} Jun 15 08:18:58.333793 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.333775 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="db6bc9581954f0ec42f05b154dfa7353272b4fca0310ae0cb83aec5a00cce5cb" exitCode=0 Jun 15 08:18:58.333905 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.333840 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"db6bc9581954f0ec42f05b154dfa7353272b4fca0310ae0cb83aec5a00cce5cb"} Jun 15 08:18:58.335254 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.335231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" event={"ID":"cd4094ec-7476-4d85-a3e7-d264bcbe847a","Type":"ContainerStarted","Data":"5925cbf589194693ae40cefa4b2ccc384fcef867eeff97746ba7ad655a8af35c"} Jun 15 08:18:58.336589 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.336570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqdtl" event={"ID":"5273e8f5-cc36-4d0f-b3aa-703c939dd650","Type":"ContainerStarted","Data":"696ddfb77428415d78f1f315d15cf6e33887735db243223f87ad04a7e8d729ba"} Jun 15 08:18:58.356083 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.356043 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-160.ec2.internal" podStartSLOduration=22.356031157 podStartE2EDuration="22.356031157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:40.311380812 +0000 UTC m=+5.577000765" watchObservedRunningTime="2026-06-15 08:18:58.356031157 +0000 UTC m=+23.621651127" Jun 15 08:18:58.387557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.385720 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mczq2" podStartSLOduration=4.327985518 podStartE2EDuration="23.385703299s" totalImagesPullingTime="19.057717781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.356218585 +0000 UTC m=+23.621838554" watchObservedRunningTime="2026-06-15 08:18:58.385703299 +0000 UTC m=+23.651323269" Jun 15 08:18:58.411001 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.410967 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f99qb" podStartSLOduration=4.293387499 podStartE2EDuration="23.410955538s" totalImagesPullingTime="19.117568039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.387975752 +0000 UTC m=+23.653595724" watchObservedRunningTime="2026-06-15 08:18:58.410955538 +0000 UTC m=+23.676575508" Jun 15 08:18:58.432452 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.432419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4zdpm" podStartSLOduration=8.279259041 podStartE2EDuration="23.432407699s" totalImagesPullingTime="15.153148658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.411180721 +0000 UTC m=+23.676800673" watchObservedRunningTime="2026-06-15 08:18:58.432407699 +0000 UTC m=+23.698027726" Jun 15 08:18:58.455915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.455851 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cqbv7" podStartSLOduration=4.393740201 podStartE2EDuration="23.455838721s" totalImagesPullingTime="19.06209852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.433128953 +0000 UTC m=+23.698748923" watchObservedRunningTime="2026-06-15 08:18:58.455838721 +0000 UTC m=+23.721458690" Jun 15 08:18:58.480974 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.480936 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fqdtl" podStartSLOduration=4.421122362 podStartE2EDuration="23.480923425s" totalImagesPullingTime="19.059801063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.456165798 +0000 UTC m=+23.721785767" watchObservedRunningTime="2026-06-15 08:18:58.480923425 +0000 UTC m=+23.746543394" Jun 15 08:18:58.633705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:58.633679 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 08:18:59.187575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.187454 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T08:18:58.633699805Z","UUID":"1cb76ddd-4958-44e9-a194-a1971a05bf4f","Handler":null,"Name":"","Endpoint":""} Jun 15 08:18:59.189199 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.189174 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 08:18:59.189336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.189217 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 08:18:59.194168 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.194149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:18:59.194587 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.194170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:18:59.194587 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:59.194275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:18:59.194587 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:18:59.194457 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:18:59.341363 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.341322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sbq4p" event={"ID":"683c8a7b-1b83-4c75-a141-beced7358e33","Type":"ContainerStarted","Data":"314b0d06bc368e110390ece17781c94958e592e02b2b7e3964a3ca2057061204"} Jun 15 08:18:59.343585 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.343559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" event={"ID":"cd4094ec-7476-4d85-a3e7-d264bcbe847a","Type":"ContainerStarted","Data":"4e7a5ec522d221c53390db5c5e6c28cb7c9a1f5f381b6137076e39eca9f17d9a"} Jun 15 08:18:59.361824 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:18:59.361773 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sbq4p" podStartSLOduration=5.307937959 podStartE2EDuration="24.361758624s" totalImagesPullingTime="19.053820665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:59.361441463 +0000 UTC m=+24.627061434" watchObservedRunningTime="2026-06-15 08:18:59.361758624 +0000 UTC m=+24.627378625" Jun 15 08:19:00.193783 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.193611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:00.193979 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:00.193879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:00.347619 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.347531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" event={"ID":"cd4094ec-7476-4d85-a3e7-d264bcbe847a","Type":"ContainerStarted","Data":"ca39e8aa7db1d8b09a80702393f6aba0f6177bf4c55b982a02b94c9d075cd45f"} Jun 15 08:19:00.350772 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.350753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:19:00.351161 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.351142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"4435f54919b32b389da431add6cabb188bc4d7728fd95ce891f80dcafb4c4d1d"} Jun 15 08:19:00.379177 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.379126 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwm59" podStartSLOduration=4.28860079 podStartE2EDuration="25.379114257s" totalImagesPullingTime="21.090513467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:00.379000371 +0000 UTC m=+25.644620364" watchObservedRunningTime="2026-06-15 08:19:00.379114257 +0000 UTC m=+25.644734226" Jun 15 08:19:00.916739 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:00.916704 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:19:01.193378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:01.193298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:01.193527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:01.193297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:01.193527 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:01.193405 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:01.193527 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:01.193468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:02.194127 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.194105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:02.194665 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:02.194211 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:02.358537 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.358382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:19:02.358900 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.358860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"136d8d45c32bf3013a10bac7751a6fbb42a7d6be4198a7eb973bb749198a598b"} Jun 15 08:19:02.359167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.359124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:02.359272 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.359215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:02.359347 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.359334 2564 scope.go:117] "RemoveContainer" containerID="e8c8eec954264ad914a2a483563b2dbf6a1fe373f901506175d81da0d7980b86" Jun 15 08:19:02.377185 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.377149 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:02.658069 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.657996 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:19:02.658528 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:02.658512 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:19:03.194105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.194072 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:03.194274 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:03.194203 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:03.194674 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.194269 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:03.194674 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:03.194357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:03.368217 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.368175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:19:03.368765 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.368729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" event={"ID":"5830691a-6638-49a1-ab61-978776f82fe1","Type":"ContainerStarted","Data":"9fe228d83bf0c4ef0728957479082ed116fe43e884e52d6181dc1156c8dfdf22"} Jun 15 08:19:03.369614 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.369284 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:03.369742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.369723 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4zdpm" Jun 15 08:19:03.390552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.390526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:03.413192 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:03.413100 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" podStartSLOduration=9.268420409 podStartE2EDuration="28.413079102s" totalImagesPullingTime="19.144658693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:03.411676366 +0000 UTC m=+28.677296356" watchObservedRunningTime="2026-06-15 08:19:03.413079102 +0000 UTC m=+28.678699075" Jun 15 08:19:04.194041 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.194015 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:04.194173 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:04.194137 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:04.412117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.412084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvs4s"] Jun 15 08:19:04.412601 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.412192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:04.412601 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:04.412299 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:04.419516 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.419487 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82dnt"] Jun 15 08:19:04.419633 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.419588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:04.419712 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:04.419689 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:04.423245 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.423221 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vwkk"] Jun 15 08:19:04.423349 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:04.423304 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:04.423476 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:04.423451 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:05.817602 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:05.817555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:05.916104 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:05.916077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:06.193927 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:06.193889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:06.193927 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:06.193915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:06.194127 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:06.193898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:06.194127 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:06.194040 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:06.194224 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:06.194173 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:06.194275 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:06.194232 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:06.376061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:06.375985 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="04572164e92c2290ae7ffad8a2d20cf5fbd01ae55268df6d1b2c7316c704d0e8" exitCode=0 Jun 15 08:19:06.376061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:06.376028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"04572164e92c2290ae7ffad8a2d20cf5fbd01ae55268df6d1b2c7316c704d0e8"} Jun 15 08:19:07.382392 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:07.382363 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="6dfdc83e540221d6bff6601860455e0ce851fec37b5051c71870f24e0161c3be" exitCode=0 Jun 15 08:19:07.382812 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:07.382416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"6dfdc83e540221d6bff6601860455e0ce851fec37b5051c71870f24e0161c3be"} Jun 15 08:19:08.194006 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.193970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:08.194135 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.194009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:08.194135 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.194009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:08.194135 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.194073 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:08.194244 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.194176 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:08.194275 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.194247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:08.386487 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.386405 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="2304caaaa2da626c2dfef0e9b892e16fb7ba3bf6bdba9253f43098355b92b707" exitCode=0 Jun 15 08:19:08.386487 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.386467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"2304caaaa2da626c2dfef0e9b892e16fb7ba3bf6bdba9253f43098355b92b707"} Jun 15 08:19:08.888238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.888195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:08.888397 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.888265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:08.888397 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.888365 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:19:08.888503 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.888432 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret podName:5674de82-e968-492d-a50b-e494a202d456 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:40.888416747 +0000 UTC m=+66.154036699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret") pod "global-pull-secret-syncer-rvs4s" (UID: "5674de82-e968-492d-a50b-e494a202d456") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:19:08.888503 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.888437 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:19:08.888503 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.888495 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:19:40.888479553 +0000 UTC m=+66.154099520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:19:08.988956 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:08.988923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:08.989123 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.989099 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:19:08.989169 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.989131 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:19:08.989169 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.989145 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qn874 for pod openshift-network-diagnostics/network-check-target-8vwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:19:08.989263 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:08.989209 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874 podName:7e58126a-bec8-49b3-9760-1f4c12beff59 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:40.989188115 +0000 UTC m=+66.254808065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qn874" (UniqueName: "kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874") pod "network-check-target-8vwkk" (UID: "7e58126a-bec8-49b3-9760-1f4c12beff59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:19:10.193951 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.193921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:10.194599 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.193916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:10.194599 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:10.194030 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vwkk" podUID="7e58126a-bec8-49b3-9760-1f4c12beff59" Jun 15 08:19:10.194599 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:10.194127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:19:10.194599 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.193931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:10.194599 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:10.194211 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvs4s" podUID="5674de82-e968-492d-a50b-e494a202d456" Jun 15 08:19:10.765441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.765399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:10.828039 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.828013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:10.981163 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.981128 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-160.ec2.internal" event="NodeReady" Jun 15 08:19:10.981321 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:10.981269 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 08:19:11.027283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.027197 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cdqbq"] Jun 15 08:19:11.030072 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.030055 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d9pbc"] Jun 15 08:19:11.030206 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.030190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.032477 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.032459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 08:19:11.032477 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.032465 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 08:19:11.032610 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.032592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r86n2\"" Jun 15 08:19:11.032662 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.032628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.034467 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.034447 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 08:19:11.034566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.034534 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 08:19:11.034627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.034596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2x8r9\"" Jun 15 08:19:11.034627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.034596 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 08:19:11.043944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.043857 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d9pbc"] Jun 15 08:19:11.044335 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.044316 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdqbq"] Jun 15 08:19:11.205515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr94x\" (UniqueName: \"kubernetes.io/projected/96724c47-bd66-4551-aaee-79a1f426be4e-kube-api-access-mr94x\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.205909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c1893c-ac8e-442e-bb13-902f9d138ca7-config-volume\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.205909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.205909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96724c47-bd66-4551-aaee-79a1f426be4e-cert\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.205909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c1893c-ac8e-442e-bb13-902f9d138ca7-tmp-dir\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.205909 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.205690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kpfn\" (UniqueName: \"kubernetes.io/projected/41c1893c-ac8e-442e-bb13-902f9d138ca7-kube-api-access-7kpfn\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.306907 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.306806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr94x\" (UniqueName: \"kubernetes.io/projected/96724c47-bd66-4551-aaee-79a1f426be4e-kube-api-access-mr94x\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.306907 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.306860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c1893c-ac8e-442e-bb13-902f9d138ca7-config-volume\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.306907 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.306906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.307150 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.306929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96724c47-bd66-4551-aaee-79a1f426be4e-cert\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.307150 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.306953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c1893c-ac8e-442e-bb13-902f9d138ca7-tmp-dir\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.307150 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:11.307046 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:11.307150 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.307090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpfn\" (UniqueName: \"kubernetes.io/projected/41c1893c-ac8e-442e-bb13-902f9d138ca7-kube-api-access-7kpfn\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.307150 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:11.307118 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:11.807097677 +0000 UTC m=+37.072717646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:11.307408 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.307284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c1893c-ac8e-442e-bb13-902f9d138ca7-tmp-dir\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.307638 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.307619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c1893c-ac8e-442e-bb13-902f9d138ca7-config-volume\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.311175 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.311138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96724c47-bd66-4551-aaee-79a1f426be4e-cert\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.315881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.315842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kpfn\" (UniqueName: \"kubernetes.io/projected/41c1893c-ac8e-442e-bb13-902f9d138ca7-kube-api-access-7kpfn\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.316235 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.316216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr94x\" (UniqueName: \"kubernetes.io/projected/96724c47-bd66-4551-aaee-79a1f426be4e-kube-api-access-mr94x\") pod \"ingress-canary-d9pbc\" (UID: \"96724c47-bd66-4551-aaee-79a1f426be4e\") " pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.346188 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.346166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d9pbc" Jun 15 08:19:11.490902 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.490718 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d9pbc"] Jun 15 08:19:11.494743 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:19:11.494716 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96724c47_bd66_4551_aaee_79a1f426be4e.slice/crio-9b263caa828a513655e7bf037e3e01e2c91f1f6917529c479deb06fad5537645 WatchSource:0}: Error finding container 9b263caa828a513655e7bf037e3e01e2c91f1f6917529c479deb06fad5537645: Status 404 returned error can't find the container with id 9b263caa828a513655e7bf037e3e01e2c91f1f6917529c479deb06fad5537645 Jun 15 08:19:11.811032 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:11.810998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:11.811201 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:11.811174 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:11.811268 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:11.811256 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:12.81124023 +0000 UTC m=+38.076860178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:12.193852 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.193778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:12.194032 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.193789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:12.194032 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.193789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:12.196764 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.196743 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qw9r9\"" Jun 15 08:19:12.196915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.196782 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 08:19:12.197541 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.197522 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 08:19:12.197643 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.197627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-646t6\"" Jun 15 08:19:12.197827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.197800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 08:19:12.197827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.197818 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 08:19:12.397985 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.397953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d9pbc" event={"ID":"96724c47-bd66-4551-aaee-79a1f426be4e","Type":"ContainerStarted","Data":"9b263caa828a513655e7bf037e3e01e2c91f1f6917529c479deb06fad5537645"} Jun 15 08:19:12.820158 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:12.820113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:12.820312 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:12.820255 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:12.820363 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:12.820319 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:14.820304437 +0000 UTC m=+40.085924385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:14.405189 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:14.405153 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="a4e548b721fa2f2bd9b2c6d7a3ba67772ae994f60a61db3e38ebc7dbe212e8b0" exitCode=0 Jun 15 08:19:14.405579 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:14.405202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"a4e548b721fa2f2bd9b2c6d7a3ba67772ae994f60a61db3e38ebc7dbe212e8b0"} Jun 15 08:19:14.838207 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:14.838122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:14.838401 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:14.838296 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:14.838401 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:14.838367 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:18.838346533 +0000 UTC m=+44.103966495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:14.912999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:14.912963 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:15.411172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.411126 2564 generic.go:356] "Generic (PLEG): container finished" podID="d74470f1-b459-4c15-8eec-922ea338ea16" containerID="fc5d65b66fad815e7dd9aa933b5b4163d60d5e853985c902bbd74df6005aa741" exitCode=0 Jun 15 08:19:15.411604 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.411215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerDied","Data":"fc5d65b66fad815e7dd9aa933b5b4163d60d5e853985c902bbd74df6005aa741"} Jun 15 08:19:15.412817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.412744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d9pbc" event={"ID":"96724c47-bd66-4551-aaee-79a1f426be4e","Type":"ContainerStarted","Data":"eeec8511eaeb0f9b55f5708e57efecc909556a165d433bc42faf150cd7fc81c5"} Jun 15 08:19:15.455316 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.455270 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d9pbc" podStartSLOduration=0.719652752 podStartE2EDuration="4.455250435s" totalImagesPullingTime="3.735597683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:15.454534931 +0000 UTC m=+40.720154950" watchObservedRunningTime="2026-06-15 08:19:15.455250435 +0000 UTC m=+40.720870405" Jun 15 08:19:15.487939 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.487903 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:15.539350 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:15.539311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:16.345450 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.345414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:16.403650 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.403611 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:16.418744 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.418718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" event={"ID":"d74470f1-b459-4c15-8eec-922ea338ea16","Type":"ContainerStarted","Data":"90754df3a874eca962f6868579bb37a0caa41c553e3a49ae89114e75f5a0535c"} Jun 15 08:19:16.444804 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.444759 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9vq2" podStartSLOduration=8.260568588 podStartE2EDuration="41.444744154s" totalImagesPullingTime="33.184175566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:16.442778618 +0000 UTC m=+41.708398587" watchObservedRunningTime="2026-06-15 08:19:16.444744154 +0000 UTC m=+41.710364102" Jun 15 08:19:16.564680 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.564644 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:16.666002 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:16.665928 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:17.460728 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.460692 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:17.515368 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.515340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:17.677816 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.677787 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz"] Jun 15 08:19:17.710643 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.710617 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz"] Jun 15 08:19:17.710815 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.710703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.713094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.713070 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 08:19:17.713924 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.713907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xtbhb\"" Jun 15 08:19:17.713999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.713907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 08:19:17.713999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.713989 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 08:19:17.714073 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.714041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 15 08:19:17.761228 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.761201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqqv\" (UniqueName: \"kubernetes.io/projected/0d3652e3-e362-4dc0-aca6-65f41966addd-kube-api-access-4tqqv\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.761347 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.761239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d3652e3-e362-4dc0-aca6-65f41966addd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.862518 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.862487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqqv\" (UniqueName: \"kubernetes.io/projected/0d3652e3-e362-4dc0-aca6-65f41966addd-kube-api-access-4tqqv\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.862649 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.862532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d3652e3-e362-4dc0-aca6-65f41966addd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.866530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.866508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d3652e3-e362-4dc0-aca6-65f41966addd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:17.871504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:17.871482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqqv\" (UniqueName: \"kubernetes.io/projected/0d3652e3-e362-4dc0-aca6-65f41966addd-kube-api-access-4tqqv\") pod \"managed-serviceaccount-addon-agent-76748d4f58-hl9tz\" (UID: \"0d3652e3-e362-4dc0-aca6-65f41966addd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:18.033776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:18.033687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:19:18.174716 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:18.174685 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz"] Jun 15 08:19:18.179753 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:19:18.179726 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d3652e3_e362_4dc0_aca6_65f41966addd.slice/crio-f8af5047c0b4e9e9faf7aea4b7d88dd7a5b40ceafe81a109f5afcaacfdbd41d8 WatchSource:0}: Error finding container f8af5047c0b4e9e9faf7aea4b7d88dd7a5b40ceafe81a109f5afcaacfdbd41d8: Status 404 returned error can't find the container with id f8af5047c0b4e9e9faf7aea4b7d88dd7a5b40ceafe81a109f5afcaacfdbd41d8 Jun 15 08:19:18.424705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:18.424626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerStarted","Data":"f8af5047c0b4e9e9faf7aea4b7d88dd7a5b40ceafe81a109f5afcaacfdbd41d8"} Jun 15 08:19:18.870413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:18.870374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:18.870814 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:18.870545 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:18.870814 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:18.870613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:26.870596558 +0000 UTC m=+52.136216507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:22.436740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:22.436703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerStarted","Data":"d77d2af6d2834e8d286bd1d0feacbed662a2d61ca7828a6bc872d87f22461c56"} Jun 15 08:19:26.922337 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:26.922294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:26.922899 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:26.922476 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:26.922899 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:26.922540 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:42.922522661 +0000 UTC m=+68.188142623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:30.772279 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:30.772236 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:30.831738 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:30.831708 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:35.382914 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:35.382885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7827g" Jun 15 08:19:35.410883 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:35.410829 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" podStartSLOduration=15.074584558 podStartE2EDuration="18.410815938s" totalImagesPullingTime="3.33623138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:22.455355671 +0000 UTC m=+47.720975642" watchObservedRunningTime="2026-06-15 08:19:35.410815938 +0000 UTC m=+60.676435908" Jun 15 08:19:35.543591 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:35.543561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:35.605587 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:35.605555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:38.281642 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:38.281591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:38.343175 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:38.343138 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:40.921513 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:40.921476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:40.921513 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:40.921526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:19:40.924086 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:40.924067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 08:19:40.924143 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:40.924103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 08:19:40.932136 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:40.932123 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:19:40.932192 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:40.932182 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:20:44.932165868 +0000 UTC m=+130.197785817 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : secret "metrics-daemon-secret" not found Jun 15 08:19:40.934248 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:40.934229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5674de82-e968-492d-a50b-e494a202d456-original-pull-secret\") pod \"global-pull-secret-syncer-rvs4s\" (UID: \"5674de82-e968-492d-a50b-e494a202d456\") " pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:41.017306 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.017261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvs4s" Jun 15 08:19:41.022227 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.022209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:41.025076 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.025055 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 08:19:41.036148 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.036125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 08:19:41.046926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.046896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn874\" (UniqueName: \"kubernetes.io/projected/7e58126a-bec8-49b3-9760-1f4c12beff59-kube-api-access-qn874\") pod \"network-check-target-8vwkk\" (UID: \"7e58126a-bec8-49b3-9760-1f4c12beff59\") " pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:41.135573 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.135541 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvs4s"] Jun 15 08:19:41.138460 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:19:41.138421 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5674de82_e968_492d_a50b_e494a202d456.slice/crio-915740638e09e4a95ffd61351433ac0d228e4389a60047a74af14331c157699e WatchSource:0}: Error finding container 915740638e09e4a95ffd61351433ac0d228e4389a60047a74af14331c157699e: Status 404 returned error can't find the container with id 915740638e09e4a95ffd61351433ac0d228e4389a60047a74af14331c157699e Jun 15 08:19:41.314332 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.314301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qw9r9\"" Jun 15 08:19:41.322283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.322261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:41.437709 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.437677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vwkk"] Jun 15 08:19:41.441083 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:19:41.441055 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e58126a_bec8_49b3_9760_1f4c12beff59.slice/crio-6725c654b91451a4565e82b04359b93e595ea1908e273c6ea2146d317057786a WatchSource:0}: Error finding container 6725c654b91451a4565e82b04359b93e595ea1908e273c6ea2146d317057786a: Status 404 returned error can't find the container with id 6725c654b91451a4565e82b04359b93e595ea1908e273c6ea2146d317057786a Jun 15 08:19:41.479728 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.479698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvs4s" event={"ID":"5674de82-e968-492d-a50b-e494a202d456","Type":"ContainerStarted","Data":"915740638e09e4a95ffd61351433ac0d228e4389a60047a74af14331c157699e"} Jun 15 08:19:41.480748 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:41.480725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vwkk" event={"ID":"7e58126a-bec8-49b3-9760-1f4c12beff59","Type":"ContainerStarted","Data":"6725c654b91451a4565e82b04359b93e595ea1908e273c6ea2146d317057786a"} Jun 15 08:19:42.935334 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:42.935296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:19:42.935734 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:42.935444 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:42.935734 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:19:42.935516 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:20:14.935496925 +0000 UTC m=+100.201116878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:19:45.590472 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:45.590432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:45.690937 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:45.690897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:19:46.496897 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:46.496849 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vwkk" event={"ID":"7e58126a-bec8-49b3-9760-1f4c12beff59","Type":"ContainerStarted","Data":"29d6bc0ed3a81b0b11829caf18ffe5feadb3fbb4498e848121470e3db41185ec"} Jun 15 08:19:46.497082 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:46.496959 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:19:46.498220 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:46.498193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvs4s" event={"ID":"5674de82-e968-492d-a50b-e494a202d456","Type":"ContainerStarted","Data":"07c4dd3a5bf22482fbc156bd15084f25b4094129d7151ca643a9c4fb63ad22ef"} Jun 15 08:19:46.512845 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:46.512800 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vwkk" podStartSLOduration=66.971694844 podStartE2EDuration="1m11.512784439s" totalImagesPullingTime="4.541089595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:46.511425092 +0000 UTC m=+71.777045063" watchObservedRunningTime="2026-06-15 08:19:46.512784439 +0000 UTC m=+71.778404438" Jun 15 08:19:46.526308 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:46.526240 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rvs4s" podStartSLOduration=66.681011413 podStartE2EDuration="1m11.526225695s" totalImagesPullingTime="4.845214282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:46.525462933 +0000 UTC m=+71.791082903" watchObservedRunningTime="2026-06-15 08:19:46.526225695 +0000 UTC m=+71.791845665" Jun 15 08:19:48.414881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:19:48.414829 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:20:14.947050 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:20:14.947007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:20:14.947541 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:20:14.947134 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:20:14.947541 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:20:14.947217 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:21:18.947192452 +0000 UTC m=+164.212812414 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:20:17.503084 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:20:17.503055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vwkk" Jun 15 08:20:44.942949 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:20:44.942899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:20:44.943455 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:20:44.943058 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:20:44.943455 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:20:44.943130 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:22:46.943114394 +0000 UTC m=+252.208734347 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : secret "metrics-daemon-secret" not found Jun 15 08:21:14.040067 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:21:14.040021 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cdqbq" podUID="41c1893c-ac8e-442e-bb13-902f9d138ca7" Jun 15 08:21:14.710774 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:14.710743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:21:15.205129 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:21:15.205097 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:21:18.636816 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:18.636788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:21:18.976155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:18.976121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:21:18.976320 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:21:18.976265 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:21:18.976362 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:21:18.976331 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls podName:41c1893c-ac8e-442e-bb13-902f9d138ca7 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:20.976315914 +0000 UTC m=+286.241935862 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls") pod "dns-default-cdqbq" (UID: "41c1893c-ac8e-442e-bb13-902f9d138ca7") : secret "dns-default-metrics-tls" not found Jun 15 08:21:21.728140 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:21.728108 2564 generic.go:356] "Generic (PLEG): container finished" podID="0d3652e3-e362-4dc0-aca6-65f41966addd" containerID="d77d2af6d2834e8d286bd1d0feacbed662a2d61ca7828a6bc872d87f22461c56" exitCode=255 Jun 15 08:21:21.728471 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:21.728164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerDied","Data":"d77d2af6d2834e8d286bd1d0feacbed662a2d61ca7828a6bc872d87f22461c56"} Jun 15 08:21:21.728516 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:21.728472 2564 scope.go:117] "RemoveContainer" containerID="d77d2af6d2834e8d286bd1d0feacbed662a2d61ca7828a6bc872d87f22461c56" Jun 15 08:21:22.735089 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:22.735055 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerStarted","Data":"2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f"} Jun 15 08:21:30.193665 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:21:30.193575 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:22:16.559858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:16.559828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:31.413034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.412997 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:22:31.414731 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.414715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.417026 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.417002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 08:22:31.417264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.417247 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 08:22:31.417359 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.417342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 08:22:31.417844 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.417824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm97c\"" Jun 15 08:22:31.422141 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.422122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 08:22:31.440906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.440882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:22:31.507745 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.507714 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr"] Jun 15 08:22:31.509467 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.509454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" Jun 15 08:22:31.511775 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.511754 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xczcf\"" Jun 15 08:22:31.512125 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.512107 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f"] Jun 15 08:22:31.513471 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.513454 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75"] Jun 15 08:22:31.513573 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.513556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.515292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.515275 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d5fb9cfcd-dk2fg"] Jun 15 08:22:31.515382 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.515361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.516770 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.516746 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 08:22:31.517236 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.517211 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 08:22:31.517915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.517891 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7lbzn\"" Jun 15 08:22:31.518335 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.518314 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.519165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.519145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.519311 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.519151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.520394 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.520373 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.520811 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.520428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wrhs7\"" Jun 15 08:22:31.520947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.520926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.521454 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.520496 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 08:22:31.522637 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.522614 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr"] Jun 15 08:22:31.524157 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524139 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rjvlc\"" Jun 15 08:22:31.524252 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524139 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 08:22:31.524440 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524424 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 08:22:31.524519 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 08:22:31.524585 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524533 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.525030 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.524898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 08:22:31.525600 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.525538 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.529299 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.529281 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f"] Jun 15 08:22:31.530331 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.530309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75"] Jun 15 08:22:31.531452 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.531431 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d5fb9cfcd-dk2fg"] Jun 15 08:22:31.560618 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgkn\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.560827 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.560818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.661689 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.661689 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlclm\" (UniqueName: \"kubernetes.io/projected/15b635b1-53e0-481b-bb2b-6b9118544f63-kube-api-access-wlclm\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xcq\" (UniqueName: \"kubernetes.io/projected/7a088634-715a-406b-b35f-34ef31ad811e-kube-api-access-r8xcq\") pod \"network-check-source-6947749cfc-4vxgr\" (UID: \"7a088634-715a-406b-b35f-34ef31ad811e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-default-certificate\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.661915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxt2x\" (UniqueName: \"kubernetes.io/projected/c71746ed-4290-4b34-8b8a-cdce86159b5b-kube-api-access-dxt2x\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c71746ed-4290-4b34-8b8a-cdce86159b5b-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.661984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgkn\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w7g2\" (UniqueName: \"kubernetes.io/projected/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-kube-api-access-2w7g2\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c71746ed-4290-4b34-8b8a-cdce86159b5b-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.662175 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:22:31.662201 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.662193 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58cdbc9f4f-gcw6d: secret "image-registry-tls" not found Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-stats-auth\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.662264 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls podName:b1e0bc11-d5b3-45df-839d-fe0f182c617c nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.16224286 +0000 UTC m=+237.427862831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls") pod "image-registry-58cdbc9f4f-gcw6d" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c") : secret "image-registry-tls" not found Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.662646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.663003 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.662987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.664228 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.664190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.664440 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.664424 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.672520 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.672494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.672637 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.672620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgkn\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:31.674070 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.674049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:31.731201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.731159 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:31.763041 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w7g2\" (UniqueName: \"kubernetes.io/projected/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-kube-api-access-2w7g2\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.763155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c71746ed-4290-4b34-8b8a-cdce86159b5b-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.763155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-stats-auth\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.763155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.763320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlclm\" (UniqueName: \"kubernetes.io/projected/15b635b1-53e0-481b-bb2b-6b9118544f63-kube-api-access-wlclm\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.763320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xcq\" (UniqueName: \"kubernetes.io/projected/7a088634-715a-406b-b35f-34ef31ad811e-kube-api-access-r8xcq\") pod \"network-check-source-6947749cfc-4vxgr\" (UID: \"7a088634-715a-406b-b35f-34ef31ad811e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" Jun 15 08:22:31.763320 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.763210 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 08:22:31.763320 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.763288 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls podName:15b635b1-53e0-481b-bb2b-6b9118544f63 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.263269392 +0000 UTC m=+237.528889355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5zf75" (UID: "15b635b1-53e0-481b-bb2b-6b9118544f63") : secret "samples-operator-tls" not found Jun 15 08:22:31.763504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-default-certificate\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.763504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.763504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxt2x\" (UniqueName: \"kubernetes.io/projected/c71746ed-4290-4b34-8b8a-cdce86159b5b-kube-api-access-dxt2x\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.763504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c71746ed-4290-4b34-8b8a-cdce86159b5b-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.763687 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.763687 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.763558 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.263540097 +0000 UTC m=+237.529160059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:31.763687 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.763642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c71746ed-4290-4b34-8b8a-cdce86159b5b-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.763808 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.763707 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 08:22:31.763808 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:31.763750 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.263735918 +0000 UTC m=+237.529355867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : secret "router-metrics-certs-default" not found Jun 15 08:22:31.765543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.765514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c71746ed-4290-4b34-8b8a-cdce86159b5b-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.765640 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.765575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-stats-auth\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.765640 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.765604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-default-certificate\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.773291 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.773271 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w7g2\" (UniqueName: \"kubernetes.io/projected/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-kube-api-access-2w7g2\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:31.773421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.773403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlclm\" (UniqueName: \"kubernetes.io/projected/15b635b1-53e0-481b-bb2b-6b9118544f63-kube-api-access-wlclm\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:31.773531 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.773514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxt2x\" (UniqueName: \"kubernetes.io/projected/c71746ed-4290-4b34-8b8a-cdce86159b5b-kube-api-access-dxt2x\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7nb7f\" (UID: \"c71746ed-4290-4b34-8b8a-cdce86159b5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.773739 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.773719 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xcq\" (UniqueName: \"kubernetes.io/projected/7a088634-715a-406b-b35f-34ef31ad811e-kube-api-access-r8xcq\") pod \"network-check-source-6947749cfc-4vxgr\" (UID: \"7a088634-715a-406b-b35f-34ef31ad811e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" Jun 15 08:22:31.823467 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.823444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" Jun 15 08:22:31.828764 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.828747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" Jun 15 08:22:31.952636 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.952603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr"] Jun 15 08:22:31.955758 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:22:31.955728 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a088634_715a_406b_b35f_34ef31ad811e.slice/crio-05b7e46c83e0f5a429200e313f62d74489670767a6efece5cb036d46bf291ee1 WatchSource:0}: Error finding container 05b7e46c83e0f5a429200e313f62d74489670767a6efece5cb036d46bf291ee1: Status 404 returned error can't find the container with id 05b7e46c83e0f5a429200e313f62d74489670767a6efece5cb036d46bf291ee1 Jun 15 08:22:31.968016 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:31.967994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f"] Jun 15 08:22:31.970716 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:22:31.970688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71746ed_4290_4b34_8b8a_cdce86159b5b.slice/crio-5d977d65b990f34790938ba9a22bc4ccad1bf22b16705d68d75e927c96588f6f WatchSource:0}: Error finding container 5d977d65b990f34790938ba9a22bc4ccad1bf22b16705d68d75e927c96588f6f: Status 404 returned error can't find the container with id 5d977d65b990f34790938ba9a22bc4ccad1bf22b16705d68d75e927c96588f6f Jun 15 08:22:32.166476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.166440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:32.166637 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.166590 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:22:32.166637 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.166611 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58cdbc9f4f-gcw6d: secret "image-registry-tls" not found Jun 15 08:22:32.166711 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.166666 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls podName:b1e0bc11-d5b3-45df-839d-fe0f182c617c nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.16664881 +0000 UTC m=+238.432268762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls") pod "image-registry-58cdbc9f4f-gcw6d" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c") : secret "image-registry-tls" not found Jun 15 08:22:32.267232 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.267190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:32.267411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.267242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:32.267411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.267322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:32.267411 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.267356 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.267339129 +0000 UTC m=+238.532959080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:32.267529 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.267416 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 08:22:32.267529 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.267476 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.267460133 +0000 UTC m=+238.533080084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : secret "router-metrics-certs-default" not found Jun 15 08:22:32.267529 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.267485 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 08:22:32.267529 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:32.267517 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls podName:15b635b1-53e0-481b-bb2b-6b9118544f63 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.267508533 +0000 UTC m=+238.533128484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5zf75" (UID: "15b635b1-53e0-481b-bb2b-6b9118544f63") : secret "samples-operator-tls" not found Jun 15 08:22:32.937238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.937201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" event={"ID":"7a088634-715a-406b-b35f-34ef31ad811e","Type":"ContainerStarted","Data":"a560b73b180cd6ea478b00315614abf0b2446ed96a2503e70709442d19a74570"} Jun 15 08:22:32.937699 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.937263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" event={"ID":"7a088634-715a-406b-b35f-34ef31ad811e","Type":"ContainerStarted","Data":"05b7e46c83e0f5a429200e313f62d74489670767a6efece5cb036d46bf291ee1"} Jun 15 08:22:32.938777 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:32.938746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" event={"ID":"c71746ed-4290-4b34-8b8a-cdce86159b5b","Type":"ContainerStarted","Data":"5d977d65b990f34790938ba9a22bc4ccad1bf22b16705d68d75e927c96588f6f"} Jun 15 08:22:33.175529 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:33.175490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:33.175716 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.175639 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:22:33.175716 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.175658 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58cdbc9f4f-gcw6d: secret "image-registry-tls" not found Jun 15 08:22:33.175828 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.175718 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls podName:b1e0bc11-d5b3-45df-839d-fe0f182c617c nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.175700699 +0000 UTC m=+240.441320650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls") pod "image-registry-58cdbc9f4f-gcw6d" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c") : secret "image-registry-tls" not found Jun 15 08:22:33.276162 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:33.276083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:33.276162 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:33.276139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:33.276342 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:33.276173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:33.276342 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.276236 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 08:22:33.276342 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.276297 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 08:22:33.276342 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.276300 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls podName:15b635b1-53e0-481b-bb2b-6b9118544f63 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.27628197 +0000 UTC m=+240.541901938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5zf75" (UID: "15b635b1-53e0-481b-bb2b-6b9118544f63") : secret "samples-operator-tls" not found Jun 15 08:22:33.276342 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.276338 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.276328267 +0000 UTC m=+240.541948215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:33.276518 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:33.276350 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.27634278 +0000 UTC m=+240.541962728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : secret "router-metrics-certs-default" not found Jun 15 08:22:34.256612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:34.256575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:34.320113 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:34.320072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:34.950641 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:34.950604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" event={"ID":"c71746ed-4290-4b34-8b8a-cdce86159b5b","Type":"ContainerStarted","Data":"3693b12611723a50e0349169d0b62181f68549a2b532fddf3f091ca84d39fb7d"} Jun 15 08:22:34.966923 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:34.966877 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4vxgr" podStartSLOduration=3.96684904 podStartE2EDuration="3.96684904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:32.952166542 +0000 UTC m=+238.217786716" watchObservedRunningTime="2026-06-15 08:22:34.96684904 +0000 UTC m=+240.232469016" Jun 15 08:22:34.967184 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:34.967156 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" podStartSLOduration=1.352939351 podStartE2EDuration="3.967150427s" totalImagesPullingTime="2.614211076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:34.965644113 +0000 UTC m=+240.231264080" watchObservedRunningTime="2026-06-15 08:22:34.967150427 +0000 UTC m=+240.232770415" Jun 15 08:22:35.193290 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.193248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:35.193473 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.193372 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:22:35.193473 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.193392 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58cdbc9f4f-gcw6d: secret "image-registry-tls" not found Jun 15 08:22:35.193473 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.193468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls podName:b1e0bc11-d5b3-45df-839d-fe0f182c617c nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.193448205 +0000 UTC m=+244.459068160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls") pod "image-registry-58cdbc9f4f-gcw6d" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c") : secret "image-registry-tls" not found Jun 15 08:22:35.294285 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.294194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:35.294285 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.294233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.294292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.294364 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.294342712 +0000 UTC m=+244.559962662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.294394 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.294402 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.294437 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls podName:15b635b1-53e0-481b-bb2b-6b9118544f63 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.29442119 +0000 UTC m=+244.560041143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5zf75" (UID: "15b635b1-53e0-481b-bb2b-6b9118544f63") : secret "samples-operator-tls" not found Jun 15 08:22:35.294763 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:35.294458 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.294445539 +0000 UTC m=+244.560065503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : secret "router-metrics-certs-default" not found Jun 15 08:22:35.791461 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.791430 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:35.868768 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.868732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:35.940937 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:35.940909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:36.657232 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.657200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:36.712294 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.712265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:36.822009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.821977 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5fh7f"] Jun 15 08:22:36.825155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.825130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.827515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.827487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vh8jv\"" Jun 15 08:22:36.827515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.827506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 08:22:36.827664 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.827617 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 08:22:36.827664 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.827624 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 08:22:36.828335 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.828320 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 08:22:36.839202 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.839179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5fh7f"] Jun 15 08:22:36.855686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.855664 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:36.909009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.908949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f1ac1c-a8a1-4a29-9476-66b5611847e3-crio-socket\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.909009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.908993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.909009 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.909010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f1ac1c-a8a1-4a29-9476-66b5611847e3-data-volume\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.909165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.909030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rb5m\" (UniqueName: \"kubernetes.io/projected/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-api-access-6rb5m\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.909165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.909047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:36.917997 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:36.917976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:37.010282 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f1ac1c-a8a1-4a29-9476-66b5611847e3-crio-socket\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f1ac1c-a8a1-4a29-9476-66b5611847e3-data-volume\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rb5m\" (UniqueName: \"kubernetes.io/projected/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-api-access-6rb5m\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f1ac1c-a8a1-4a29-9476-66b5611847e3-crio-socket\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.010457 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.010393 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:37.010752 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.010479 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:37.510460656 +0000 UTC m=+242.776080606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : configmap "kube-rbac-proxy" not found Jun 15 08:22:37.010752 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.010503 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.010752 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.010542 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:37.510531316 +0000 UTC m=+242.776151277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.010752 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.010625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f1ac1c-a8a1-4a29-9476-66b5611847e3-data-volume\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.020775 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.020756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rb5m\" (UniqueName: \"kubernetes.io/projected/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-api-access-6rb5m\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.360674 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.360646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:37.460446 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.460414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:37.514598 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.514568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.514746 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:37.514602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:37.514746 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.514687 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:37.514832 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.514757 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:38.514741845 +0000 UTC m=+243.780361794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : configmap "kube-rbac-proxy" not found Jun 15 08:22:37.514832 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.514768 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.514832 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:37.514823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:38.514806868 +0000 UTC m=+243.780426832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:38.274399 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.274367 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:38.375582 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.375550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:38.524243 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.524205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:38.524394 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.524253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:38.524394 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:38.524323 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:38.524394 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:38.524376 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:38.524565 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:38.524424 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:40.524408647 +0000 UTC m=+245.790028594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : configmap "kube-rbac-proxy" not found Jun 15 08:22:38.524565 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:38.524439 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:40.524432891 +0000 UTC m=+245.790052838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:38.956875 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.956840 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-c85km"] Jun 15 08:22:38.959894 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.959879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:38.962160 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.962125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 08:22:38.962160 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.962125 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nmzmf\"" Jun 15 08:22:38.963061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.963045 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 08:22:38.963183 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.963080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 08:22:38.963183 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.963123 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 08:22:38.968245 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.968226 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-c85km"] Jun 15 08:22:38.993282 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:38.993252 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:39.047317 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.047289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:39.129858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.129833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-cabundle\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.129969 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.129881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-key\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.130033 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.129986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dnq\" (UniqueName: \"kubernetes.io/projected/1e859063-3a30-4879-bd55-087b0ab1b3c2-kube-api-access-c5dnq\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.230538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.230460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dnq\" (UniqueName: \"kubernetes.io/projected/1e859063-3a30-4879-bd55-087b0ab1b3c2-kube-api-access-c5dnq\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.230538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.230526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-cabundle\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.230742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.230546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-key\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.230742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.230592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:39.230742 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.230688 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:22:39.230742 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.230699 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58cdbc9f4f-gcw6d: secret "image-registry-tls" not found Jun 15 08:22:39.230949 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.230747 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls podName:b1e0bc11-d5b3-45df-839d-fe0f182c617c nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.230729747 +0000 UTC m=+252.496349714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls") pod "image-registry-58cdbc9f4f-gcw6d" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c") : secret "image-registry-tls" not found Jun 15 08:22:39.231308 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.231290 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-cabundle\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.232914 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.232896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e859063-3a30-4879-bd55-087b0ab1b3c2-signing-key\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.239206 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.239183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dnq\" (UniqueName: \"kubernetes.io/projected/1e859063-3a30-4879-bd55-087b0ab1b3c2-kube-api-access-c5dnq\") pod \"service-ca-7b994bc59-c85km\" (UID: \"1e859063-3a30-4879-bd55-087b0ab1b3c2\") " pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.269650 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.269612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-c85km" Jun 15 08:22:39.332208 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.332148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:39.332938 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.332914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:39.332993 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.332976 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.332932395 +0000 UTC m=+252.598552345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:39.332993 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.332983 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 08:22:39.333072 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.333025 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.333014097 +0000 UTC m=+252.598634045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : secret "router-metrics-certs-default" not found Jun 15 08:22:39.333142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.333130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:39.333236 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.333227 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 08:22:39.333271 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:39.333263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls podName:15b635b1-53e0-481b-bb2b-6b9118544f63 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.333252005 +0000 UTC m=+252.598871959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5zf75" (UID: "15b635b1-53e0-481b-bb2b-6b9118544f63") : secret "samples-operator-tls" not found Jun 15 08:22:39.391333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.391300 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-c85km"] Jun 15 08:22:39.394729 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:22:39.394707 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e859063_3a30_4879_bd55_087b0ab1b3c2.slice/crio-9f6921669135a533a14fcfe848d99be6c6f837827eadaddc8eef366d2ec54e1f WatchSource:0}: Error finding container 9f6921669135a533a14fcfe848d99be6c6f837827eadaddc8eef366d2ec54e1f: Status 404 returned error can't find the container with id 9f6921669135a533a14fcfe848d99be6c6f837827eadaddc8eef366d2ec54e1f Jun 15 08:22:39.409495 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.409479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqdtl_5273e8f5-cc36-4d0f-b3aa-703c939dd650/dns-node-resolver/0.log" Jun 15 08:22:39.967049 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:39.967010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-c85km" event={"ID":"1e859063-3a30-4879-bd55-087b0ab1b3c2","Type":"ContainerStarted","Data":"9f6921669135a533a14fcfe848d99be6c6f837827eadaddc8eef366d2ec54e1f"} Jun 15 08:22:40.095472 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:40.095442 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:40.410214 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:40.410147 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cqbv7_287d5ac4-6d9a-4c70-94ea-1a03da6bd642/node-ca/0.log" Jun 15 08:22:40.542307 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:40.542275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:40.542459 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:40.542317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:40.542459 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:40.542402 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:40.542459 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:40.542438 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:40.542549 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:40.542468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:44.542453313 +0000 UTC m=+249.808073265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : configmap "kube-rbac-proxy" not found Jun 15 08:22:40.542549 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:40.542485 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:44.542477072 +0000 UTC m=+249.808097020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:41.410933 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:41.410849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d9pbc_96724c47-bd66-4551-aaee-79a1f426be4e/serve-healthcheck-canary/0.log" Jun 15 08:22:41.974795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:41.974756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-c85km" event={"ID":"1e859063-3a30-4879-bd55-087b0ab1b3c2","Type":"ContainerStarted","Data":"001cf621851a7de06b6b2eef224b3c402c2126110c664baa2069889ba5d54aeb"} Jun 15 08:22:41.991352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:41.991310 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-c85km" podStartSLOduration=2.349425277 podStartE2EDuration="3.991295044s" totalImagesPullingTime="1.641869767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:41.990063785 +0000 UTC m=+247.255683754" watchObservedRunningTime="2026-06-15 08:22:41.991295044 +0000 UTC m=+247.256915016" Jun 15 08:22:42.230254 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.230176 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7nb7f_c71746ed-4290-4b34-8b8a-cdce86159b5b/kube-storage-version-migrator-operator/0.log" Jun 15 08:22:42.316193 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.316154 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:42.417264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.417227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:42.539787 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.539671 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:42.637459 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.637414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:42.739659 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.739623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:42.895563 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:42.895487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:43.090820 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:43.090779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:43.206913 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:43.206885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:43.403589 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:43.403561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:44.416965 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:44.416935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:44.581422 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:44.581391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:44.581586 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:44.581430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:44.581586 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:44.581523 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:44.581688 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:44.581600 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:52.581579262 +0000 UTC m=+257.847199224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : configmap "kube-rbac-proxy" not found Jun 15 08:22:44.581688 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:44.581526 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:44.581688 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:44.581653 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls podName:93f1ac1c-a8a1-4a29-9476-66b5611847e3 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:52.581641543 +0000 UTC m=+257.847261490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5fh7f" (UID: "93f1ac1c-a8a1-4a29-9476-66b5611847e3") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:44.651493 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:44.651461 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:44.796999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:44.796969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:45.205433 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:45.205407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:45.810938 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:45.810912 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:46.003622 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:46.003589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:46.196191 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:46.196161 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:46.395393 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:46.395359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:46.599094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:46.599015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:46.791013 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:46.790981 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:47.001642 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.001614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:22:47.002107 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:47.001747 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:22:47.002107 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:47.001809 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs podName:fa0a4420-accc-4ebf-80b1-2440a419320f nodeName:}" failed. No retries permitted until 2026-06-15 08:24:49.001790506 +0000 UTC m=+374.267410455 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs") pod "network-metrics-daemon-82dnt" (UID: "fa0a4420-accc-4ebf-80b1-2440a419320f") : secret "metrics-daemon-secret" not found Jun 15 08:22:47.002107 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.001978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:47.303997 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.303917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:47.306185 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.306155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"image-registry-58cdbc9f4f-gcw6d\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:47.326403 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.326383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm97c\"" Jun 15 08:22:47.335327 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.335307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:47.405646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.405452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:47.405646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.405518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:47.405646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.405610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:47.405898 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:22:47.405694 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle podName:fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:03.40566751 +0000 UTC m=+268.671287476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle") pod "router-default-5d5fb9cfcd-dk2fg" (UID: "fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49") : configmap references non-existent config key: service-ca.crt Jun 15 08:22:47.408716 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.408654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15b635b1-53e0-481b-bb2b-6b9118544f63-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5zf75\" (UID: \"15b635b1-53e0-481b-bb2b-6b9118544f63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:47.409565 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.409518 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-metrics-certs\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:22:47.439340 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.439315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wrhs7\"" Jun 15 08:22:47.447420 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.447399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" Jun 15 08:22:47.471584 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.471562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:22:47.474479 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:22:47.474453 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e0bc11_d5b3_45df_839d_fe0f182c617c.slice/crio-9914fad02dd3dc4b099f4b37a357828e88fad4262489df61756d955c6330bed4 WatchSource:0}: Error finding container 9914fad02dd3dc4b099f4b37a357828e88fad4262489df61756d955c6330bed4: Status 404 returned error can't find the container with id 9914fad02dd3dc4b099f4b37a357828e88fad4262489df61756d955c6330bed4 Jun 15 08:22:47.574524 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.574386 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75"] Jun 15 08:22:47.993223 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.993192 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" event={"ID":"b1e0bc11-d5b3-45df-839d-fe0f182c617c","Type":"ContainerStarted","Data":"0c80fff4794a2c4becdec21bb62720a00663b4d65e36c1cbc231bfad1a459a07"} Jun 15 08:22:47.993382 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.993242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" event={"ID":"b1e0bc11-d5b3-45df-839d-fe0f182c617c","Type":"ContainerStarted","Data":"9914fad02dd3dc4b099f4b37a357828e88fad4262489df61756d955c6330bed4"} Jun 15 08:22:47.993382 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.993310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:22:47.994418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.994397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" event={"ID":"15b635b1-53e0-481b-bb2b-6b9118544f63","Type":"ContainerStarted","Data":"002b2675cebfd3d7bed849ca5ff9bf1bad840e6587ee50994ac33f4d63f21498"} Jun 15 08:22:47.998130 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:47.998111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:48.012258 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:48.012221 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" podStartSLOduration=17.012208425 podStartE2EDuration="17.012208425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:48.011932992 +0000 UTC m=+253.277552965" watchObservedRunningTime="2026-06-15 08:22:48.012208425 +0000 UTC m=+253.277828394" Jun 15 08:22:48.204209 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:48.204176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:48.597968 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:48.597931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:48.818202 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:48.818163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:48.946983 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:48.946934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:49.047153 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:49.047116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:49.210486 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:49.210339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:49.799346 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:49.799253 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:50.002541 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.002504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" event={"ID":"15b635b1-53e0-481b-bb2b-6b9118544f63","Type":"ContainerStarted","Data":"7318ae3131469e9daf3b6c97f99fe189351c3e5c28e13dc33455d428de640afc"} Jun 15 08:22:50.002691 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.002557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" event={"ID":"15b635b1-53e0-481b-bb2b-6b9118544f63","Type":"ContainerStarted","Data":"d13fc5dcbe76a9f89e51351777db61b56464626a5682562e3985165767077508"} Jun 15 08:22:50.019191 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.019139 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5zf75" podStartSLOduration=17.301019213 podStartE2EDuration="19.019122134s" totalImagesPullingTime="1.718102921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:50.019070055 +0000 UTC m=+255.284690046" watchObservedRunningTime="2026-06-15 08:22:50.019122134 +0000 UTC m=+255.284742106" Jun 15 08:22:50.201693 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.201662 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:50.602081 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.601989 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:50.996242 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:50.996210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:51.399307 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:51.399210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:51.463280 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:51.463242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:51.796122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:51.796094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:52.209339 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.209311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:52.597293 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.597211 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:52.650198 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.650168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:52.650348 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.650207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:52.650670 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.650650 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f1ac1c-a8a1-4a29-9476-66b5611847e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:52.652432 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.652414 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f1ac1c-a8a1-4a29-9476-66b5611847e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5fh7f\" (UID: \"93f1ac1c-a8a1-4a29-9476-66b5611847e3\") " pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:52.733098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.733067 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5fh7f" Jun 15 08:22:52.796999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.796923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:52.854768 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:52.854696 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5fh7f"] Jun 15 08:22:52.857988 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:22:52.857959 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f1ac1c_a8a1_4a29_9476_66b5611847e3.slice/crio-e4ddd29d89a09fdb2ad23ed05ce7b2129722294be4c20290fcf9f0675b308851 WatchSource:0}: Error finding container e4ddd29d89a09fdb2ad23ed05ce7b2129722294be4c20290fcf9f0675b308851: Status 404 returned error can't find the container with id e4ddd29d89a09fdb2ad23ed05ce7b2129722294be4c20290fcf9f0675b308851 Jun 15 08:22:53.001428 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:53.001390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:53.013177 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:53.013147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fh7f" event={"ID":"93f1ac1c-a8a1-4a29-9476-66b5611847e3","Type":"ContainerStarted","Data":"e4ddd29d89a09fdb2ad23ed05ce7b2129722294be4c20290fcf9f0675b308851"} Jun 15 08:22:55.762755 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:55.762682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:55.813929 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:55.813889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:57.027904 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.027879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fh7f" event={"ID":"93f1ac1c-a8a1-4a29-9476-66b5611847e3","Type":"ContainerStarted","Data":"33d68ff189f65edd83a3286b976051e1c7cece0f9c20586b2b7b03174390f37a"} Jun 15 08:22:57.028251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.027956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fh7f" event={"ID":"93f1ac1c-a8a1-4a29-9476-66b5611847e3","Type":"ContainerStarted","Data":"d91fc5dbb7c3d1183a9ecf8afcbb1e70613ba7daa805537cf4a5f2b2a9f3db20"} Jun 15 08:22:57.260590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.260511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:57.362090 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.362060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:57.413695 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.413667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:57.563451 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.563378 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:57.737979 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:57.737944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:58.139246 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:58.139209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:58.218652 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:58.218617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:58.342744 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:58.342716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:58.405600 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:58.405527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:58.943514 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:58.943484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:59.035426 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:59.035399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5fh7f" event={"ID":"93f1ac1c-a8a1-4a29-9476-66b5611847e3","Type":"ContainerStarted","Data":"ca5900d5b17cf5238efc680a17e76d815de38efc7e5271d6f5beeb407c06d8bb"} Jun 15 08:22:59.052477 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:59.052433 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5fh7f" podStartSLOduration=17.073527382 podStartE2EDuration="23.052420827s" totalImagesPullingTime="5.978893445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:22:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:59.051007366 +0000 UTC m=+264.316627336" watchObservedRunningTime="2026-06-15 08:22:59.052420827 +0000 UTC m=+264.318040796" Jun 15 08:22:59.147913 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:59.147883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:59.564421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:59.564386 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:22:59.961346 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:22:59.961313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:01.054491 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.054465 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:23:01.055394 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.055371 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-27mbf"] Jun 15 08:23:01.058103 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.058085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:01.060400 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.060380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b9s6f\"" Jun 15 08:23:01.060513 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.060414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 08:23:01.060513 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.060447 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 08:23:01.070213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.070192 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-27mbf"] Jun 15 08:23:01.118886 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.118833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2sfl\" (UniqueName: \"kubernetes.io/projected/276010f8-5e47-40d4-81d1-8e70753a137d-kube-api-access-b2sfl\") pod \"downloads-694c955b9-27mbf\" (UID: \"276010f8-5e47-40d4-81d1-8e70753a137d\") " pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:01.132628 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.132596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:01.218939 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.218910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:01.219219 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.219204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2sfl\" (UniqueName: \"kubernetes.io/projected/276010f8-5e47-40d4-81d1-8e70753a137d-kube-api-access-b2sfl\") pod \"downloads-694c955b9-27mbf\" (UID: \"276010f8-5e47-40d4-81d1-8e70753a137d\") " pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:01.227507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.227482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2sfl\" (UniqueName: \"kubernetes.io/projected/276010f8-5e47-40d4-81d1-8e70753a137d-kube-api-access-b2sfl\") pod \"downloads-694c955b9-27mbf\" (UID: \"276010f8-5e47-40d4-81d1-8e70753a137d\") " pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:01.367658 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.367596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:01.492774 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:01.492743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-27mbf"] Jun 15 08:23:01.496225 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:01.496199 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276010f8_5e47_40d4_81d1_8e70753a137d.slice/crio-9d0a358bdc10b2140e948516bb3365a16ea7ea8ae8815acae0a0c36ff30732de WatchSource:0}: Error finding container 9d0a358bdc10b2140e948516bb3365a16ea7ea8ae8815acae0a0c36ff30732de: Status 404 returned error can't find the container with id 9d0a358bdc10b2140e948516bb3365a16ea7ea8ae8815acae0a0c36ff30732de Jun 15 08:23:02.047207 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:02.047166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-27mbf" event={"ID":"276010f8-5e47-40d4-81d1-8e70753a137d","Type":"ContainerStarted","Data":"9d0a358bdc10b2140e948516bb3365a16ea7ea8ae8815acae0a0c36ff30732de"} Jun 15 08:23:03.435637 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:03.435606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:03.436274 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:03.436255 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49-service-ca-bundle\") pod \"router-default-5d5fb9cfcd-dk2fg\" (UID: \"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49\") " pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:03.643289 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:03.643256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rjvlc\"" Jun 15 08:23:03.652080 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:03.652060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:03.779758 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:03.779724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d5fb9cfcd-dk2fg"] Jun 15 08:23:03.783400 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:03.783348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe67cfa0_81ce_45cf_afd5_0eafaa1f5b49.slice/crio-3ccf01b8573d0c23aef1da934e0994cb429527a6a890634b0d62e7f16249f9bb WatchSource:0}: Error finding container 3ccf01b8573d0c23aef1da934e0994cb429527a6a890634b0d62e7f16249f9bb: Status 404 returned error can't find the container with id 3ccf01b8573d0c23aef1da934e0994cb429527a6a890634b0d62e7f16249f9bb Jun 15 08:23:04.055795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:04.055710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" event={"ID":"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49","Type":"ContainerStarted","Data":"5ec6d28743f0e3809123b483d13d34aa9ec8eda541c7fb9421b0eb395c8f9b6d"} Jun 15 08:23:04.055795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:04.055768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" event={"ID":"fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49","Type":"ContainerStarted","Data":"3ccf01b8573d0c23aef1da934e0994cb429527a6a890634b0d62e7f16249f9bb"} Jun 15 08:23:04.073041 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:04.072903 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" podStartSLOduration=33.072885546 podStartE2EDuration="33.072885546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:04.07212551 +0000 UTC m=+269.337745501" watchObservedRunningTime="2026-06-15 08:23:04.072885546 +0000 UTC m=+269.338505521" Jun 15 08:23:04.652558 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:04.652522 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:04.655421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:04.655399 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:05.060127 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:05.060094 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:05.061301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:05.061282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d5fb9cfcd-dk2fg" Jun 15 08:23:05.378032 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:05.377944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:05.433616 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:05.433585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:06.176948 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:06.176881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:06.275926 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:06.275893 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:06.343943 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:06.343887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:06.890374 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:06.890323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:10.367479 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:10.367447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:10.464020 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:10.463991 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:10.752066 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:10.752029 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:11.059858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:11.059776 2564 patch_prober.go:28] interesting pod/image-registry-58cdbc9f4f-gcw6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 08:23:11.059858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:11.059831 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 08:23:13.525771 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:13.525729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:13.972599 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:13.972566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:14.032658 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:14.032616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:14.172172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:14.172095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:14.226881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:14.226833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:15.539687 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.539648 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:15.712656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.712623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:15.765466 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.765437 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-448nd"] Jun 15 08:23:15.770372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.770349 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl"] Jun 15 08:23:15.770501 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.770443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.772660 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.772636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 08:23:15.772937 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.772916 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 08:23:15.773630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.773173 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 08:23:15.773630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.773319 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 08:23:15.773630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.773438 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 08:23:15.773630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.773190 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 08:23:15.773630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.773305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5hrr\"" Jun 15 08:23:15.774320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.774303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.778234 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.776991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 08:23:15.778234 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.778174 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl"] Jun 15 08:23:15.778391 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.778371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t6zxz\"" Jun 15 08:23:15.778706 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.778689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 08:23:15.778817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.778796 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 08:23:15.795380 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.795306 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:15.831591 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-sys\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.831719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66jh\" (UniqueName: \"kubernetes.io/projected/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-api-access-k66jh\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-textfile\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.831719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b7de6b8-aaed-416d-a783-d7024da7e41e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bmp5\" (UniqueName: \"kubernetes.io/projected/812a7c6f-aff4-4a65-866d-f51fcd49ba22-kube-api-access-8bmp5\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.831998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.831982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-root\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.832301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.832028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-metrics-client-ca\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.832301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.832060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-accelerators-collector-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.832301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.832110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-wtmp\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.869184 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.869157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:15.933448 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-sys\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66jh\" (UniqueName: \"kubernetes.io/projected/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-api-access-k66jh\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-textfile\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b7de6b8-aaed-416d-a783-d7024da7e41e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bmp5\" (UniqueName: \"kubernetes.io/projected/812a7c6f-aff4-4a65-866d-f51fcd49ba22-kube-api-access-8bmp5\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-root\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-metrics-client-ca\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.933785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-accelerators-collector-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-wtmp\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-wtmp\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.933943 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-sys\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:15.934046 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:15.934109 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls podName:1b7de6b8-aaed-416d-a783-d7024da7e41e nodeName:}" failed. No retries permitted until 2026-06-15 08:23:16.43409257 +0000 UTC m=+281.699712519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-4z6bl" (UID: "1b7de6b8-aaed-416d-a783-d7024da7e41e") : secret "kube-state-metrics-tls" not found Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b7de6b8-aaed-416d-a783-d7024da7e41e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-textfile\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:15.934456 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:15.934506 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls podName:812a7c6f-aff4-4a65-866d-f51fcd49ba22 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:16.434491637 +0000 UTC m=+281.700111593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls") pod "node-exporter-448nd" (UID: "812a7c6f-aff4-4a65-866d-f51fcd49ba22") : secret "node-exporter-tls" not found Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7de6b8-aaed-416d-a783-d7024da7e41e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-metrics-client-ca\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/812a7c6f-aff4-4a65-866d-f51fcd49ba22-root\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.935366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.934938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-accelerators-collector-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.937343 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.937322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.937834 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.937807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:15.945756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.945713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bmp5\" (UniqueName: \"kubernetes.io/projected/812a7c6f-aff4-4a65-866d-f51fcd49ba22-kube-api-access-8bmp5\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:15.945906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:15.945788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66jh\" (UniqueName: \"kubernetes.io/projected/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-api-access-k66jh\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:16.105213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.105106 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.194237 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.194177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.253274 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.253248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.437906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.437852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:16.438078 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.437935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:16.440594 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.440567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/812a7c6f-aff4-4a65-866d-f51fcd49ba22-node-exporter-tls\") pod \"node-exporter-448nd\" (UID: \"812a7c6f-aff4-4a65-866d-f51fcd49ba22\") " pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:16.440694 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.440659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b7de6b8-aaed-416d-a783-d7024da7e41e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4z6bl\" (UID: \"1b7de6b8-aaed-416d-a783-d7024da7e41e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:16.447937 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.447910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.670419 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.670389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.685355 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.685294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-448nd" Jun 15 08:23:16.692297 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.692277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" Jun 15 08:23:16.771173 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.771145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.807161 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.807135 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:23:16.810724 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.810700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.813016 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.812991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 08:23:16.813145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813059 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 08:23:16.813145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813116 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 08:23:16.813301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.812991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 08:23:16.813301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813250 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 08:23:16.813476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813356 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pkdc9\"" Jun 15 08:23:16.813886 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 08:23:16.813886 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.813667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 08:23:16.814172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.814155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 08:23:16.825824 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.825030 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 08:23:16.827020 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.827000 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:23:16.830929 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.830908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.902834 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.902806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:16.941966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.941887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.941966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.941945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.941992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khjll\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:16.942538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:16.942314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043407 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khjll\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.043808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.043683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.044176 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.044091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.044176 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.044148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.044278 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.044191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.044374 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.044346 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.045306 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.045257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.046616 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.046491 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.046720 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.046645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.046989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.046944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.046989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.046983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.047156 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.047133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.047340 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.047314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.047618 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.047576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.048525 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.048506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.049073 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.049050 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.052415 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.052396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khjll\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll\") pod \"alertmanager-main-0\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.127321 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.127293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:23:17.561076 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.561043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:17.564185 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.564164 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.566512 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.566489 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 08:23:17.566618 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.566558 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8b8vt\"" Jun 15 08:23:17.567607 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.567586 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 08:23:17.567707 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.567630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 08:23:17.567707 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.567644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 08:23:17.567707 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.567596 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 08:23:17.571849 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.571827 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 08:23:17.574811 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.574790 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:17.650018 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.649989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.650333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.650287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcx2\" (UniqueName: \"kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.711477 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:17.711442 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cdqbq" podUID="41c1893c-ac8e-442e-bb13-902f9d138ca7" Jun 15 08:23:17.751329 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcx2\" (UniqueName: \"kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751453 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751453 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751453 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751453 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751677 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.751677 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.751490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.752226 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.752203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.752366 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.752345 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.752436 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.752386 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.752537 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.752520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.754168 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.754143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.754288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.754240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.758822 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.758800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcx2\" (UniqueName: \"kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2\") pod \"console-86f87ff778-d65wr\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:17.875947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:17.875857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:18.103567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:18.103535 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:18.716595 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:18.716561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:18.819796 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:18.819766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:19.111094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.111001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-448nd" event={"ID":"812a7c6f-aff4-4a65-866d-f51fcd49ba22","Type":"ContainerStarted","Data":"2402741fbc5c92a505392a077b51d6b591b25d652f7068316731ecc0a379d90f"} Jun 15 08:23:19.118117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.117960 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:19.155591 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.155333 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:23:19.158266 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:19.158223 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6d4a00_48fc_4352_88a5_41df5014ee2e.slice/crio-578db16ac74c5f4c90eef8fde8ed88c3a23813a0cc530113189e6e06b824fcb2 WatchSource:0}: Error finding container 578db16ac74c5f4c90eef8fde8ed88c3a23813a0cc530113189e6e06b824fcb2: Status 404 returned error can't find the container with id 578db16ac74c5f4c90eef8fde8ed88c3a23813a0cc530113189e6e06b824fcb2 Jun 15 08:23:19.170906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.170887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:19.173323 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:19.173302 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1f06de_eed0_409a_9f17_45e21471099d.slice/crio-71b3bdd498b0cc765e2b526465f22705b6229784ad5f33f0c4b57f1d9217bcfd WatchSource:0}: Error finding container 71b3bdd498b0cc765e2b526465f22705b6229784ad5f33f0c4b57f1d9217bcfd: Status 404 returned error can't find the container with id 71b3bdd498b0cc765e2b526465f22705b6229784ad5f33f0c4b57f1d9217bcfd Jun 15 08:23:19.181903 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.181878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl"] Jun 15 08:23:19.184559 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:19.184524 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7de6b8_aaed_416d_a783_d7024da7e41e.slice/crio-4cbeed349c38cd12e223062b4e63aa125223389e3b091a8d136ff0b6197267dc WatchSource:0}: Error finding container 4cbeed349c38cd12e223062b4e63aa125223389e3b091a8d136ff0b6197267dc: Status 404 returned error can't find the container with id 4cbeed349c38cd12e223062b4e63aa125223389e3b091a8d136ff0b6197267dc Jun 15 08:23:19.291762 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:19.291677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:20.118022 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.117928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" event={"ID":"1b7de6b8-aaed-416d-a783-d7024da7e41e","Type":"ContainerStarted","Data":"4cbeed349c38cd12e223062b4e63aa125223389e3b091a8d136ff0b6197267dc"} Jun 15 08:23:20.120795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.120284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-27mbf" event={"ID":"276010f8-5e47-40d4-81d1-8e70753a137d","Type":"ContainerStarted","Data":"b1151fb27218073f6b10ac54b4c77a13e11a9f591cd3662d3adb783da37b2c6f"} Jun 15 08:23:20.120795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.120656 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:20.125538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.125452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"578db16ac74c5f4c90eef8fde8ed88c3a23813a0cc530113189e6e06b824fcb2"} Jun 15 08:23:20.130402 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.130374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f87ff778-d65wr" event={"ID":"ba1f06de-eed0-409a-9f17-45e21471099d","Type":"ContainerStarted","Data":"71b3bdd498b0cc765e2b526465f22705b6229784ad5f33f0c4b57f1d9217bcfd"} Jun 15 08:23:20.131566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.131540 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-27mbf" Jun 15 08:23:20.142320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.142226 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-27mbf" podStartSLOduration=1.542201768 podStartE2EDuration="19.142209351s" totalImagesPullingTime="17.600007583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:20.141674455 +0000 UTC m=+285.407294425" watchObservedRunningTime="2026-06-15 08:23:20.142209351 +0000 UTC m=+285.407829322" Jun 15 08:23:20.156881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.154961 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67465b6d87-z8zrs"] Jun 15 08:23:20.159294 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.159104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.165961 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.165931 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zr876\"" Jun 15 08:23:20.166458 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.166441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 08:23:20.168056 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.168039 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 08:23:20.169584 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.168155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ab65kecmtdc8m\"" Jun 15 08:23:20.169856 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.169271 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 08:23:20.170427 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.169335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 08:23:20.195174 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.195151 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67465b6d87-z8zrs"] Jun 15 08:23:20.279796 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-tls\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.279796 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-client-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.280001 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-client-certs\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.280001 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.280001 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-audit-log\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.280001 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.279987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-metrics-server-audit-profiles\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.280258 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.280048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pxrp\" (UniqueName: \"kubernetes.io/projected/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-kube-api-access-2pxrp\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-tls\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-client-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-client-certs\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-audit-log\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-metrics-server-audit-profiles\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.381798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pxrp\" (UniqueName: \"kubernetes.io/projected/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-kube-api-access-2pxrp\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382651 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.382499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-audit-log\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.382651 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.382564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.384206 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.383879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-metrics-server-audit-profiles\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.386699 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.386556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-tls\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.388476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.388200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-client-ca-bundle\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.388476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.388439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-secret-metrics-server-client-certs\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.392438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.392398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pxrp\" (UniqueName: \"kubernetes.io/projected/569ef4e2-f912-4ec9-adfc-dba87df1bf7e-kube-api-access-2pxrp\") pod \"metrics-server-67465b6d87-z8zrs\" (UID: \"569ef4e2-f912-4ec9-adfc-dba87df1bf7e\") " pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.485297 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.485063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:20.515114 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.515051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:20.529812 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.529783 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9668m"] Jun 15 08:23:20.541137 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.541114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.542243 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.541682 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9668m"] Jun 15 08:23:20.545409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.545233 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 08:23:20.545409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.545261 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gpz47\"" Jun 15 08:23:20.581364 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.581289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:20.684076 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.683822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7j5d\" (UniqueName: \"kubernetes.io/projected/6f7d791f-8be1-404b-8668-494925ce5a65-kube-api-access-t7j5d\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.684076 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.683936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f7d791f-8be1-404b-8668-494925ce5a65-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.752574 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.752542 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:20.785146 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.785098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f7d791f-8be1-404b-8668-494925ce5a65-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.785288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.785215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7j5d\" (UniqueName: \"kubernetes.io/projected/6f7d791f-8be1-404b-8668-494925ce5a65-kube-api-access-t7j5d\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.794889 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.788646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f7d791f-8be1-404b-8668-494925ce5a65-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.800747 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.800698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7j5d\" (UniqueName: \"kubernetes.io/projected/6f7d791f-8be1-404b-8668-494925ce5a65-kube-api-access-t7j5d\") pod \"monitoring-plugin-589576dfc7-9668m\" (UID: \"6f7d791f-8be1-404b-8668-494925ce5a65\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.858669 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.858381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:20.986914 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.986807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:20.989763 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:20.989710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c1893c-ac8e-442e-bb13-902f9d138ca7-metrics-tls\") pod \"dns-default-cdqbq\" (UID: \"41c1893c-ac8e-442e-bb13-902f9d138ca7\") " pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:21.001416 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.001374 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:21.062493 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.062127 2564 patch_prober.go:28] interesting pod/image-registry-58cdbc9f4f-gcw6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 08:23:21.062493 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.062192 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 08:23:21.064680 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.064610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:21.106879 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.106784 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r86n2\"" Jun 15 08:23:21.115075 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.114887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:21.138759 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.137876 2564 generic.go:356] "Generic (PLEG): container finished" podID="812a7c6f-aff4-4a65-866d-f51fcd49ba22" containerID="8615284a52e91f5e4a8938029fba38dd6cc3b200f2fe652db7fd60dab799eeec" exitCode=0 Jun 15 08:23:21.138759 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.138525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-448nd" event={"ID":"812a7c6f-aff4-4a65-866d-f51fcd49ba22","Type":"ContainerDied","Data":"8615284a52e91f5e4a8938029fba38dd6cc3b200f2fe652db7fd60dab799eeec"} Jun 15 08:23:21.995510 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:21.995447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:23.153136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.152953 2564 generic.go:356] "Generic (PLEG): container finished" podID="0d3652e3-e362-4dc0-aca6-65f41966addd" containerID="2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f" exitCode=255 Jun 15 08:23:23.155007 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.153579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerDied","Data":"2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f"} Jun 15 08:23:23.155007 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.153659 2564 scope.go:117] "RemoveContainer" containerID="d77d2af6d2834e8d286bd1d0feacbed662a2d61ca7828a6bc872d87f22461c56" Jun 15 08:23:23.213791 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.212330 2564 scope.go:117] "RemoveContainer" containerID="2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f" Jun 15 08:23:23.213791 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:23.212540 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76748d4f58-hl9tz_open-cluster-management-agent-addon(0d3652e3-e362-4dc0-aca6-65f41966addd)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" podUID="0d3652e3-e362-4dc0-aca6-65f41966addd" Jun 15 08:23:23.309115 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.309044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-9668m"] Jun 15 08:23:23.328324 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.328301 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdqbq"] Jun 15 08:23:23.356467 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:23.356345 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67465b6d87-z8zrs"] Jun 15 08:23:23.390854 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:23.390606 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7d791f_8be1_404b_8668_494925ce5a65.slice/crio-c131454cd727c9fa86856545ec14eb40cee5da7bdedfa7595c9cb05b3626728b WatchSource:0}: Error finding container c131454cd727c9fa86856545ec14eb40cee5da7bdedfa7595c9cb05b3626728b: Status 404 returned error can't find the container with id c131454cd727c9fa86856545ec14eb40cee5da7bdedfa7595c9cb05b3626728b Jun 15 08:23:24.168118 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.168008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" event={"ID":"569ef4e2-f912-4ec9-adfc-dba87df1bf7e","Type":"ContainerStarted","Data":"9bf29ec102a1dc35fad0562598b4b7ad5f3e8f200c525b86ade5e6d0bb97ff40"} Jun 15 08:23:24.172807 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.172166 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83" exitCode=0 Jun 15 08:23:24.172807 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.172244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83"} Jun 15 08:23:24.178391 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.178364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdqbq" event={"ID":"41c1893c-ac8e-442e-bb13-902f9d138ca7","Type":"ContainerStarted","Data":"205c7ed92f14f7710e615badf7de55dc8fa8bc47155ccc403cd6851307df9e8f"} Jun 15 08:23:24.182038 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.181540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f87ff778-d65wr" event={"ID":"ba1f06de-eed0-409a-9f17-45e21471099d","Type":"ContainerStarted","Data":"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9"} Jun 15 08:23:24.185823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.185183 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" event={"ID":"1b7de6b8-aaed-416d-a783-d7024da7e41e","Type":"ContainerStarted","Data":"560cc75079d7b99b2716f1ca3ceeca939a3c5578853f86baf122d05cf7f1cd4b"} Jun 15 08:23:24.185823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.185237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" event={"ID":"1b7de6b8-aaed-416d-a783-d7024da7e41e","Type":"ContainerStarted","Data":"3cdaacb68c4fedca7e6eabe536d5dd119ef4521f71930a15f20c1be6ca01aaaf"} Jun 15 08:23:24.185823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.185267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" event={"ID":"1b7de6b8-aaed-416d-a783-d7024da7e41e","Type":"ContainerStarted","Data":"c97d5230c10c08a230ad347253b3776b7ad2244bbd4215790ba568702a46b436"} Jun 15 08:23:24.190092 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.189517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-448nd" event={"ID":"812a7c6f-aff4-4a65-866d-f51fcd49ba22","Type":"ContainerStarted","Data":"a81ae242032ac0bae2e66b1fc6e6753edda74ee0a5754ebd06785cf2ea8d2036"} Jun 15 08:23:24.190092 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.189559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-448nd" event={"ID":"812a7c6f-aff4-4a65-866d-f51fcd49ba22","Type":"ContainerStarted","Data":"ed535220d558f830c8e044c4d5f8efef5adeee98edfe54b538c138d2c9eed8d2"} Jun 15 08:23:24.192037 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.191969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" event={"ID":"6f7d791f-8be1-404b-8668-494925ce5a65","Type":"ContainerStarted","Data":"c131454cd727c9fa86856545ec14eb40cee5da7bdedfa7595c9cb05b3626728b"} Jun 15 08:23:24.241354 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.239627 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-448nd" podStartSLOduration=7.957575149 podStartE2EDuration="9.23960986s" totalImagesPullingTime="1.176587829s" totalInitContainerRuntime="105.446882ms" isStatefulPod=true podCreationTimestamp="2026-06-15 08:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:24.239086931 +0000 UTC m=+289.504706916" watchObservedRunningTime="2026-06-15 08:23:24.23960986 +0000 UTC m=+289.505229832" Jun 15 08:23:24.241354 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.240525 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4z6bl" podStartSLOduration=5.319868059 podStartE2EDuration="9.240510815s" totalImagesPullingTime="3.920642756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:24.220393802 +0000 UTC m=+289.486013773" watchObservedRunningTime="2026-06-15 08:23:24.240510815 +0000 UTC m=+289.506130789" Jun 15 08:23:24.257849 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.257465 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f87ff778-d65wr" podStartSLOduration=3.0126849 podStartE2EDuration="7.257448112s" totalImagesPullingTime="4.244763212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:24.255566515 +0000 UTC m=+289.521186528" watchObservedRunningTime="2026-06-15 08:23:24.257448112 +0000 UTC m=+289.523068083" Jun 15 08:23:24.429210 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.429129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:24.488696 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.488630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:24.510138 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.510110 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:24.544151 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.544120 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:23:24.562959 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.562933 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:23:24.563108 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.563046 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.726957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.727292 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.727196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2gnr\" (UniqueName: \"kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.830550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.832744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.832779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.832829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.832911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.832963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.833006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2gnr\" (UniqueName: \"kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.834074 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.835215 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.834638 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.839698 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.836065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.839698 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.836410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.840138 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.840097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.844530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.844486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2gnr\" (UniqueName: \"kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.848854 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.848776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert\") pod \"console-dc84578b9-z7jcn\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:24.885729 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:24.885471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:26.077736 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:26.077658 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" containerID="cri-o://0c80fff4794a2c4becdec21bb62720a00663b4d65e36c1cbc231bfad1a459a07" gracePeriod=30 Jun 15 08:23:27.212204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.212163 2564 generic.go:356] "Generic (PLEG): container finished" podID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerID="0c80fff4794a2c4becdec21bb62720a00663b4d65e36c1cbc231bfad1a459a07" exitCode=0 Jun 15 08:23:27.212641 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.212288 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" event={"ID":"b1e0bc11-d5b3-45df-839d-fe0f182c617c","Type":"ContainerDied","Data":"0c80fff4794a2c4becdec21bb62720a00663b4d65e36c1cbc231bfad1a459a07"} Jun 15 08:23:27.768027 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.768004 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:23:27.770574 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.770550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:23:27.774125 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:23:27.774094 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97da7c64_37d5_4f43_99f5_fb059140b5eb.slice/crio-b85e891274339207ca993131d941799dd26b231c1be7b7cedd54faf053c3a39c WatchSource:0}: Error finding container b85e891274339207ca993131d941799dd26b231c1be7b7cedd54faf053c3a39c: Status 404 returned error can't find the container with id b85e891274339207ca993131d941799dd26b231c1be7b7cedd54faf053c3a39c Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866513 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866566 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866607 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sgkn\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866774 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866800 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.866819 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates\") pod \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\" (UID: \"b1e0bc11-d5b3-45df-839d-fe0f182c617c\") " Jun 15 08:23:27.867462 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.867391 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:27.868782 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.868514 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:27.871328 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.871286 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:27.871424 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.871355 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:27.871925 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.871888 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn" (OuterVolumeSpecName: "kube-api-access-4sgkn") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "kube-api-access-4sgkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:27.872019 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.871932 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:27.872131 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.872108 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:27.876957 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.876934 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:27.878502 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.878478 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b1e0bc11-d5b3-45df-839d-fe0f182c617c" (UID: "b1e0bc11-d5b3-45df-839d-fe0f182c617c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:23:27.967476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967450 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-bound-sa-token\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967476 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967473 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-tls\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967481 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-trusted-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967489 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e0bc11-d5b3-45df-839d-fe0f182c617c-registry-certificates\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967499 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-installation-pull-secrets\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967508 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e0bc11-d5b3-45df-839d-fe0f182c617c-ca-trust-extracted\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967517 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e0bc11-d5b3-45df-839d-fe0f182c617c-image-registry-private-configuration\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:27.967597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:27.967525 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sgkn\" (UniqueName: \"kubernetes.io/projected/b1e0bc11-d5b3-45df-839d-fe0f182c617c-kube-api-access-4sgkn\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:28.036850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.036194 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" Jun 15 08:23:28.056264 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.056241 2564 scope.go:117] "RemoveContainer" containerID="2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f" Jun 15 08:23:28.056469 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:28.056443 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76748d4f58-hl9tz_open-cluster-management-agent-addon(0d3652e3-e362-4dc0-aca6-65f41966addd)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" podUID="0d3652e3-e362-4dc0-aca6-65f41966addd" Jun 15 08:23:28.217039 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.217013 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" Jun 15 08:23:28.217404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.217049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58cdbc9f4f-gcw6d" event={"ID":"b1e0bc11-d5b3-45df-839d-fe0f182c617c","Type":"ContainerDied","Data":"9914fad02dd3dc4b099f4b37a357828e88fad4262489df61756d955c6330bed4"} Jun 15 08:23:28.217404 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.217115 2564 scope.go:117] "RemoveContainer" containerID="0c80fff4794a2c4becdec21bb62720a00663b4d65e36c1cbc231bfad1a459a07" Jun 15 08:23:28.218984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.218959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" event={"ID":"6f7d791f-8be1-404b-8668-494925ce5a65","Type":"ContainerStarted","Data":"dd0cb0e3e9932659c15a82ea97163dcc6da9b35b0ed863d190bea67c4bfc73c5"} Jun 15 08:23:28.219374 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.219337 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:28.221555 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.221461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc84578b9-z7jcn" event={"ID":"97da7c64-37d5-4f43-99f5-fb059140b5eb","Type":"ContainerStarted","Data":"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b"} Jun 15 08:23:28.221555 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.221505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc84578b9-z7jcn" event={"ID":"97da7c64-37d5-4f43-99f5-fb059140b5eb","Type":"ContainerStarted","Data":"b85e891274339207ca993131d941799dd26b231c1be7b7cedd54faf053c3a39c"} Jun 15 08:23:28.223315 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.223263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" event={"ID":"569ef4e2-f912-4ec9-adfc-dba87df1bf7e","Type":"ContainerStarted","Data":"af92d5babccef0d0e2277ca8879935c5a5aeb93ed9763e59ad8e0087330eb06d"} Jun 15 08:23:28.225133 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.225116 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" Jun 15 08:23:28.225521 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.225502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3"} Jun 15 08:23:28.227033 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.227017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdqbq" event={"ID":"41c1893c-ac8e-442e-bb13-902f9d138ca7","Type":"ContainerStarted","Data":"b9f98674b6b77f6afae03975513226d914e114db29b4518001e4ecb539830ad2"} Jun 15 08:23:28.227097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.227047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdqbq" event={"ID":"41c1893c-ac8e-442e-bb13-902f9d138ca7","Type":"ContainerStarted","Data":"3fccedd7f199ca1c6d2485ce2988b0d01026be4e9d470c95298cedbbe9a2cdcd"} Jun 15 08:23:28.227152 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.227137 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:28.236899 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.236842 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-9668m" podStartSLOduration=4.031381805 podStartE2EDuration="8.236830072s" totalImagesPullingTime="4.205448267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:28.235404243 +0000 UTC m=+293.501024214" watchObservedRunningTime="2026-06-15 08:23:28.236830072 +0000 UTC m=+293.502450041" Jun 15 08:23:28.252841 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.252805 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc84578b9-z7jcn" podStartSLOduration=4.252791829 podStartE2EDuration="4.252791829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:28.251670694 +0000 UTC m=+293.517290685" watchObservedRunningTime="2026-06-15 08:23:28.252791829 +0000 UTC m=+293.518411799" Jun 15 08:23:28.264778 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.264754 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:23:28.268217 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.268194 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58cdbc9f4f-gcw6d"] Jun 15 08:23:28.285106 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.285060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" podStartSLOduration=4.079887457 podStartE2EDuration="8.285042923s" totalImagesPullingTime="4.205155466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:28.282896973 +0000 UTC m=+293.548516944" watchObservedRunningTime="2026-06-15 08:23:28.285042923 +0000 UTC m=+293.550662894" Jun 15 08:23:28.299101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:28.299060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cdqbq" podStartSLOduration=253.090950883 podStartE2EDuration="4m17.299044036s" totalImagesPullingTime="4.208093153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:28.298329684 +0000 UTC m=+293.563949681" watchObservedRunningTime="2026-06-15 08:23:28.299044036 +0000 UTC m=+293.564664004" Jun 15 08:23:29.199777 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:29.199747 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" path="/var/lib/kubelet/pods/b1e0bc11-d5b3-45df-839d-fe0f182c617c/volumes" Jun 15 08:23:29.234139 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:29.234106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949"} Jun 15 08:23:29.234504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:29.234172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08"} Jun 15 08:23:29.234504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:29.234210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497"} Jun 15 08:23:29.234504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:29.234235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891"} Jun 15 08:23:30.241327 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:30.241298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerStarted","Data":"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c"} Jun 15 08:23:30.266323 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:30.266278 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.33034145 podStartE2EDuration="14.266262662s" totalImagesPullingTime="8.901341919s" totalInitContainerRuntime="34.579293ms" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:30.265224037 +0000 UTC m=+295.530844006" watchObservedRunningTime="2026-06-15 08:23:30.266262662 +0000 UTC m=+295.531882625" Jun 15 08:23:32.705811 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:32.705779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:33.195239 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:33.195186 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-82dnt" podUID="fa0a4420-accc-4ebf-80b1-2440a419320f" Jun 15 08:23:33.661129 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:33.661060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:33.942409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:33.942380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:34.886610 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:34.886575 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:34.886770 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:34.886642 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:34.891017 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:34.890997 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:35.110155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.110123 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:35.153903 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.153882 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:23:35.154091 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.154075 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:23:35.160622 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.160605 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 08:23:35.166005 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.165985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:35.264329 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.264219 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:23:35.467360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.415244 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:35.516415 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:35.516390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:38.237185 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:38.237155 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cdqbq" Jun 15 08:23:38.391809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:38.391779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:38.481974 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:38.481950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:40.310739 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:40.310710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:40.366690 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:40.366659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:40.485918 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:40.485893 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:40.486070 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:40.485941 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:23:41.776652 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:41.776622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:41.838171 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:41.838143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:42.199978 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:42.199958 2564 scope.go:117] "RemoveContainer" containerID="2f7b131ae58c50122cd62fa30d6c2e41f837395ba3f3d4f0a493a0dc4ad8549f" Jun 15 08:23:43.299044 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:43.299006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76748d4f58-hl9tz" event={"ID":"0d3652e3-e362-4dc0-aca6-65f41966addd","Type":"ContainerStarted","Data":"6fde9b963fe2435dc647d942ec7bb397974397595b1dc657690e95edb09a69c6"} Jun 15 08:23:44.193532 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:44.193498 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:23:45.307252 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:45.307225 2564 generic.go:356] "Generic (PLEG): container finished" podID="c71746ed-4290-4b34-8b8a-cdce86159b5b" containerID="3693b12611723a50e0349169d0b62181f68549a2b532fddf3f091ca84d39fb7d" exitCode=0 Jun 15 08:23:45.307582 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:45.307295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" event={"ID":"c71746ed-4290-4b34-8b8a-cdce86159b5b","Type":"ContainerDied","Data":"3693b12611723a50e0349169d0b62181f68549a2b532fddf3f091ca84d39fb7d"} Jun 15 08:23:45.307582 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:45.307560 2564 scope.go:117] "RemoveContainer" containerID="3693b12611723a50e0349169d0b62181f68549a2b532fddf3f091ca84d39fb7d" Jun 15 08:23:46.313191 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:46.313162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7nb7f" event={"ID":"c71746ed-4290-4b34-8b8a-cdce86159b5b","Type":"ContainerStarted","Data":"2550cb086dedf4795cd20a39aa230a1ff1445e36d45af447d67e8407eb656204"} Jun 15 08:23:47.501121 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:47.501088 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:47.598314 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:47.598282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:51.231969 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.231916 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86f87ff778-d65wr" podUID="ba1f06de-eed0-409a-9f17-45e21471099d" containerName="console" containerID="cri-o://8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9" gracePeriod=15 Jun 15 08:23:51.505298 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.505231 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:51.552986 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.552961 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.552993 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553035 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553054 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twcx2\" (UniqueName: \"kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553277 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553187 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553277 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553251 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca\") pod \"ba1f06de-eed0-409a-9f17-45e21471099d\" (UID: \"ba1f06de-eed0-409a-9f17-45e21471099d\") " Jun 15 08:23:51.553377 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553344 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config" (OuterVolumeSpecName: "console-config") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:51.553538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553517 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-console-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.553645 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553588 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:51.553645 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553603 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:51.553721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.553710 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:51.555235 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.555213 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2" (OuterVolumeSpecName: "kube-api-access-twcx2") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "kube-api-access-twcx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:51.555484 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.555462 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:51.555523 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.555481 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba1f06de-eed0-409a-9f17-45e21471099d" (UID: "ba1f06de-eed0-409a-9f17-45e21471099d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:51.653848 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653822 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-trusted-ca-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.653848 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653845 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-oauth-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.654000 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653854 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.654000 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653903 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twcx2\" (UniqueName: \"kubernetes.io/projected/ba1f06de-eed0-409a-9f17-45e21471099d-kube-api-access-twcx2\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.654000 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653913 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1f06de-eed0-409a-9f17-45e21471099d-console-oauth-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:51.654000 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:51.653922 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f06de-eed0-409a-9f17-45e21471099d-service-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:23:52.337119 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.337081 2564 generic.go:356] "Generic (PLEG): container finished" podID="ba1f06de-eed0-409a-9f17-45e21471099d" containerID="8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9" exitCode=0 Jun 15 08:23:52.337530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.337143 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f87ff778-d65wr" Jun 15 08:23:52.337530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.337147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f87ff778-d65wr" event={"ID":"ba1f06de-eed0-409a-9f17-45e21471099d","Type":"ContainerDied","Data":"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9"} Jun 15 08:23:52.337530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.337195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f87ff778-d65wr" event={"ID":"ba1f06de-eed0-409a-9f17-45e21471099d","Type":"ContainerDied","Data":"71b3bdd498b0cc765e2b526465f22705b6229784ad5f33f0c4b57f1d9217bcfd"} Jun 15 08:23:52.337530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.337223 2564 scope.go:117] "RemoveContainer" containerID="8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9" Jun 15 08:23:52.346227 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.346211 2564 scope.go:117] "RemoveContainer" containerID="8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9" Jun 15 08:23:52.346464 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:23:52.346448 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9\": container with ID starting with 8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9 not found: ID does not exist" containerID="8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9" Jun 15 08:23:52.346501 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.346472 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9"} err="failed to get container status \"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9\": rpc error: code = NotFound desc = could not find container \"8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9\": container with ID starting with 8eda421c9641fd72441c4f83d402ad04341647563ebf8d6075d164ff65aa0be9 not found: ID does not exist" Jun 15 08:23:52.358974 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.358950 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:52.362826 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:52.362806 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f87ff778-d65wr"] Jun 15 08:23:53.198744 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:53.198714 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1f06de-eed0-409a-9f17-45e21471099d" path="/var/lib/kubelet/pods/ba1f06de-eed0-409a-9f17-45e21471099d/volumes" Jun 15 08:23:55.762702 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:55.762653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:23:55.815490 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:23:55.815468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:00.491225 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:00.491199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:24:00.494842 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:00.494826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67465b6d87-z8zrs" Jun 15 08:24:31.913881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:31.913776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:32.058920 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:32.058892 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:36.180145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180112 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:36.180524 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180372 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="alertmanager" containerID="cri-o://cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3" gracePeriod=120 Jun 15 08:24:36.180524 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180444 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-metric" containerID="cri-o://a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949" gracePeriod=120 Jun 15 08:24:36.180524 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180497 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy" containerID="cri-o://0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08" gracePeriod=120 Jun 15 08:24:36.180686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180494 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="prom-label-proxy" containerID="cri-o://7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c" gracePeriod=120 Jun 15 08:24:36.180686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180539 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-web" containerID="cri-o://446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497" gracePeriod=120 Jun 15 08:24:36.180686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.180530 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="config-reloader" containerID="cri-o://4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891" gracePeriod=120 Jun 15 08:24:36.514079 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514052 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c" exitCode=0 Jun 15 08:24:36.514079 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514076 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949" exitCode=0 Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514085 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08" exitCode=0 Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514093 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891" exitCode=0 Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514100 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3" exitCode=0 Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514117 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c"} Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949"} Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08"} Jun 15 08:24:36.514230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891"} Jun 15 08:24:36.514430 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:36.514251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3"} Jun 15 08:24:37.420781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.420756 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:37.524553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.524471 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerID="446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497" exitCode=0 Jun 15 08:24:37.524553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.524524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497"} Jun 15 08:24:37.524719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.524567 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:37.524719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.524598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c6d4a00-48fc-4352-88a5-41df5014ee2e","Type":"ContainerDied","Data":"578db16ac74c5f4c90eef8fde8ed88c3a23813a0cc530113189e6e06b824fcb2"} Jun 15 08:24:37.524719 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.524644 2564 scope.go:117] "RemoveContainer" containerID="7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c" Jun 15 08:24:37.532095 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.532070 2564 scope.go:117] "RemoveContainer" containerID="a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949" Jun 15 08:24:37.540034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.540013 2564 scope.go:117] "RemoveContainer" containerID="0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08" Jun 15 08:24:37.547221 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.547198 2564 scope.go:117] "RemoveContainer" containerID="446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497" Jun 15 08:24:37.553760 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.553741 2564 scope.go:117] "RemoveContainer" containerID="4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891" Jun 15 08:24:37.560740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.560725 2564 scope.go:117] "RemoveContainer" containerID="cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3" Jun 15 08:24:37.567771 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.567754 2564 scope.go:117] "RemoveContainer" containerID="88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83" Jun 15 08:24:37.574515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.574493 2564 scope.go:117] "RemoveContainer" containerID="7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c" Jun 15 08:24:37.574778 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.574760 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c\": container with ID starting with 7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c not found: ID does not exist" containerID="7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c" Jun 15 08:24:37.574848 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.574791 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c"} err="failed to get container status \"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c\": rpc error: code = NotFound desc = could not find container \"7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c\": container with ID starting with 7dc639d87f7363e1249d0b0bdb5f9280b11c5f5cd4dc7a59b5ca4c333afc741c not found: ID does not exist" Jun 15 08:24:37.574848 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.574815 2564 scope.go:117] "RemoveContainer" containerID="a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949" Jun 15 08:24:37.575172 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.575153 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949\": container with ID starting with a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949 not found: ID does not exist" containerID="a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949" Jun 15 08:24:37.575217 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575178 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949"} err="failed to get container status \"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949\": rpc error: code = NotFound desc = could not find container \"a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949\": container with ID starting with a5811b9644e653beaca769189b00c5af8a5fb12e3184c852c1d4c5088840f949 not found: ID does not exist" Jun 15 08:24:37.575217 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575195 2564 scope.go:117] "RemoveContainer" containerID="0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08" Jun 15 08:24:37.575435 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.575419 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08\": container with ID starting with 0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08 not found: ID does not exist" containerID="0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08" Jun 15 08:24:37.575479 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575440 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08"} err="failed to get container status \"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08\": rpc error: code = NotFound desc = could not find container \"0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08\": container with ID starting with 0de8266d9a42be75b4cbddba9ea8fe0503ed25a2f5622c4f3b6ac6fb69b8cb08 not found: ID does not exist" Jun 15 08:24:37.575479 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575455 2564 scope.go:117] "RemoveContainer" containerID="446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497" Jun 15 08:24:37.575685 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.575669 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497\": container with ID starting with 446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497 not found: ID does not exist" containerID="446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497" Jun 15 08:24:37.575756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575692 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497"} err="failed to get container status \"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497\": rpc error: code = NotFound desc = could not find container \"446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497\": container with ID starting with 446e6ff9dc3f609635d2fa04e68bae4facab89e7bc0fe35f94b42cd4bfc7a497 not found: ID does not exist" Jun 15 08:24:37.575756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575713 2564 scope.go:117] "RemoveContainer" containerID="4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891" Jun 15 08:24:37.575986 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.575967 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891\": container with ID starting with 4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891 not found: ID does not exist" containerID="4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891" Jun 15 08:24:37.576041 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.575990 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891"} err="failed to get container status \"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891\": rpc error: code = NotFound desc = could not find container \"4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891\": container with ID starting with 4dff2d9b6e95b4389092bcdcf75c125f1ce487690882d30a5abf7cccd0387891 not found: ID does not exist" Jun 15 08:24:37.576041 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.576003 2564 scope.go:117] "RemoveContainer" containerID="cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3" Jun 15 08:24:37.576269 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.576254 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3\": container with ID starting with cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3 not found: ID does not exist" containerID="cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3" Jun 15 08:24:37.576318 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.576272 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3"} err="failed to get container status \"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3\": rpc error: code = NotFound desc = could not find container \"cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3\": container with ID starting with cd660ee38c67d99c48e91e91139f31675146a9a50ac801ffb6eaf034dbcbdad3 not found: ID does not exist" Jun 15 08:24:37.576318 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.576286 2564 scope.go:117] "RemoveContainer" containerID="88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83" Jun 15 08:24:37.576505 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:24:37.576490 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83\": container with ID starting with 88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83 not found: ID does not exist" containerID="88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83" Jun 15 08:24:37.576553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.576509 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83"} err="failed to get container status \"88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83\": rpc error: code = NotFound desc = could not find container \"88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83\": container with ID starting with 88275bfe99c4455542f256e100e2f3c4e0de9d407f475f959195fbec2966ba83 not found: ID does not exist" Jun 15 08:24:37.600591 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600572 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600691 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600601 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khjll\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600691 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600620 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600691 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600641 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600691 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600665 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600931 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600931 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600821 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.600931 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601088 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600950 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601088 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.600982 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601088 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601049 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601088 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601079 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601275 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601122 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca\") pod \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\" (UID: \"5c6d4a00-48fc-4352-88a5-41df5014ee2e\") " Jun 15 08:24:37.601275 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601157 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:37.601377 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601366 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.601736 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.601683 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:37.602946 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.602797 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:24:37.603856 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.603807 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:24:37.603989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.603898 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume" (OuterVolumeSpecName: "config-volume") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.604296 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604265 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.604375 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604342 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.604557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604520 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.604557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604526 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll" (OuterVolumeSpecName: "kube-api-access-khjll") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "kube-api-access-khjll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:24:37.604794 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604772 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.604851 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.604811 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out" (OuterVolumeSpecName: "config-out") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:24:37.608470 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.608445 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.613674 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.613652 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config" (OuterVolumeSpecName: "web-config") pod "5c6d4a00-48fc-4352-88a5-41df5014ee2e" (UID: "5c6d4a00-48fc-4352-88a5-41df5014ee2e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:37.702411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702380 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-volume\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702410 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khjll\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-kube-api-access-khjll\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702411 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702419 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c6d4a00-48fc-4352-88a5-41df5014ee2e-tls-assets\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702428 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-web-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702436 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702445 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702454 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-main-tls\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702462 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-config-out\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702470 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702479 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c6d4a00-48fc-4352-88a5-41df5014ee2e-alertmanager-main-db\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702487 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c6d4a00-48fc-4352-88a5-41df5014ee2e-cluster-tls-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.702566 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.702495 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6d4a00-48fc-4352-88a5-41df5014ee2e-metrics-client-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:24:37.854304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.854282 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:37.862542 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.862525 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:37.929126 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929104 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:37.929347 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929336 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="config-reloader" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929349 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="config-reloader" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929356 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1f06de-eed0-409a-9f17-45e21471099d" containerName="console" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929362 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1f06de-eed0-409a-9f17-45e21471099d" containerName="console" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929372 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="alertmanager" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929377 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="alertmanager" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929382 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-web" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929387 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-web" Jun 15 08:24:37.929396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929398 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-metric" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929404 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-metric" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929409 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929414 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929421 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="prom-label-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929426 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="prom-label-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929432 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929460 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929467 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="init-config-reloader" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929472 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="init-config-reloader" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929519 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1f06de-eed0-409a-9f17-45e21471099d" containerName="console" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929527 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e0bc11-d5b3-45df-839d-fe0f182c617c" containerName="registry" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929535 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="alertmanager" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929540 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-web" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929545 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="prom-label-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929550 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="config-reloader" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929555 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy" Jun 15 08:24:37.929624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.929561 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" containerName="kube-rbac-proxy-metric" Jun 15 08:24:37.932781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.932766 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:37.935279 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 08:24:37.935381 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 08:24:37.935381 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935283 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 08:24:37.935381 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 08:24:37.935563 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935548 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 08:24:37.935611 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935581 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 08:24:37.935737 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935723 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pkdc9\"" Jun 15 08:24:37.935906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935891 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 08:24:37.935999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.935985 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 08:24:37.940825 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.940806 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 08:24:37.949833 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:37.949804 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:38.106984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.106909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.106984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.106946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.106984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.106972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-web-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-out\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.107418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.107347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9jn\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-kube-api-access-gt9jn\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-out\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9jn\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-kube-api-access-gt9jn\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-web-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.208954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.208922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.210547 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.209203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.210547 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.209718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.210547 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.209724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad6fc59-c600-4be7-a6bc-43e186fa1673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.211309 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.211279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-out\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.211559 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.211537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.211673 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.211654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.211742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.211672 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.211807 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.211768 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.212219 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.212195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.212330 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.212309 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.212713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.212692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-web-config\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.213233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.213212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ad6fc59-c600-4be7-a6bc-43e186fa1673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.216903 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.216858 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9jn\" (UniqueName: \"kubernetes.io/projected/9ad6fc59-c600-4be7-a6bc-43e186fa1673-kube-api-access-gt9jn\") pod \"alertmanager-main-0\" (UID: \"9ad6fc59-c600-4be7-a6bc-43e186fa1673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.243175 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.243157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 08:24:38.375725 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.375661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 08:24:38.378908 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:24:38.378880 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad6fc59_c600_4be7_a6bc_43e186fa1673.slice/crio-efa903a5f5a1e19cfedfa11db6a4498bfe5d60909123ec2fb0520de3aa2367d3 WatchSource:0}: Error finding container efa903a5f5a1e19cfedfa11db6a4498bfe5d60909123ec2fb0520de3aa2367d3: Status 404 returned error can't find the container with id efa903a5f5a1e19cfedfa11db6a4498bfe5d60909123ec2fb0520de3aa2367d3 Jun 15 08:24:38.529201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.529176 2564 generic.go:356] "Generic (PLEG): container finished" podID="9ad6fc59-c600-4be7-a6bc-43e186fa1673" containerID="f4d10c11dec7151b607fdb3c4b141e22471d6bd24578b1b9bc198043c5b3ff16" exitCode=0 Jun 15 08:24:38.529507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.529270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerDied","Data":"f4d10c11dec7151b607fdb3c4b141e22471d6bd24578b1b9bc198043c5b3ff16"} Jun 15 08:24:38.529507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:38.529344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"efa903a5f5a1e19cfedfa11db6a4498bfe5d60909123ec2fb0520de3aa2367d3"} Jun 15 08:24:39.198597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.198565 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6d4a00-48fc-4352-88a5-41df5014ee2e" path="/var/lib/kubelet/pods/5c6d4a00-48fc-4352-88a5-41df5014ee2e/volumes" Jun 15 08:24:39.537556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"6220ba5b957ba9a130d1f6dbc55fc86bf6803bb5f7afbe53b79fa407b438fc86"} Jun 15 08:24:39.537556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"c163cb81886d2c6a5e6c93fbd7991f95e4a579497026e46cbd16fea7129f062a"} Jun 15 08:24:39.537940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"a96ed87e2f9fe33b8455227af9a56df91dfe95f32899deeaf15c84a166fc24e8"} Jun 15 08:24:39.537940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"0419747c6956d725d0ed1a12ad1476783704630a7a8b2852d11c09fb1f096236"} Jun 15 08:24:39.537940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"09cae95a1f37477ada8412e011b1e30ad2adb7d10e00bfefbe31e9c9ab00ad22"} Jun 15 08:24:39.537940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.537657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ad6fc59-c600-4be7-a6bc-43e186fa1673","Type":"ContainerStarted","Data":"9b6997a41311dde99d285ae3ed8870f083b22b15849d85bffaf5e38d59fd211b"} Jun 15 08:24:39.564641 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:39.564597 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.54925637 podStartE2EDuration="2.564582929s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.326559ms" isStatefulPod=false podCreationTimestamp="2026-06-15 08:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:24:39.562532417 +0000 UTC m=+364.828152392" watchObservedRunningTime="2026-06-15 08:24:39.564582929 +0000 UTC m=+364.830202898" Jun 15 08:24:43.847808 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:43.847777 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:43.949181 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:43.949152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:44.874960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:44.874930 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:44.933600 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:44.933571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:49.091054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.091022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:24:49.093196 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.093178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa0a4420-accc-4ebf-80b1-2440a419320f-metrics-certs\") pod \"network-metrics-daemon-82dnt\" (UID: \"fa0a4420-accc-4ebf-80b1-2440a419320f\") " pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:24:49.297042 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.297019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-646t6\"" Jun 15 08:24:49.305080 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.305063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82dnt" Jun 15 08:24:49.430182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.430154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82dnt"] Jun 15 08:24:49.432987 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:24:49.432956 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0a4420_accc_4ebf_80b1_2440a419320f.slice/crio-04d69e3a1d50165afabcd65d48e2593c3d3f059e23cef02d86e079597018ede4 WatchSource:0}: Error finding container 04d69e3a1d50165afabcd65d48e2593c3d3f059e23cef02d86e079597018ede4: Status 404 returned error can't find the container with id 04d69e3a1d50165afabcd65d48e2593c3d3f059e23cef02d86e079597018ede4 Jun 15 08:24:49.434813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.434799 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:24:49.575285 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:49.575248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82dnt" event={"ID":"fa0a4420-accc-4ebf-80b1-2440a419320f","Type":"ContainerStarted","Data":"04d69e3a1d50165afabcd65d48e2593c3d3f059e23cef02d86e079597018ede4"} Jun 15 08:24:51.584600 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:51.584564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82dnt" event={"ID":"fa0a4420-accc-4ebf-80b1-2440a419320f","Type":"ContainerStarted","Data":"56425fb722e352f945b76778a255bf369fe1d40a42d440602ca1732a89857cbb"} Jun 15 08:24:51.585020 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:51.584610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82dnt" event={"ID":"fa0a4420-accc-4ebf-80b1-2440a419320f","Type":"ContainerStarted","Data":"68cd0af2c031ef8ec08e1c43eb9c40ebec3a06d7ad1d94a77f54bef0a45a08f7"} Jun 15 08:24:51.601700 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:51.601658 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82dnt" podStartSLOduration=375.45802294 podStartE2EDuration="6m16.601643854s" totalImagesPullingTime="1.143620914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:24:51.600226574 +0000 UTC m=+376.865846543" watchObservedRunningTime="2026-06-15 08:24:51.601643854 +0000 UTC m=+376.867263824" Jun 15 08:24:51.710975 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:51.710946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:51.773284 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:51.773259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:55.776630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:55.776598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:55.874922 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:55.874900 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:57.273636 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.273611 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:24:57.275837 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.275820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.287224 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.287199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:24:57.349705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.349823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.349823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.349823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l8bw\" (UniqueName: \"kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.350011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.350011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.350011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.349906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.362898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.362854 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:57.420487 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.420464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:24:57.451107 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451211 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451211 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l8bw\" (UniqueName: \"kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451211 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.451874 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.451851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.452026 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.452004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.452087 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.452075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.452123 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.452097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.453796 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.453766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.453907 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.453777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.458695 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.458674 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l8bw\" (UniqueName: \"kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw\") pod \"console-8554dc54d9-drwlk\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.584834 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.584782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:24:57.712115 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:57.712052 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:24:57.715699 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:24:57.715675 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc020a8_d4d6_49c3_8cbe_6705cc42bb95.slice/crio-476365aa80412dee01aa80d8fc8856f84855096e5e28219aae2d34b6cca13f1a WatchSource:0}: Error finding container 476365aa80412dee01aa80d8fc8856f84855096e5e28219aae2d34b6cca13f1a: Status 404 returned error can't find the container with id 476365aa80412dee01aa80d8fc8856f84855096e5e28219aae2d34b6cca13f1a Jun 15 08:24:58.611179 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:58.611143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554dc54d9-drwlk" event={"ID":"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95","Type":"ContainerStarted","Data":"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9"} Jun 15 08:24:58.611602 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:58.611191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554dc54d9-drwlk" event={"ID":"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95","Type":"ContainerStarted","Data":"476365aa80412dee01aa80d8fc8856f84855096e5e28219aae2d34b6cca13f1a"} Jun 15 08:24:58.631252 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:24:58.631211 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8554dc54d9-drwlk" podStartSLOduration=1.631196286 podStartE2EDuration="1.631196286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:24:58.630233503 +0000 UTC m=+383.895853489" watchObservedRunningTime="2026-06-15 08:24:58.631196286 +0000 UTC m=+383.896816256" Jun 15 08:25:07.584958 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.584925 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:25:07.585421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.584979 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:25:07.589930 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.589908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:25:07.648686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.648664 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:25:07.694710 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.694676 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:25:07.804700 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.804666 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:07.864747 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.864682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:07.919310 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:07.919289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:32.429853 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:32.429811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:32.716815 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:32.716775 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dc84578b9-z7jcn" podUID="97da7c64-37d5-4f43-99f5-fb059140b5eb" containerName="console" containerID="cri-o://c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b" gracePeriod=15 Jun 15 08:25:32.955851 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:32.955825 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:25:33.034170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034166 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034208 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034237 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2gnr\" (UniqueName: \"kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034281 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle\") pod \"97da7c64-37d5-4f43-99f5-fb059140b5eb\" (UID: \"97da7c64-37d5-4f43-99f5-fb059140b5eb\") " Jun 15 08:25:33.034690 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034649 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:25:33.034690 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034679 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config" (OuterVolumeSpecName: "console-config") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:25:33.034785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034712 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:25:33.034829 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.034812 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:25:33.036276 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.036251 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:25:33.036351 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.036308 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:25:33.036431 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.036414 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr" (OuterVolumeSpecName: "kube-api-access-s2gnr") pod "97da7c64-37d5-4f43-99f5-fb059140b5eb" (UID: "97da7c64-37d5-4f43-99f5-fb059140b5eb"). InnerVolumeSpecName "kube-api-access-s2gnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:25:33.135809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135779 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2gnr\" (UniqueName: \"kubernetes.io/projected/97da7c64-37d5-4f43-99f5-fb059140b5eb-kube-api-access-s2gnr\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.135809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135807 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-service-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.136024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135818 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-trusted-ca-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.136024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135828 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-oauth-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.136024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135836 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-oauth-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.136024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135845 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.136024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.135856 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97da7c64-37d5-4f43-99f5-fb059140b5eb-console-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:25:33.746283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.746252 2564 generic.go:356] "Generic (PLEG): container finished" podID="97da7c64-37d5-4f43-99f5-fb059140b5eb" containerID="c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b" exitCode=0 Jun 15 08:25:33.746722 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.746300 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc84578b9-z7jcn" Jun 15 08:25:33.746722 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.746302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc84578b9-z7jcn" event={"ID":"97da7c64-37d5-4f43-99f5-fb059140b5eb","Type":"ContainerDied","Data":"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b"} Jun 15 08:25:33.746722 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.746436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc84578b9-z7jcn" event={"ID":"97da7c64-37d5-4f43-99f5-fb059140b5eb","Type":"ContainerDied","Data":"b85e891274339207ca993131d941799dd26b231c1be7b7cedd54faf053c3a39c"} Jun 15 08:25:33.746722 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.746474 2564 scope.go:117] "RemoveContainer" containerID="c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b" Jun 15 08:25:33.754634 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.754613 2564 scope.go:117] "RemoveContainer" containerID="c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b" Jun 15 08:25:33.754932 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:25:33.754911 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b\": container with ID starting with c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b not found: ID does not exist" containerID="c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b" Jun 15 08:25:33.755012 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.754938 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b"} err="failed to get container status \"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b\": rpc error: code = NotFound desc = could not find container \"c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b\": container with ID starting with c7e6d5e7b21311b8991b981da14f4816e8f3dd31d4af8aadb1694d370cb5175b not found: ID does not exist" Jun 15 08:25:33.762270 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.762251 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:25:33.767657 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:33.767637 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc84578b9-z7jcn"] Jun 15 08:25:35.199441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:35.199412 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97da7c64-37d5-4f43-99f5-fb059140b5eb" path="/var/lib/kubelet/pods/97da7c64-37d5-4f43-99f5-fb059140b5eb/volumes" Jun 15 08:25:37.679263 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:37.679231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:37.731424 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:37.731388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:54.405528 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:54.405448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:54.499819 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:54.499788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:25:55.061442 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.061408 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq"] Jun 15 08:25:55.061800 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.061778 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97da7c64-37d5-4f43-99f5-fb059140b5eb" containerName="console" Jun 15 08:25:55.061800 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.061800 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="97da7c64-37d5-4f43-99f5-fb059140b5eb" containerName="console" Jun 15 08:25:55.061974 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.061905 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="97da7c64-37d5-4f43-99f5-fb059140b5eb" containerName="console" Jun 15 08:25:55.064947 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.064930 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.067233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.067211 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:25:55.067337 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.067280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:25:55.068576 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.068550 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:25:55.075159 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.075133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq"] Jun 15 08:25:55.106782 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.106747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rv4l\" (UniqueName: \"kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.106964 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.106801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.106964 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.106856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.207515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.207474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rv4l\" (UniqueName: \"kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.207705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.207536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.207705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.207563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.207981 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.207960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.208073 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.208029 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.216234 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.216213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rv4l\" (UniqueName: \"kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.376559 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.376470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:25:55.503047 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.503023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq"] Jun 15 08:25:55.505247 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:25:55.505218 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea52c5d_9d81_4084_9d4b_389237de9aaa.slice/crio-85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986 WatchSource:0}: Error finding container 85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986: Status 404 returned error can't find the container with id 85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986 Jun 15 08:25:55.830114 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:25:55.830081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" event={"ID":"8ea52c5d-9d81-4084-9d4b-389237de9aaa","Type":"ContainerStarted","Data":"85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986"} Jun 15 08:26:02.861211 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:02.861173 2564 generic.go:356] "Generic (PLEG): container finished" podID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerID="589bdd4358d4f0ed044084cd056cdbe8fd8585289ea32d8d81573dc50663e1ba" exitCode=0 Jun 15 08:26:02.861590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:02.861262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" event={"ID":"8ea52c5d-9d81-4084-9d4b-389237de9aaa","Type":"ContainerDied","Data":"589bdd4358d4f0ed044084cd056cdbe8fd8585289ea32d8d81573dc50663e1ba"} Jun 15 08:26:05.875583 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:05.875547 2564 generic.go:356] "Generic (PLEG): container finished" podID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerID="52faa05babc36b47a8e5500b0d72d3797eb68daf367aa1b1b5e413bb35e1f9ad" exitCode=0 Jun 15 08:26:05.876061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:05.875625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" event={"ID":"8ea52c5d-9d81-4084-9d4b-389237de9aaa","Type":"ContainerDied","Data":"52faa05babc36b47a8e5500b0d72d3797eb68daf367aa1b1b5e413bb35e1f9ad"} Jun 15 08:26:14.915278 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:14.915181 2564 generic.go:356] "Generic (PLEG): container finished" podID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerID="6d71223e0af363541da12ef75c528ec2488c8fc0359c5029085a043e49eaf1cb" exitCode=0 Jun 15 08:26:14.915634 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:14.915276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" event={"ID":"8ea52c5d-9d81-4084-9d4b-389237de9aaa","Type":"ContainerDied","Data":"6d71223e0af363541da12ef75c528ec2488c8fc0359c5029085a043e49eaf1cb"} Jun 15 08:26:16.043218 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.043195 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:26:16.176986 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.176902 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rv4l\" (UniqueName: \"kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l\") pod \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " Jun 15 08:26:16.176986 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.176970 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle\") pod \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " Jun 15 08:26:16.176986 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.176990 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util\") pod \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\" (UID: \"8ea52c5d-9d81-4084-9d4b-389237de9aaa\") " Jun 15 08:26:16.177594 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.177564 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle" (OuterVolumeSpecName: "bundle") pod "8ea52c5d-9d81-4084-9d4b-389237de9aaa" (UID: "8ea52c5d-9d81-4084-9d4b-389237de9aaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:26:16.179021 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.178990 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l" (OuterVolumeSpecName: "kube-api-access-2rv4l") pod "8ea52c5d-9d81-4084-9d4b-389237de9aaa" (UID: "8ea52c5d-9d81-4084-9d4b-389237de9aaa"). InnerVolumeSpecName "kube-api-access-2rv4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:26:16.181270 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.181253 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util" (OuterVolumeSpecName: "util") pod "8ea52c5d-9d81-4084-9d4b-389237de9aaa" (UID: "8ea52c5d-9d81-4084-9d4b-389237de9aaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:26:16.277734 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.277707 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:16.277734 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.277727 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea52c5d-9d81-4084-9d4b-389237de9aaa-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:16.277734 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.277737 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rv4l\" (UniqueName: \"kubernetes.io/projected/8ea52c5d-9d81-4084-9d4b-389237de9aaa-kube-api-access-2rv4l\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:16.925243 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.925201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" event={"ID":"8ea52c5d-9d81-4084-9d4b-389237de9aaa","Type":"ContainerDied","Data":"85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986"} Jun 15 08:26:16.925243 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.925223 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dphmdq" Jun 15 08:26:16.925462 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:16.925260 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f2dc18c08f3155ca81fc4ad071c7dfe514dd38d0970e34dc38f89e57ca2986" Jun 15 08:26:21.065136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:21.065103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:22.058067 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:22.058028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:24.686542 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:24.686505 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:24.787046 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:24.787009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:28.735031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:28.734998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:28.861487 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:28.861454 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:28.961824 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:28.961792 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:30.463960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.463923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:30.564955 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.564917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:30.696536 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696496 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq"] Jun 15 08:26:30.696860 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696844 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="util" Jun 15 08:26:30.696860 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696878 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="util" Jun 15 08:26:30.697034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696900 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="pull" Jun 15 08:26:30.697034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696908 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="pull" Jun 15 08:26:30.697034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696917 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="extract" Jun 15 08:26:30.697034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.696925 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="extract" Jun 15 08:26:30.697034 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.697002 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea52c5d-9d81-4084-9d4b-389237de9aaa" containerName="extract" Jun 15 08:26:30.700125 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.700102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.702381 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.702359 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:26:30.703136 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.703116 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:26:30.703242 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.703139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:26:30.708067 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.708043 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq"] Jun 15 08:26:30.794898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.794802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.794898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.794841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.794898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.794897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmml\" (UniqueName: \"kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.896183 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.896149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmml\" (UniqueName: \"kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.896358 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.896205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.896358 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.896252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.896520 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.896506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.896558 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.896541 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:30.904957 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:30.904934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmml\" (UniqueName: \"kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:31.010012 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.009978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:31.144756 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.144681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq"] Jun 15 08:26:31.146919 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:26:31.146886 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f4c531_2f8c_4209_bc30_aefb7d490722.slice/crio-e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493 WatchSource:0}: Error finding container e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493: Status 404 returned error can't find the container with id e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493 Jun 15 08:26:31.228953 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.228913 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p9sks"] Jun 15 08:26:31.231901 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.231884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.234307 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.234281 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 08:26:31.234422 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.234326 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rkp5w\"" Jun 15 08:26:31.234470 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.234418 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 08:26:31.244097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.244076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p9sks"] Jun 15 08:26:31.299560 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.299524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.299745 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.299582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljf5m\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-kube-api-access-ljf5m\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.400767 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.400683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljf5m\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-kube-api-access-ljf5m\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.400767 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.400758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.409414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.409386 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.409509 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.409385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljf5m\" (UniqueName: \"kubernetes.io/projected/7eb18f49-cb7b-4f76-9c7d-9f0c23c23926-kube-api-access-ljf5m\") pod \"cert-manager-webhook-7dc76cbb94-p9sks\" (UID: \"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.541058 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.541012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:31.668699 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.668639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p9sks"] Jun 15 08:26:31.671285 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:26:31.671249 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eb18f49_cb7b_4f76_9c7d_9f0c23c23926.slice/crio-eadd67150861accaf8a4343c1e2f7152729467e9335eefc49018b1e05a05735a WatchSource:0}: Error finding container eadd67150861accaf8a4343c1e2f7152729467e9335eefc49018b1e05a05735a: Status 404 returned error can't find the container with id eadd67150861accaf8a4343c1e2f7152729467e9335eefc49018b1e05a05735a Jun 15 08:26:31.984575 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.984541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" event={"ID":"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926","Type":"ContainerStarted","Data":"eadd67150861accaf8a4343c1e2f7152729467e9335eefc49018b1e05a05735a"} Jun 15 08:26:31.985828 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.985807 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerID="dc1a946150b29d75ce1f70a169f98856a3ae51e3f64492a7369679b3a8c5470d" exitCode=0 Jun 15 08:26:31.985966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.985841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" event={"ID":"f4f4c531-2f8c-4209-bc30-aefb7d490722","Type":"ContainerDied","Data":"dc1a946150b29d75ce1f70a169f98856a3ae51e3f64492a7369679b3a8c5470d"} Jun 15 08:26:31.985966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:31.985892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" event={"ID":"f4f4c531-2f8c-4209-bc30-aefb7d490722","Type":"ContainerStarted","Data":"e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493"} Jun 15 08:26:32.043106 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:32.043080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:32.634968 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:32.634940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:36.011684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.011652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" event={"ID":"7eb18f49-cb7b-4f76-9c7d-9f0c23c23926","Type":"ContainerStarted","Data":"5c216c803d46620ac1ddccd31e3312233719d3c72a467d33c96e036552839140"} Jun 15 08:26:36.012120 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.011737 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:36.013290 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.013267 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerID="e0dfb0749fff2a78baac5c24e3dd9b67214b90021733237819d0669143e71ef7" exitCode=0 Jun 15 08:26:36.013398 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.013347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" event={"ID":"f4f4c531-2f8c-4209-bc30-aefb7d490722","Type":"ContainerDied","Data":"e0dfb0749fff2a78baac5c24e3dd9b67214b90021733237819d0669143e71ef7"} Jun 15 08:26:36.028175 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.028138 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" podStartSLOduration=1.315372135 podStartE2EDuration="5.028125363s" totalImagesPullingTime="3.712753228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:26:36.027479748 +0000 UTC m=+481.293099724" watchObservedRunningTime="2026-06-15 08:26:36.028125363 +0000 UTC m=+481.293745334" Jun 15 08:26:36.964271 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:36.964229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:37.017524 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:37.017491 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:37.019613 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:37.019591 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerID="1e561b61919b8834402a9f64282cd1e67314de0352368af432651da1d828bccf" exitCode=0 Jun 15 08:26:37.019705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:37.019673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" event={"ID":"f4f4c531-2f8c-4209-bc30-aefb7d490722","Type":"ContainerDied","Data":"1e561b61919b8834402a9f64282cd1e67314de0352368af432651da1d828bccf"} Jun 15 08:26:38.145972 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.145946 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:38.261011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.260983 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhmml\" (UniqueName: \"kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml\") pod \"f4f4c531-2f8c-4209-bc30-aefb7d490722\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " Jun 15 08:26:38.261182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.261061 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle\") pod \"f4f4c531-2f8c-4209-bc30-aefb7d490722\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " Jun 15 08:26:38.261182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.261104 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util\") pod \"f4f4c531-2f8c-4209-bc30-aefb7d490722\" (UID: \"f4f4c531-2f8c-4209-bc30-aefb7d490722\") " Jun 15 08:26:38.261428 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.261405 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle" (OuterVolumeSpecName: "bundle") pod "f4f4c531-2f8c-4209-bc30-aefb7d490722" (UID: "f4f4c531-2f8c-4209-bc30-aefb7d490722"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:26:38.263105 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.263083 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml" (OuterVolumeSpecName: "kube-api-access-vhmml") pod "f4f4c531-2f8c-4209-bc30-aefb7d490722" (UID: "f4f4c531-2f8c-4209-bc30-aefb7d490722"). InnerVolumeSpecName "kube-api-access-vhmml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:26:38.265182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.265161 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util" (OuterVolumeSpecName: "util") pod "f4f4c531-2f8c-4209-bc30-aefb7d490722" (UID: "f4f4c531-2f8c-4209-bc30-aefb7d490722"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:26:38.361684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.361599 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:38.361684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.361630 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4f4c531-2f8c-4209-bc30-aefb7d490722-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:38.361684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:38.361642 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhmml\" (UniqueName: \"kubernetes.io/projected/f4f4c531-2f8c-4209-bc30-aefb7d490722-kube-api-access-vhmml\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:26:39.029817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:39.029780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" event={"ID":"f4f4c531-2f8c-4209-bc30-aefb7d490722","Type":"ContainerDied","Data":"e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493"} Jun 15 08:26:39.029817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:39.029821 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6trmq" Jun 15 08:26:39.030033 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:39.029833 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e331779d6b35a079238ec86dff02946960ec2d89b43e6257feabab36e779b493" Jun 15 08:26:40.431389 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:40.431352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:42.022480 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:42.022449 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p9sks" Jun 15 08:26:47.892162 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:47.892127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:47.983881 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:47.983840 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:49.447610 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447577 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gxdhq"] Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447907 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="extract" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447920 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="extract" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447931 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="pull" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447936 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="pull" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447946 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="util" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.447953 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="util" Jun 15 08:26:49.448004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.448003 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f4c531-2f8c-4209-bc30-aefb7d490722" containerName="extract" Jun 15 08:26:49.450630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.450611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.453843 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.453824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q2vmh\"" Jun 15 08:26:49.462844 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.462819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gxdhq"] Jun 15 08:26:49.554948 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.554917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-bound-sa-token\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.555097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.554961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8p29\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-kube-api-access-c8p29\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.655545 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.655512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-bound-sa-token\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.655681 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.655568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8p29\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-kube-api-access-c8p29\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.667396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.667367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8p29\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-kube-api-access-c8p29\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.669150 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.669128 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b825c71c-2d6d-49ac-85e0-e710c9e999b4-bound-sa-token\") pod \"cert-manager-59c77684cc-gxdhq\" (UID: \"b825c71c-2d6d-49ac-85e0-e710c9e999b4\") " pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.759545 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.759463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gxdhq" Jun 15 08:26:49.888266 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:49.888138 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gxdhq"] Jun 15 08:26:49.890828 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:26:49.890802 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb825c71c_2d6d_49ac_85e0_e710c9e999b4.slice/crio-6eaee6bbc9ca301aa00a81f6c803dd66ad652bd138610f9351a8a7975a9f947f WatchSource:0}: Error finding container 6eaee6bbc9ca301aa00a81f6c803dd66ad652bd138610f9351a8a7975a9f947f: Status 404 returned error can't find the container with id 6eaee6bbc9ca301aa00a81f6c803dd66ad652bd138610f9351a8a7975a9f947f Jun 15 08:26:50.084883 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:50.084789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gxdhq" event={"ID":"b825c71c-2d6d-49ac-85e0-e710c9e999b4","Type":"ContainerStarted","Data":"1ce7426db4840939fc01cfea66542d4f72cc8165ff48778f4fcf0c10a7986c88"} Jun 15 08:26:50.084883 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:50.084828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gxdhq" event={"ID":"b825c71c-2d6d-49ac-85e0-e710c9e999b4","Type":"ContainerStarted","Data":"6eaee6bbc9ca301aa00a81f6c803dd66ad652bd138610f9351a8a7975a9f947f"} Jun 15 08:26:50.103936 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:50.103889 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gxdhq" podStartSLOduration=1.1038598 podStartE2EDuration="1.1038598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:26:50.102107016 +0000 UTC m=+495.367726984" watchObservedRunningTime="2026-06-15 08:26:50.1038598 +0000 UTC m=+495.369479769" Jun 15 08:26:54.356779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:54.356745 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:54.455051 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:54.455017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:56.351140 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.351104 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp"] Jun 15 08:26:56.353340 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.353324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.355726 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.355701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:26:56.355831 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.355732 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:26:56.356583 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.356552 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:26:56.363854 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.363834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp"] Jun 15 08:26:56.404962 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.404921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmx8b\" (UniqueName: \"kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.405093 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.404986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.405093 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.405014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.483997 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.483961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:26:56.506122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.506095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmx8b\" (UniqueName: \"kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.506225 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.506135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.506225 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.506154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.506545 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.506526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.506585 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.506539 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.513956 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.513930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmx8b\" (UniqueName: \"kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.664776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.664700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:26:56.790853 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:56.790714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp"] Jun 15 08:26:56.793542 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:26:56.793516 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8146ade1_fa79_4199_8ebd_003995a286bf.slice/crio-e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19 WatchSource:0}: Error finding container e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19: Status 404 returned error can't find the container with id e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19 Jun 15 08:26:57.113204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:57.113166 2564 generic.go:356] "Generic (PLEG): container finished" podID="8146ade1-fa79-4199-8ebd-003995a286bf" containerID="72a835482a383a423902a72daaaa690aa968962280725742f9e389d38818efda" exitCode=0 Jun 15 08:26:57.113353 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:57.113252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" event={"ID":"8146ade1-fa79-4199-8ebd-003995a286bf","Type":"ContainerDied","Data":"72a835482a383a423902a72daaaa690aa968962280725742f9e389d38818efda"} Jun 15 08:26:57.113353 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:57.113296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" event={"ID":"8146ade1-fa79-4199-8ebd-003995a286bf","Type":"ContainerStarted","Data":"e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19"} Jun 15 08:26:58.119646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:58.119564 2564 generic.go:356] "Generic (PLEG): container finished" podID="8146ade1-fa79-4199-8ebd-003995a286bf" containerID="b745db1a27bda216c9e551f3fbc58250b333c5150b1e168520e8460fcc6b994f" exitCode=0 Jun 15 08:26:58.119646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:58.119632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" event={"ID":"8146ade1-fa79-4199-8ebd-003995a286bf","Type":"ContainerDied","Data":"b745db1a27bda216c9e551f3fbc58250b333c5150b1e168520e8460fcc6b994f"} Jun 15 08:26:59.125818 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:59.125780 2564 generic.go:356] "Generic (PLEG): container finished" podID="8146ade1-fa79-4199-8ebd-003995a286bf" containerID="bed39eebf42639868cf5ce88b97e845e150dc10b8687679e6cfb32e2d9bc1746" exitCode=0 Jun 15 08:26:59.126211 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:26:59.125889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" event={"ID":"8146ade1-fa79-4199-8ebd-003995a286bf","Type":"ContainerDied","Data":"bed39eebf42639868cf5ce88b97e845e150dc10b8687679e6cfb32e2d9bc1746"} Jun 15 08:27:00.258813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.258784 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:27:00.333390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.333357 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util\") pod \"8146ade1-fa79-4199-8ebd-003995a286bf\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " Jun 15 08:27:00.338431 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.338400 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util" (OuterVolumeSpecName: "util") pod "8146ade1-fa79-4199-8ebd-003995a286bf" (UID: "8146ade1-fa79-4199-8ebd-003995a286bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:00.433892 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.433854 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle\") pod \"8146ade1-fa79-4199-8ebd-003995a286bf\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " Jun 15 08:27:00.434006 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.433906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmx8b\" (UniqueName: \"kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b\") pod \"8146ade1-fa79-4199-8ebd-003995a286bf\" (UID: \"8146ade1-fa79-4199-8ebd-003995a286bf\") " Jun 15 08:27:00.434063 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.434054 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:00.434486 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.434456 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle" (OuterVolumeSpecName: "bundle") pod "8146ade1-fa79-4199-8ebd-003995a286bf" (UID: "8146ade1-fa79-4199-8ebd-003995a286bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:00.435916 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.435884 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b" (OuterVolumeSpecName: "kube-api-access-fmx8b") pod "8146ade1-fa79-4199-8ebd-003995a286bf" (UID: "8146ade1-fa79-4199-8ebd-003995a286bf"). InnerVolumeSpecName "kube-api-access-fmx8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:27:00.534413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.534381 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146ade1-fa79-4199-8ebd-003995a286bf-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:00.534413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:00.534409 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmx8b\" (UniqueName: \"kubernetes.io/projected/8146ade1-fa79-4199-8ebd-003995a286bf-kube-api-access-fmx8b\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:01.137405 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:01.137375 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" Jun 15 08:27:01.137405 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:01.137387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhqjrp" event={"ID":"8146ade1-fa79-4199-8ebd-003995a286bf","Type":"ContainerDied","Data":"e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19"} Jun 15 08:27:01.137649 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:01.137427 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e159b584962f2f2888e7059f3287b12b1f4b7486b85647ddec77c1544c490f19" Jun 15 08:27:08.083572 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:08.083512 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:08.181296 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:08.181264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:08.692740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:08.692706 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:08.924704 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:08.924674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.032420 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.032339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.101773 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.101728 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br"] Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102068 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="extract" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102081 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="extract" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102089 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="util" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102094 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="util" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102105 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="pull" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102113 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="pull" Jun 15 08:27:09.102167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.102167 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8146ade1-fa79-4199-8ebd-003995a286bf" containerName="extract" Jun 15 08:27:09.148564 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.148532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.152158 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.152093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fd6vf\"" Jun 15 08:27:09.152365 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.152164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 08:27:09.152365 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.152212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 08:27:09.152923 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.152902 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 08:27:09.153029 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.152922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 08:27:09.155379 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.155355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br"] Jun 15 08:27:09.195831 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.195798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.195831 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.195831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.196122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.195883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.196122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.195980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.196122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.196026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9fpc\" (UniqueName: \"kubernetes.io/projected/a7d1e815-9ee8-40fd-ab63-8695141df36e-kube-api-access-z9fpc\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.296748 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.296675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.296748 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.296709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.296748 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.296739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.297031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.296784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.297031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.296800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9fpc\" (UniqueName: \"kubernetes.io/projected/a7d1e815-9ee8-40fd-ab63-8695141df36e-kube-api-access-z9fpc\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.297263 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.297240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.299103 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.299067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d1e815-9ee8-40fd-ab63-8695141df36e-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.299205 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.299170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.299286 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.299261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d1e815-9ee8-40fd-ab63-8695141df36e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.308917 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.308894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9fpc\" (UniqueName: \"kubernetes.io/projected/a7d1e815-9ee8-40fd-ab63-8695141df36e-kube-api-access-z9fpc\") pod \"opendatahub-operator-controller-manager-6996b7d859-rs5br\" (UID: \"a7d1e815-9ee8-40fd-ab63-8695141df36e\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.363436 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.363409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.458409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.458376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.459310 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.459290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:09.558261 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.558195 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.631828 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.631805 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br"] Jun 15 08:27:09.633881 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:27:09.633832 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d1e815_9ee8_40fd_ab63_8695141df36e.slice/crio-6a0af76da59e583892640305c1b9f05d077276a4323f416bc9c380de2b2f2b28 WatchSource:0}: Error finding container 6a0af76da59e583892640305c1b9f05d077276a4323f416bc9c380de2b2f2b28: Status 404 returned error can't find the container with id 6a0af76da59e583892640305c1b9f05d077276a4323f416bc9c380de2b2f2b28 Jun 15 08:27:09.658842 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.658809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.759707 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.759675 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.861123 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.861048 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:09.960038 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:09.960003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:10.179733 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:10.179613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" event={"ID":"a7d1e815-9ee8-40fd-ab63-8695141df36e","Type":"ContainerStarted","Data":"6a0af76da59e583892640305c1b9f05d077276a4323f416bc9c380de2b2f2b28"} Jun 15 08:27:13.198637 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:13.198601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" event={"ID":"a7d1e815-9ee8-40fd-ab63-8695141df36e","Type":"ContainerStarted","Data":"864914f836cea6a7918f6aa0b60e7a5b06de4848e68bcf93ad6e0577858edc00"} Jun 15 08:27:14.203710 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:14.203676 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7d1e815-9ee8-40fd-ab63-8695141df36e" containerID="864914f836cea6a7918f6aa0b60e7a5b06de4848e68bcf93ad6e0577858edc00" exitCode=0 Jun 15 08:27:14.204155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:14.203766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" event={"ID":"a7d1e815-9ee8-40fd-ab63-8695141df36e","Type":"ContainerDied","Data":"864914f836cea6a7918f6aa0b60e7a5b06de4848e68bcf93ad6e0577858edc00"} Jun 15 08:27:15.209456 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:15.209424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" event={"ID":"a7d1e815-9ee8-40fd-ab63-8695141df36e","Type":"ContainerStarted","Data":"f696f5a913bef20a87991e0da210c92e0324e223de9de6b324f18aa750ff849d"} Jun 15 08:27:15.209828 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:15.209553 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:15.232221 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:15.232175 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" podStartSLOduration=1.895340552 podStartE2EDuration="6.23216044s" totalImagesPullingTime="3.391346911s" totalInitContainerRuntime="945.472977ms" isStatefulPod=false podCreationTimestamp="2026-06-15 08:27:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:27:15.230078131 +0000 UTC m=+520.495698112" watchObservedRunningTime="2026-06-15 08:27:15.23216044 +0000 UTC m=+520.497780410" Jun 15 08:27:16.747674 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:16.747636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:16.831021 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:16.830992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:26.216623 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:26.216541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-rs5br" Jun 15 08:27:27.920515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:27.920482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.039817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.039789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.398016 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.397987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.529942 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.529902 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw"] Jun 15 08:27:28.533585 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.533566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.536644 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.536623 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nb97m\"" Jun 15 08:27:28.537020 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.537006 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 08:27:28.537251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.537234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 08:27:28.538458 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.538408 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.554359 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.554329 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw"] Jun 15 08:27:28.663101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.663005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.663101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.663058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tmp\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.663101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.663098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrgv\" (UniqueName: \"kubernetes.io/projected/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-kube-api-access-hqrgv\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.764219 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.764183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tmp\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.764402 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.764230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrgv\" (UniqueName: \"kubernetes.io/projected/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-kube-api-access-hqrgv\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.764402 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.764272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.764402 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:27:28.764397 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 15 08:27:28.764583 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:27:28.764453 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs podName:43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1 nodeName:}" failed. No retries permitted until 2026-06-15 08:27:29.264435321 +0000 UTC m=+534.530055283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs") pod "kube-auth-proxy-b895ff9c6-j49fw" (UID: "43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1") : secret "kube-auth-proxy-tls" not found Jun 15 08:27:28.768019 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.767989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tmp\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.775733 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.775704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrgv\" (UniqueName: \"kubernetes.io/projected/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-kube-api-access-hqrgv\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:28.783702 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.783676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.888304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.888263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:28.984540 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:28.984511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:29.238108 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.238025 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh"] Jun 15 08:27:29.241287 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.241271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.243958 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.243936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7rn6b\"" Jun 15 08:27:29.244049 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.244033 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 08:27:29.244802 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.244781 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 08:27:29.244945 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.244789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 08:27:29.244945 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.244900 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:27:29.245061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.244825 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 08:27:29.268274 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.268245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:29.270593 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.270571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1-tls-certs\") pod \"kube-auth-proxy-b895ff9c6-j49fw\" (UID: \"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1\") " pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:29.274723 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.274701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh"] Jun 15 08:27:29.369998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.369954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zhk\" (UniqueName: \"kubernetes.io/projected/4852ade3-52cb-40bf-9bc8-8907468b4140-kube-api-access-j7zhk\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.370190 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.370085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.370190 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.370159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.370319 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.370216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4852ade3-52cb-40bf-9bc8-8907468b4140-manager-config\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.433438 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.433396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:29.443167 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.443140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" Jun 15 08:27:29.470933 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.470900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4852ade3-52cb-40bf-9bc8-8907468b4140-manager-config\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.471110 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.471003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zhk\" (UniqueName: \"kubernetes.io/projected/4852ade3-52cb-40bf-9bc8-8907468b4140-kube-api-access-j7zhk\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.471110 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.471048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.471110 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.471094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.471824 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.471653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4852ade3-52cb-40bf-9bc8-8907468b4140-manager-config\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.474377 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.474351 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.474540 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.474378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4852ade3-52cb-40bf-9bc8-8907468b4140-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.484522 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.484495 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zhk\" (UniqueName: \"kubernetes.io/projected/4852ade3-52cb-40bf-9bc8-8907468b4140-kube-api-access-j7zhk\") pod \"lws-controller-manager-6bd5868f66-l86kh\" (UID: \"4852ade3-52cb-40bf-9bc8-8907468b4140\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.551358 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.551320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:29.588471 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.588430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw"] Jun 15 08:27:29.591017 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:27:29.590989 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ec0eea_710d_4cb4_8adc_5ef7ed6f4bb1.slice/crio-ed5d2a21caaf2a693be511cc7d270e94254a918858c7494952f337dc19a1eee0 WatchSource:0}: Error finding container ed5d2a21caaf2a693be511cc7d270e94254a918858c7494952f337dc19a1eee0: Status 404 returned error can't find the container with id ed5d2a21caaf2a693be511cc7d270e94254a918858c7494952f337dc19a1eee0 Jun 15 08:27:29.689948 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.689919 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh"] Jun 15 08:27:29.691357 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:27:29.691332 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4852ade3_52cb_40bf_9bc8_8907468b4140.slice/crio-f5b06931883d51fef2188dcc39fb37d081c5c7cd3575fc0d3415cad79cdc6d49 WatchSource:0}: Error finding container f5b06931883d51fef2188dcc39fb37d081c5c7cd3575fc0d3415cad79cdc6d49: Status 404 returned error can't find the container with id f5b06931883d51fef2188dcc39fb37d081c5c7cd3575fc0d3415cad79cdc6d49 Jun 15 08:27:29.776669 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:29.776554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:30.276459 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.276381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" event={"ID":"4852ade3-52cb-40bf-9bc8-8907468b4140","Type":"ContainerStarted","Data":"f5b06931883d51fef2188dcc39fb37d081c5c7cd3575fc0d3415cad79cdc6d49"} Jun 15 08:27:30.278727 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.278701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" event={"ID":"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1","Type":"ContainerStarted","Data":"ed5d2a21caaf2a693be511cc7d270e94254a918858c7494952f337dc19a1eee0"} Jun 15 08:27:30.486317 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.486279 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg"] Jun 15 08:27:30.490879 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.490840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.493762 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.493737 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:27:30.493895 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.493773 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:27:30.494737 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.494539 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:27:30.498818 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.498764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg"] Jun 15 08:27:30.580283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.580138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.580283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.580194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thxbs\" (UniqueName: \"kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.580482 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.580406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.681112 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.681065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.681345 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.681126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.681345 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.681162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thxbs\" (UniqueName: \"kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.681485 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.681461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.681557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.681537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.689871 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.689841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thxbs\" (UniqueName: \"kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:30.804577 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:30.804545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:31.588490 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:31.588465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg"] Jun 15 08:27:31.590991 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:27:31.590962 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573d7711_b3da_4723_ac8e_a3f1e2e811b1.slice/crio-4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62 WatchSource:0}: Error finding container 4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62: Status 404 returned error can't find the container with id 4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62 Jun 15 08:27:32.290795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:32.290760 2564 generic.go:356] "Generic (PLEG): container finished" podID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerID="5cbcfa51deb2e6dc64f602e596a56938aa3db802468d4f091d759de5a62cc1a6" exitCode=0 Jun 15 08:27:32.290989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:32.290826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerDied","Data":"5cbcfa51deb2e6dc64f602e596a56938aa3db802468d4f091d759de5a62cc1a6"} Jun 15 08:27:32.290989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:32.290905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerStarted","Data":"4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62"} Jun 15 08:27:33.298843 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.298808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerStarted","Data":"f157140268a85b4600c683d27206fe023166a7fe0319bc7cb8aa78806222455d"} Jun 15 08:27:33.300636 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.300605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" event={"ID":"4852ade3-52cb-40bf-9bc8-8907468b4140","Type":"ContainerStarted","Data":"b4334d246153a31d1bb91fb82c5ffd08f908e85cb994d297cf43e57b5265baba"} Jun 15 08:27:33.300763 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.300700 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:33.302331 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.302309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" event={"ID":"43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1","Type":"ContainerStarted","Data":"1784d01c0eafcdd37fd03c1d5fc23edbef81634564784d1feff12e12feb3498f"} Jun 15 08:27:33.338991 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.338946 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" podStartSLOduration=1.196042548 podStartE2EDuration="4.338931204s" totalImagesPullingTime="3.142888656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:27:33.33703121 +0000 UTC m=+538.602651181" watchObservedRunningTime="2026-06-15 08:27:33.338931204 +0000 UTC m=+538.604551173" Jun 15 08:27:33.354504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:33.354460 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b895ff9c6-j49fw" podStartSLOduration=2.107557455 podStartE2EDuration="5.354450389s" totalImagesPullingTime="3.246892934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:27:33.352938487 +0000 UTC m=+538.618558483" watchObservedRunningTime="2026-06-15 08:27:33.354450389 +0000 UTC m=+538.620070359" Jun 15 08:27:34.309417 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:34.309380 2564 generic.go:356] "Generic (PLEG): container finished" podID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerID="f157140268a85b4600c683d27206fe023166a7fe0319bc7cb8aa78806222455d" exitCode=0 Jun 15 08:27:34.309809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:34.309467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerDied","Data":"f157140268a85b4600c683d27206fe023166a7fe0319bc7cb8aa78806222455d"} Jun 15 08:27:35.315794 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:35.315763 2564 generic.go:356] "Generic (PLEG): container finished" podID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerID="4d6673421cdf6bf650cc9565aa0f3b9337e1e6d1b86564856ea909c9115b279a" exitCode=0 Jun 15 08:27:35.316156 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:35.315801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerDied","Data":"4d6673421cdf6bf650cc9565aa0f3b9337e1e6d1b86564856ea909c9115b279a"} Jun 15 08:27:36.447060 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.447030 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:36.532599 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.532564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util\") pod \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " Jun 15 08:27:36.532761 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.532624 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle\") pod \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " Jun 15 08:27:36.532761 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.532660 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thxbs\" (UniqueName: \"kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs\") pod \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\" (UID: \"573d7711-b3da-4723-ac8e-a3f1e2e811b1\") " Jun 15 08:27:36.533505 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.533465 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle" (OuterVolumeSpecName: "bundle") pod "573d7711-b3da-4723-ac8e-a3f1e2e811b1" (UID: "573d7711-b3da-4723-ac8e-a3f1e2e811b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:36.534767 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.534737 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs" (OuterVolumeSpecName: "kube-api-access-thxbs") pod "573d7711-b3da-4723-ac8e-a3f1e2e811b1" (UID: "573d7711-b3da-4723-ac8e-a3f1e2e811b1"). InnerVolumeSpecName "kube-api-access-thxbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:27:36.538141 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.538108 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util" (OuterVolumeSpecName: "util") pod "573d7711-b3da-4723-ac8e-a3f1e2e811b1" (UID: "573d7711-b3da-4723-ac8e-a3f1e2e811b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:36.634104 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.634019 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:36.634104 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.634049 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thxbs\" (UniqueName: \"kubernetes.io/projected/573d7711-b3da-4723-ac8e-a3f1e2e811b1-kube-api-access-thxbs\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:36.634104 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:36.634060 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/573d7711-b3da-4723-ac8e-a3f1e2e811b1-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:37.327093 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:37.327056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" event={"ID":"573d7711-b3da-4723-ac8e-a3f1e2e811b1","Type":"ContainerDied","Data":"4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62"} Jun 15 08:27:37.327289 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:37.327104 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4accb149640c947e0c1a3496db7d2a767ffca9a060abf8399529aafb8a0a8c62" Jun 15 08:27:37.327289 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:37.327107 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067qhxg" Jun 15 08:27:39.848692 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:39.848651 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:39.953055 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:39.953024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:40.039773 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:40.039738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:40.149806 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:40.149728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:41.185396 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:41.185364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:41.281521 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:41.281464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:44.311845 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:44.311812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-l86kh" Jun 15 08:27:45.505887 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:45.505843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:45.603751 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:45.603719 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:46.817531 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817494 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4"] Jun 15 08:27:46.817898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817852 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="extract" Jun 15 08:27:46.817898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817885 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="extract" Jun 15 08:27:46.817898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817894 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="pull" Jun 15 08:27:46.817898 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817900 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="pull" Jun 15 08:27:46.818031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817914 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="util" Jun 15 08:27:46.818031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817919 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="util" Jun 15 08:27:46.818031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.817974 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="573d7711-b3da-4723-ac8e-a3f1e2e811b1" containerName="extract" Jun 15 08:27:46.888776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.888741 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4"] Jun 15 08:27:46.888963 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.888897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:46.897528 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.897506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:27:46.906684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.906665 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:27:46.908309 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:46.908290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:27:47.023416 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.023376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwz6\" (UniqueName: \"kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.023581 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.023428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.023581 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.023487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.040057 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.040026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:47.124256 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.124172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.124256 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.124212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.124470 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.124273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwz6\" (UniqueName: \"kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.124567 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.124547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.124632 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.124613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.146370 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.146340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwz6\" (UniqueName: \"kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.158331 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.158302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:47.198648 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.198616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:47.359288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.359258 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4"] Jun 15 08:27:47.360714 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:27:47.360690 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640398c7_2229_4a6e_9fc1_cf45bdde749a.slice/crio-1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181 WatchSource:0}: Error finding container 1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181: Status 404 returned error can't find the container with id 1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181 Jun 15 08:27:47.375180 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.375112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:47.380430 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.380388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" event={"ID":"640398c7-2229-4a6e-9fc1-cf45bdde749a","Type":"ContainerStarted","Data":"1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181"} Jun 15 08:27:47.924701 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:47.924668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:48.131379 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:48.131346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:48.386423 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:48.386389 2564 generic.go:356] "Generic (PLEG): container finished" podID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerID="fdd3b7ac63520a1423b4d05106eec06ff364bf87a387aaf59823cbfff82d2335" exitCode=0 Jun 15 08:27:48.386630 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:48.386481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" event={"ID":"640398c7-2229-4a6e-9fc1-cf45bdde749a","Type":"ContainerDied","Data":"fdd3b7ac63520a1423b4d05106eec06ff364bf87a387aaf59823cbfff82d2335"} Jun 15 08:27:49.393312 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:49.393226 2564 generic.go:356] "Generic (PLEG): container finished" podID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerID="2a5b94493c3a604450fcaf53e865d4046d81d3b7aecc624cc30983c9f73daabc" exitCode=0 Jun 15 08:27:49.393312 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:49.393274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" event={"ID":"640398c7-2229-4a6e-9fc1-cf45bdde749a","Type":"ContainerDied","Data":"2a5b94493c3a604450fcaf53e865d4046d81d3b7aecc624cc30983c9f73daabc"} Jun 15 08:27:50.399538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:50.399500 2564 generic.go:356] "Generic (PLEG): container finished" podID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerID="42bf0d0c8f1c9f7729ba839b9a2596fc98f5b79d4cd046fe8bca4dcd660c5511" exitCode=0 Jun 15 08:27:50.399916 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:50.399581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" event={"ID":"640398c7-2229-4a6e-9fc1-cf45bdde749a","Type":"ContainerDied","Data":"42bf0d0c8f1c9f7729ba839b9a2596fc98f5b79d4cd046fe8bca4dcd660c5511"} Jun 15 08:27:51.526094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.526071 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:51.664251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.664156 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle\") pod \"640398c7-2229-4a6e-9fc1-cf45bdde749a\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " Jun 15 08:27:51.664251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.664228 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llwz6\" (UniqueName: \"kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6\") pod \"640398c7-2229-4a6e-9fc1-cf45bdde749a\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " Jun 15 08:27:51.664744 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.664268 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util\") pod \"640398c7-2229-4a6e-9fc1-cf45bdde749a\" (UID: \"640398c7-2229-4a6e-9fc1-cf45bdde749a\") " Jun 15 08:27:51.665093 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.665067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle" (OuterVolumeSpecName: "bundle") pod "640398c7-2229-4a6e-9fc1-cf45bdde749a" (UID: "640398c7-2229-4a6e-9fc1-cf45bdde749a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:51.666305 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.666280 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6" (OuterVolumeSpecName: "kube-api-access-llwz6") pod "640398c7-2229-4a6e-9fc1-cf45bdde749a" (UID: "640398c7-2229-4a6e-9fc1-cf45bdde749a"). InnerVolumeSpecName "kube-api-access-llwz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:27:51.669713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.669688 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util" (OuterVolumeSpecName: "util") pod "640398c7-2229-4a6e-9fc1-cf45bdde749a" (UID: "640398c7-2229-4a6e-9fc1-cf45bdde749a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:27:51.765101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.765067 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llwz6\" (UniqueName: \"kubernetes.io/projected/640398c7-2229-4a6e-9fc1-cf45bdde749a-kube-api-access-llwz6\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:51.765101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.765095 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:51.765101 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:51.765104 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640398c7-2229-4a6e-9fc1-cf45bdde749a-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:27:52.410742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:52.410718 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" Jun 15 08:27:52.410914 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:52.410747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqjks4" event={"ID":"640398c7-2229-4a6e-9fc1-cf45bdde749a","Type":"ContainerDied","Data":"1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181"} Jun 15 08:27:52.410914 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:52.410793 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f7478d3a2afa5522873c52931195153328e1fe2c5b027c44489542f45650181" Jun 15 08:27:58.399248 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:58.399214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:58.486664 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:58.486627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:58.588338 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:58.588305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:27:58.956529 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:27:58.956499 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:02.881159 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:02.881122 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:02.980916 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:02.980859 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:03.278984 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:03.278952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:03.489304 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:03.489272 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:03.679473 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:03.679395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:08.067186 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:08.067149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:09.605709 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:09.605678 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:09.706799 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:09.706766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:11.464761 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:11.464731 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:11.538170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:11.538132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:28.454232 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:28.454191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:28.511509 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:28.511477 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:29.599920 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:29.599881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:29.699234 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:29.699199 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:29.780693 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:29.780660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:30.532030 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:30.531998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:30.730127 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:30.730100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:32.245426 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:32.245397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:32.300902 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:32.300860 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:35.191138 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:35.191111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:28:35.192720 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:35.192698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:28:38.855989 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:38.855952 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:28:38.969265 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:38.969229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:40.128233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:40.128197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:28:45.341465 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341434 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7"] Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341763 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="util" Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341774 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="util" Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341786 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="pull" Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341791 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="pull" Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341799 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="extract" Jun 15 08:28:45.341832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341806 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="extract" Jun 15 08:28:45.342063 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.341877 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="640398c7-2229-4a6e-9fc1-cf45bdde749a" containerName="extract" Jun 15 08:28:45.344447 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.344431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.347118 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.347101 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 08:28:45.347796 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.347778 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hv5s6\"" Jun 15 08:28:45.347847 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.347778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 08:28:45.353517 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.353494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7"] Jun 15 08:28:45.520789 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.520754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhr76\" (UniqueName: \"kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.520972 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.520808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.520972 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.520929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.622043 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.621962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.622043 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.622009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhr76\" (UniqueName: \"kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.622263 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.622056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.622347 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.622325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.622413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.622392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.630029 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.629998 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhr76\" (UniqueName: \"kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.652995 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.652967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:45.736770 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.736739 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6"] Jun 15 08:28:45.740998 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.740976 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:45.752474 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.752445 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6"] Jun 15 08:28:45.784146 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.784118 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7"] Jun 15 08:28:45.786146 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:28:45.786119 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8a0202_c4b9_44f2_9873_6f024c6f3ae0.slice/crio-476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0 WatchSource:0}: Error finding container 476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0: Status 404 returned error can't find the container with id 476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0 Jun 15 08:28:45.924552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.924527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:45.924686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.924606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzzkf\" (UniqueName: \"kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:45.924686 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:45.924626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.025437 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.025407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzzkf\" (UniqueName: \"kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.025586 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.025443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.025586 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.025472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.025819 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.025799 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.025858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.025827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.034350 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.034328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzzkf\" (UniqueName: \"kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.051252 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.051234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:46.140342 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.140312 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq"] Jun 15 08:28:46.144908 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.144888 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.155962 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.155938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq"] Jun 15 08:28:46.185499 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.185474 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6"] Jun 15 08:28:46.187960 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:28:46.187933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee44047_7f5a_48ac_8e9c_e782ffcc69c2.slice/crio-6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398 WatchSource:0}: Error finding container 6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398: Status 404 returned error can't find the container with id 6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398 Jun 15 08:28:46.327935 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.327905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.328068 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.327954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.328115 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.328095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqts4\" (UniqueName: \"kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.429238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.429138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqts4\" (UniqueName: \"kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.429238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.429197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.429238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.429230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.429727 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.429545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.429727 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.429589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.438129 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.438112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqts4\" (UniqueName: \"kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.457023 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.457001 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:46.545512 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.545478 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw"] Jun 15 08:28:46.549781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.549760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.557546 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.557519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw"] Jun 15 08:28:46.604354 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.604328 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq"] Jun 15 08:28:46.606576 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:28:46.606547 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e67466_a33f_4685_b746_a6fb9088db85.slice/crio-ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d WatchSource:0}: Error finding container ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d: Status 404 returned error can't find the container with id ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d Jun 15 08:28:46.677715 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.677689 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerID="8a7aebd0610ccb2aded8950368f3658aa6fcefa6b1dcc55516da222098b4204d" exitCode=0 Jun 15 08:28:46.677855 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.677776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" event={"ID":"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0","Type":"ContainerDied","Data":"8a7aebd0610ccb2aded8950368f3658aa6fcefa6b1dcc55516da222098b4204d"} Jun 15 08:28:46.677951 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.677883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" event={"ID":"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0","Type":"ContainerStarted","Data":"476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0"} Jun 15 08:28:46.679695 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.679641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" event={"ID":"18e67466-a33f-4685-b746-a6fb9088db85","Type":"ContainerStarted","Data":"ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d"} Jun 15 08:28:46.681181 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.681159 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerID="8d08052f178d2d05ac062ae91720bcb76cf249bdc0b474de27ffc9d96596feee" exitCode=0 Jun 15 08:28:46.681271 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.681246 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" event={"ID":"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2","Type":"ContainerDied","Data":"8d08052f178d2d05ac062ae91720bcb76cf249bdc0b474de27ffc9d96596feee"} Jun 15 08:28:46.681319 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.681287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" event={"ID":"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2","Type":"ContainerStarted","Data":"6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398"} Jun 15 08:28:46.732326 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.732291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.732466 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.732390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vzt\" (UniqueName: \"kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.732466 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.732442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.833231 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.833189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.833430 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.833259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vzt\" (UniqueName: \"kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.833491 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.833441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.833660 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.833638 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.833814 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.833790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.848685 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.848654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vzt\" (UniqueName: \"kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.863542 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.863515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:46.991253 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:46.991229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw"] Jun 15 08:28:46.993184 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:28:46.993160 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75bb6bf_8d20_47fd_8d44_6e33f19ca3c3.slice/crio-d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae WatchSource:0}: Error finding container d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae: Status 404 returned error can't find the container with id d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae Jun 15 08:28:47.687859 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.687827 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerID="f6eea871a820211d84262d4a89f36b7eca76ff473e41ef7ca3c1f3593ac139db" exitCode=0 Jun 15 08:28:47.688302 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.687897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" event={"ID":"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0","Type":"ContainerDied","Data":"f6eea871a820211d84262d4a89f36b7eca76ff473e41ef7ca3c1f3593ac139db"} Jun 15 08:28:47.689431 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.689404 2564 generic.go:356] "Generic (PLEG): container finished" podID="18e67466-a33f-4685-b746-a6fb9088db85" containerID="f82b9449c48e771d0211be754072e0559e2a422e4616472e5be0420dda3e2ea9" exitCode=0 Jun 15 08:28:47.689545 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.689439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" event={"ID":"18e67466-a33f-4685-b746-a6fb9088db85","Type":"ContainerDied","Data":"f82b9449c48e771d0211be754072e0559e2a422e4616472e5be0420dda3e2ea9"} Jun 15 08:28:47.691435 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.691416 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerID="7dcc54b2f9357acc8ef1fc3ad51ed3adbea9d4bd957e12f73c402c0510b40671" exitCode=0 Jun 15 08:28:47.691523 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.691483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" event={"ID":"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2","Type":"ContainerDied","Data":"7dcc54b2f9357acc8ef1fc3ad51ed3adbea9d4bd957e12f73c402c0510b40671"} Jun 15 08:28:47.693035 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.693015 2564 generic.go:356] "Generic (PLEG): container finished" podID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerID="7620fcd39007cecdc5c41cff166543a4856f0b217fbbb022b730da0588f512da" exitCode=0 Jun 15 08:28:47.693246 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.693135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" event={"ID":"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3","Type":"ContainerDied","Data":"7620fcd39007cecdc5c41cff166543a4856f0b217fbbb022b730da0588f512da"} Jun 15 08:28:47.693246 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:47.693177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" event={"ID":"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3","Type":"ContainerStarted","Data":"d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae"} Jun 15 08:28:48.700052 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.700021 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerID="0f402775543ea53ea3f4c708e53655332a6cc118b6859cdb5b0417da1e6b051c" exitCode=0 Jun 15 08:28:48.700417 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.700113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" event={"ID":"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0","Type":"ContainerDied","Data":"0f402775543ea53ea3f4c708e53655332a6cc118b6859cdb5b0417da1e6b051c"} Jun 15 08:28:48.701975 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.701951 2564 generic.go:356] "Generic (PLEG): container finished" podID="18e67466-a33f-4685-b746-a6fb9088db85" containerID="1cd541893cff427e878327a8d45c1dc043e91daedb35d20d4bae1c424dcc5dd1" exitCode=0 Jun 15 08:28:48.702069 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.702024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" event={"ID":"18e67466-a33f-4685-b746-a6fb9088db85","Type":"ContainerDied","Data":"1cd541893cff427e878327a8d45c1dc043e91daedb35d20d4bae1c424dcc5dd1"} Jun 15 08:28:48.704295 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.704272 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerID="a2ae03a386154b4ad1874fb0adab852f887b33cdb295628dd39b3d32683e603c" exitCode=0 Jun 15 08:28:48.704364 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.704329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" event={"ID":"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2","Type":"ContainerDied","Data":"a2ae03a386154b4ad1874fb0adab852f887b33cdb295628dd39b3d32683e603c"} Jun 15 08:28:48.705942 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.705924 2564 generic.go:356] "Generic (PLEG): container finished" podID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerID="fa600d8ef126af6ad6fff3a7cad6ccab0d74bfe8498d530e48167d5fcd4848f8" exitCode=0 Jun 15 08:28:48.706018 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:48.706003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" event={"ID":"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3","Type":"ContainerDied","Data":"fa600d8ef126af6ad6fff3a7cad6ccab0d74bfe8498d530e48167d5fcd4848f8"} Jun 15 08:28:49.713272 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.713229 2564 generic.go:356] "Generic (PLEG): container finished" podID="18e67466-a33f-4685-b746-a6fb9088db85" containerID="5adfe85e772a5765a62ba2d22dc2cce4e48d7a5c3baeb25e7add34b6b1b66f47" exitCode=0 Jun 15 08:28:49.713715 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.713312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" event={"ID":"18e67466-a33f-4685-b746-a6fb9088db85","Type":"ContainerDied","Data":"5adfe85e772a5765a62ba2d22dc2cce4e48d7a5c3baeb25e7add34b6b1b66f47"} Jun 15 08:28:49.715330 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.715310 2564 generic.go:356] "Generic (PLEG): container finished" podID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerID="6268b6fe60ea2a2255095af6a81a9a27e31808e065cf5bb5dcb2f43fd99f7627" exitCode=0 Jun 15 08:28:49.715410 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.715394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" event={"ID":"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3","Type":"ContainerDied","Data":"6268b6fe60ea2a2255095af6a81a9a27e31808e065cf5bb5dcb2f43fd99f7627"} Jun 15 08:28:49.843320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.843295 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:49.876742 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.876710 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:49.961383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.961345 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util\") pod \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " Jun 15 08:28:49.961580 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.961427 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhr76\" (UniqueName: \"kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76\") pod \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " Jun 15 08:28:49.961580 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.961444 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle\") pod \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\" (UID: \"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0\") " Jun 15 08:28:49.962124 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.962096 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle" (OuterVolumeSpecName: "bundle") pod "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" (UID: "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:49.963712 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.963667 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76" (OuterVolumeSpecName: "kube-api-access-bhr76") pod "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" (UID: "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0"). InnerVolumeSpecName "kube-api-access-bhr76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:28:49.966985 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:49.966965 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util" (OuterVolumeSpecName: "util") pod "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" (UID: "3a8a0202-c4b9-44f2-9873-6f024c6f3ae0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:50.062262 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzzkf\" (UniqueName: \"kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf\") pod \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " Jun 15 08:28:50.062402 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062278 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util\") pod \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " Jun 15 08:28:50.062402 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062326 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle\") pod \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\" (UID: \"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2\") " Jun 15 08:28:50.062590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062575 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.062627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062597 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhr76\" (UniqueName: \"kubernetes.io/projected/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-kube-api-access-bhr76\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.062627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062611 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a0202-c4b9-44f2-9873-6f024c6f3ae0-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.062875 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.062833 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle" (OuterVolumeSpecName: "bundle") pod "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" (UID: "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:50.064403 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.064380 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf" (OuterVolumeSpecName: "kube-api-access-rzzkf") pod "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" (UID: "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2"). InnerVolumeSpecName "kube-api-access-rzzkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:28:50.067440 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.067420 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util" (OuterVolumeSpecName: "util") pod "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" (UID: "4ee44047-7f5a-48ac-8e9c-e782ffcc69c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:50.163810 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.163778 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.163810 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.163804 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.163810 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.163815 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzzkf\" (UniqueName: \"kubernetes.io/projected/4ee44047-7f5a-48ac-8e9c-e782ffcc69c2-kube-api-access-rzzkf\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:50.722200 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.722165 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" Jun 15 08:28:50.722200 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.722190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6" event={"ID":"4ee44047-7f5a-48ac-8e9c-e782ffcc69c2","Type":"ContainerDied","Data":"6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398"} Jun 15 08:28:50.722718 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.722232 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cca8887754838bc34c332684093b13abed55583a3891986d8dc2d6441de6398" Jun 15 08:28:50.724054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.724035 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" Jun 15 08:28:50.724170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.724069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7" event={"ID":"3a8a0202-c4b9-44f2-9873-6f024c6f3ae0","Type":"ContainerDied","Data":"476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0"} Jun 15 08:28:50.724170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.724103 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="476e0162e50b3ce9bc2901f131b993fe78d64488716abdc23a944590290412b0" Jun 15 08:28:50.886418 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.886395 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:50.888033 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:50.888016 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:51.073705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073614 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2vzt\" (UniqueName: \"kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt\") pod \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " Jun 15 08:28:51.073705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073656 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqts4\" (UniqueName: \"kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4\") pod \"18e67466-a33f-4685-b746-a6fb9088db85\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " Jun 15 08:28:51.073705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073704 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle\") pod \"18e67466-a33f-4685-b746-a6fb9088db85\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " Jun 15 08:28:51.074014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073727 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util\") pod \"18e67466-a33f-4685-b746-a6fb9088db85\" (UID: \"18e67466-a33f-4685-b746-a6fb9088db85\") " Jun 15 08:28:51.074014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle\") pod \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " Jun 15 08:28:51.074014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.073784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util\") pod \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\" (UID: \"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3\") " Jun 15 08:28:51.074285 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.074256 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle" (OuterVolumeSpecName: "bundle") pod "18e67466-a33f-4685-b746-a6fb9088db85" (UID: "18e67466-a33f-4685-b746-a6fb9088db85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:51.074413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.074313 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle" (OuterVolumeSpecName: "bundle") pod "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" (UID: "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:51.075895 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.075842 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4" (OuterVolumeSpecName: "kube-api-access-rqts4") pod "18e67466-a33f-4685-b746-a6fb9088db85" (UID: "18e67466-a33f-4685-b746-a6fb9088db85"). InnerVolumeSpecName "kube-api-access-rqts4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:28:51.076206 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.076183 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt" (OuterVolumeSpecName: "kube-api-access-w2vzt") pod "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" (UID: "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3"). InnerVolumeSpecName "kube-api-access-w2vzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:28:51.079355 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.079332 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util" (OuterVolumeSpecName: "util") pod "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" (UID: "e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:51.080137 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.080117 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util" (OuterVolumeSpecName: "util") pod "18e67466-a33f-4685-b746-a6fb9088db85" (UID: "18e67466-a33f-4685-b746-a6fb9088db85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:28:51.174507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174467 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2vzt\" (UniqueName: \"kubernetes.io/projected/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-kube-api-access-w2vzt\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.174507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174500 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqts4\" (UniqueName: \"kubernetes.io/projected/18e67466-a33f-4685-b746-a6fb9088db85-kube-api-access-rqts4\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.174507 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174514 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.174740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174526 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e67466-a33f-4685-b746-a6fb9088db85-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.174740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174539 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.174740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.174549 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:28:51.730729 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.730696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" event={"ID":"18e67466-a33f-4685-b746-a6fb9088db85","Type":"ContainerDied","Data":"ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d"} Jun 15 08:28:51.731187 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.730749 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccb0417039b4493df18473252e14e7366386a2c62e9272813448c27410a6741d" Jun 15 08:28:51.731187 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.730705 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq" Jun 15 08:28:51.732781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.732742 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" Jun 15 08:28:51.732781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.732750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw" event={"ID":"e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3","Type":"ContainerDied","Data":"d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae"} Jun 15 08:28:51.732994 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:51.732784 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d71d3c506283016d234afd69c2b5000e03c84a2bf88895e452fafc9b8711f7ae" Jun 15 08:28:58.565222 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:28:58.565142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:01.956475 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:01.956441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:02.768312 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:02.768277 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:03.876103 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:03.876067 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8554dc54d9-drwlk" podUID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" containerName="console" containerID="cri-o://bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9" gracePeriod=15 Jun 15 08:29:04.125650 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.125619 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:29:04.183201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183127 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183201 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183173 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183216 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l8bw\" (UniqueName: \"kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183232 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183260 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183296 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183414 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183332 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert\") pod \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\" (UID: \"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95\") " Jun 15 08:29:04.183665 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183633 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config" (OuterVolumeSpecName: "console-config") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:29:04.183743 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183676 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca" (OuterVolumeSpecName: "service-ca") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:29:04.183879 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183839 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:29:04.183929 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.183844 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:29:04.185530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.185505 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:29:04.185813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.185791 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:29:04.185813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.185805 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw" (OuterVolumeSpecName: "kube-api-access-9l8bw") pod "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" (UID: "8dc020a8-d4d6-49c3-8cbe-6705cc42bb95"). InnerVolumeSpecName "kube-api-access-9l8bw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:29:04.284527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284481 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l8bw\" (UniqueName: \"kubernetes.io/projected/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-kube-api-access-9l8bw\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284523 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-oauth-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284535 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-service-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284527 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284543 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-trusted-ca-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284773 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284552 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-oauth-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284773 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284562 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-config\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.284773 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.284571 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95-console-serving-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:29:04.801769 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.801732 2564 generic.go:356] "Generic (PLEG): container finished" podID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" containerID="bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9" exitCode=0 Jun 15 08:29:04.801976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.801779 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554dc54d9-drwlk" Jun 15 08:29:04.801976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.801814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554dc54d9-drwlk" event={"ID":"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95","Type":"ContainerDied","Data":"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9"} Jun 15 08:29:04.801976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.801886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554dc54d9-drwlk" event={"ID":"8dc020a8-d4d6-49c3-8cbe-6705cc42bb95","Type":"ContainerDied","Data":"476365aa80412dee01aa80d8fc8856f84855096e5e28219aae2d34b6cca13f1a"} Jun 15 08:29:04.801976 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.801910 2564 scope.go:117] "RemoveContainer" containerID="bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9" Jun 15 08:29:04.811715 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.811698 2564 scope.go:117] "RemoveContainer" containerID="bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9" Jun 15 08:29:04.811996 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:29:04.811969 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9\": container with ID starting with bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9 not found: ID does not exist" containerID="bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9" Jun 15 08:29:04.812099 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.811999 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9"} err="failed to get container status \"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9\": rpc error: code = NotFound desc = could not find container \"bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9\": container with ID starting with bf2be60bfba183dca21a780f057e964deea5ba42b0db31130b0d53364aee95d9 not found: ID does not exist" Jun 15 08:29:04.823193 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.823171 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:29:04.829074 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:04.829055 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8554dc54d9-drwlk"] Jun 15 08:29:05.199441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:05.199410 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" path="/var/lib/kubelet/pods/8dc020a8-d4d6-49c3-8cbe-6705cc42bb95/volumes" Jun 15 08:29:06.367916 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:06.367859 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:06.605341 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:06.605310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:06.712172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:06.712139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:08.686585 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:08.686547 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:09.168472 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:09.168402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:09.646641 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:09.646614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:11.607435 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:11.607402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:14.571066 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:14.571031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:14.671092 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:14.671058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:19.953592 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:19.953551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:20.055717 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:20.055676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:20.385959 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:20.385850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:20.501469 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:20.501434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:24.165112 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.165077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:24.248801 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.248768 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg"] Jun 15 08:29:24.249118 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249106 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="util" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249120 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="util" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249129 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="pull" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249134 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="pull" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249144 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" containerName="console" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249150 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" containerName="console" Jun 15 08:29:24.249166 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249164 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249169 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249175 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249181 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249197 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249202 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249207 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249212 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249217 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249221 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249227 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249231 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="pull" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249235 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249241 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249247 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249252 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="util" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249257 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249262 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249268 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249273 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249325 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e67466-a33f-4685-b746-a6fb9088db85" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249335 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc020a8-d4d6-49c3-8cbe-6705cc42bb95" containerName="console" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249342 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8a0202-c4b9-44f2-9873-6f024c6f3ae0" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249348 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3" containerName="extract" Jun 15 08:29:24.249352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.249354 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee44047-7f5a-48ac-8e9c-e782ffcc69c2" containerName="extract" Jun 15 08:29:24.253761 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.253733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:24.253942 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.253922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.256765 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.256743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 15 08:29:24.256765 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.256757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 15 08:29:24.256916 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.256746 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hv5s6\"" Jun 15 08:29:24.257462 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.257444 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 08:29:24.257550 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.257517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 08:29:24.263451 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.263430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg"] Jun 15 08:29:24.342831 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.342789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:24.356995 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.356970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.357122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.357028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd97de93-4fd7-4f09-8a1c-77f5a737c135-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.357122 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.357089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzqzk\" (UniqueName: \"kubernetes.io/projected/bd97de93-4fd7-4f09-8a1c-77f5a737c135-kube-api-access-gzqzk\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.457590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.457565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.457755 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.457633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd97de93-4fd7-4f09-8a1c-77f5a737c135-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.457755 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.457668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzqzk\" (UniqueName: \"kubernetes.io/projected/bd97de93-4fd7-4f09-8a1c-77f5a737c135-kube-api-access-gzqzk\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.457755 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:29:24.457720 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 15 08:29:24.457901 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:29:24.457799 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert podName:bd97de93-4fd7-4f09-8a1c-77f5a737c135 nodeName:}" failed. No retries permitted until 2026-06-15 08:29:24.957778641 +0000 UTC m=+650.223398605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rcbjg" (UID: "bd97de93-4fd7-4f09-8a1c-77f5a737c135") : secret "plugin-serving-cert" not found Jun 15 08:29:24.458282 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.458261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd97de93-4fd7-4f09-8a1c-77f5a737c135-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.468582 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.468554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzqzk\" (UniqueName: \"kubernetes.io/projected/bd97de93-4fd7-4f09-8a1c-77f5a737c135-kube-api-access-gzqzk\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.531543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.531486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:24.962924 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.962898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:24.965263 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:24.965236 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd97de93-4fd7-4f09-8a1c-77f5a737c135-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcbjg\" (UID: \"bd97de93-4fd7-4f09-8a1c-77f5a737c135\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:25.164676 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:25.164641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" Jun 15 08:29:25.292395 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:25.292369 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg"] Jun 15 08:29:25.293999 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:29:25.293968 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd97de93_4fd7_4f09_8a1c_77f5a737c135.slice/crio-08cf79be4541f645782f2b579787e0021e9b501f68c4aa167053a42234da4d43 WatchSource:0}: Error finding container 08cf79be4541f645782f2b579787e0021e9b501f68c4aa167053a42234da4d43: Status 404 returned error can't find the container with id 08cf79be4541f645782f2b579787e0021e9b501f68c4aa167053a42234da4d43 Jun 15 08:29:25.907979 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:25.907944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" event={"ID":"bd97de93-4fd7-4f09-8a1c-77f5a737c135","Type":"ContainerStarted","Data":"08cf79be4541f645782f2b579787e0021e9b501f68c4aa167053a42234da4d43"} Jun 15 08:29:26.522553 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:26.522490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:26.628678 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:26.628645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:31.286877 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:31.286839 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:31.346089 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:31.346043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:32.196725 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:32.196688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:33.168216 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:33.168188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:33.267646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:33.267599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:38.056888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:38.056833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:38.559685 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:38.559647 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:38.674846 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:38.674813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:39.196400 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:39.196367 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:39.288320 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:39.288282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:42.567747 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:42.567713 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:42.667128 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:42.667092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:46.163832 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:46.163796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:46.264228 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:46.264191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:48.044446 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:48.044412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" event={"ID":"bd97de93-4fd7-4f09-8a1c-77f5a737c135","Type":"ContainerStarted","Data":"bd0ee4563c33733ed13a3445df28a0057e5e7e752e5d9f8209025fc07b4ead13"} Jun 15 08:29:48.059966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:48.059915 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcbjg" podStartSLOduration=1.821003395 podStartE2EDuration="24.059899474s" totalImagesPullingTime="22.238896079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:48.058426336 +0000 UTC m=+673.324046307" watchObservedRunningTime="2026-06-15 08:29:48.059899474 +0000 UTC m=+673.325519444" Jun 15 08:29:56.137443 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:56.137408 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:57.260369 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:57.260335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:29:57.361536 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:29:57.361495 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:06.512365 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:06.512332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:06.767095 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:06.767003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:21.855646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:21.855608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:21.959260 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:21.959203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:22.058572 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.058537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:22.063301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.063269 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:30:22.115666 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.115592 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:30:22.115666 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.115626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:30:22.115841 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.115702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.117932 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.117911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 08:30:22.243906 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.243849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-config-file\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.244079 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.243964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wczt\" (UniqueName: \"kubernetes.io/projected/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-kube-api-access-8wczt\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.345204 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.345170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wczt\" (UniqueName: \"kubernetes.io/projected/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-kube-api-access-8wczt\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.345382 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.345247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-config-file\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.345816 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.345798 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-config-file\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.355208 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.355178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wczt\" (UniqueName: \"kubernetes.io/projected/8bf6ed8a-939d-4946-8ce3-9b967eb74d2b-kube-api-access-8wczt\") pod \"limitador-limitador-54d6d988d5-5l6j9\" (UID: \"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.425642 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.425550 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:22.552744 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.552720 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:30:22.558810 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.558788 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:30:22.654008 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.653980 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:22.658603 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.658585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:22.660956 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.660940 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9z8cr\"" Jun 15 08:30:22.665597 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.665572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:22.678348 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.678280 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:22.739542 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.739513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:22.748660 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.748634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xbs\" (UniqueName: \"kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs\") pod \"authorino-58cd955675-w6q8d\" (UID: \"c4efc2ca-4076-48f1-9e01-d5362bcba7c9\") " pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:22.849618 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.849584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xbs\" (UniqueName: \"kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs\") pod \"authorino-58cd955675-w6q8d\" (UID: \"c4efc2ca-4076-48f1-9e01-d5362bcba7c9\") " pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:22.858859 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.858829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xbs\" (UniqueName: \"kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs\") pod \"authorino-58cd955675-w6q8d\" (UID: \"c4efc2ca-4076-48f1-9e01-d5362bcba7c9\") " pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:22.860213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.860193 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:30:22.863646 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.863629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:30:22.872362 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.872336 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:30:22.950441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.950410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2nkw\" (UniqueName: \"kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw\") pod \"authorino-75d556bd77-rqlx7\" (UID: \"29371fa1-4c95-4f89-bec4-cf65c16cc166\") " pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:30:22.968948 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:22.968922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:23.051051 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.051009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2nkw\" (UniqueName: \"kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw\") pod \"authorino-75d556bd77-rqlx7\" (UID: \"29371fa1-4c95-4f89-bec4-cf65c16cc166\") " pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:30:23.060921 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.060852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2nkw\" (UniqueName: \"kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw\") pod \"authorino-75d556bd77-rqlx7\" (UID: \"29371fa1-4c95-4f89-bec4-cf65c16cc166\") " pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:30:23.112578 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.112543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:23.114625 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:30:23.114559 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4efc2ca_4076_48f1_9e01_d5362bcba7c9.slice/crio-909cc5fa5757174525675e76f1bcfcf8b9f2f20c3172c25122077afee3cebb6c WatchSource:0}: Error finding container 909cc5fa5757174525675e76f1bcfcf8b9f2f20c3172c25122077afee3cebb6c: Status 404 returned error can't find the container with id 909cc5fa5757174525675e76f1bcfcf8b9f2f20c3172c25122077afee3cebb6c Jun 15 08:30:23.174647 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.174554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:30:23.227574 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.227452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w6q8d" event={"ID":"c4efc2ca-4076-48f1-9e01-d5362bcba7c9","Type":"ContainerStarted","Data":"909cc5fa5757174525675e76f1bcfcf8b9f2f20c3172c25122077afee3cebb6c"} Jun 15 08:30:23.229823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.229752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" event={"ID":"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b","Type":"ContainerStarted","Data":"8f6a0d5ebf6507e15fc8ceab48961eeaf2d02ed7f4ea34cad4831d6b2a1ac44f"} Jun 15 08:30:23.365583 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:23.365561 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:30:23.368948 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:30:23.368915 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29371fa1_4c95_4f89_bec4_cf65c16cc166.slice/crio-805f0e5dffcd3925a7fe0b5da9d38793a8adda4b6dce8a4ff7f9bc5a0cd5f278 WatchSource:0}: Error finding container 805f0e5dffcd3925a7fe0b5da9d38793a8adda4b6dce8a4ff7f9bc5a0cd5f278: Status 404 returned error can't find the container with id 805f0e5dffcd3925a7fe0b5da9d38793a8adda4b6dce8a4ff7f9bc5a0cd5f278 Jun 15 08:30:24.249028 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:24.248960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rqlx7" event={"ID":"29371fa1-4c95-4f89-bec4-cf65c16cc166","Type":"ContainerStarted","Data":"805f0e5dffcd3925a7fe0b5da9d38793a8adda4b6dce8a4ff7f9bc5a0cd5f278"} Jun 15 08:30:28.271798 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.271757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w6q8d" event={"ID":"c4efc2ca-4076-48f1-9e01-d5362bcba7c9","Type":"ContainerStarted","Data":"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19"} Jun 15 08:30:28.273341 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.273315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" event={"ID":"8bf6ed8a-939d-4946-8ce3-9b967eb74d2b","Type":"ContainerStarted","Data":"8ae0c70b4833c8722c58d1e542bf98713b920c47fe618712d1e5ba91703ab135"} Jun 15 08:30:28.273468 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.273372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:28.274635 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.274600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rqlx7" event={"ID":"29371fa1-4c95-4f89-bec4-cf65c16cc166","Type":"ContainerStarted","Data":"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52"} Jun 15 08:30:28.286036 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.285993 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-w6q8d" podStartSLOduration=1.88020466 podStartE2EDuration="6.285979102s" totalImagesPullingTime="4.405774442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:28.285383894 +0000 UTC m=+713.551003863" watchObservedRunningTime="2026-06-15 08:30:28.285979102 +0000 UTC m=+713.551599072" Jun 15 08:30:28.299922 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.299853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rqlx7" podStartSLOduration=2.136118263 podStartE2EDuration="6.29984142s" totalImagesPullingTime="4.163723157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:28.298616414 +0000 UTC m=+713.564236385" watchObservedRunningTime="2026-06-15 08:30:28.29984142 +0000 UTC m=+713.565461391" Jun 15 08:30:28.315910 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.315841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" podStartSLOduration=1.351702247 podStartE2EDuration="6.315823337s" totalImagesPullingTime="4.96412109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:28.314748799 +0000 UTC m=+713.580368771" watchObservedRunningTime="2026-06-15 08:30:28.315823337 +0000 UTC m=+713.581443320" Jun 15 08:30:28.324587 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:28.324560 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:30.285964 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:30.285924 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-w6q8d" podUID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" containerName="authorino" containerID="cri-o://f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19" gracePeriod=30 Jun 15 08:30:30.530197 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:30.530168 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:30.622781 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:30.622698 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7xbs\" (UniqueName: \"kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs\") pod \"c4efc2ca-4076-48f1-9e01-d5362bcba7c9\" (UID: \"c4efc2ca-4076-48f1-9e01-d5362bcba7c9\") " Jun 15 08:30:30.624747 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:30.624724 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs" (OuterVolumeSpecName: "kube-api-access-n7xbs") pod "c4efc2ca-4076-48f1-9e01-d5362bcba7c9" (UID: "c4efc2ca-4076-48f1-9e01-d5362bcba7c9"). InnerVolumeSpecName "kube-api-access-n7xbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:30:30.723466 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:30.723431 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7xbs\" (UniqueName: \"kubernetes.io/projected/c4efc2ca-4076-48f1-9e01-d5362bcba7c9-kube-api-access-n7xbs\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:30:31.291825 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.291791 2564 generic.go:356] "Generic (PLEG): container finished" podID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" containerID="f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19" exitCode=0 Jun 15 08:30:31.292213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.291827 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w6q8d" Jun 15 08:30:31.292213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.291892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w6q8d" event={"ID":"c4efc2ca-4076-48f1-9e01-d5362bcba7c9","Type":"ContainerDied","Data":"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19"} Jun 15 08:30:31.292213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.291932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w6q8d" event={"ID":"c4efc2ca-4076-48f1-9e01-d5362bcba7c9","Type":"ContainerDied","Data":"909cc5fa5757174525675e76f1bcfcf8b9f2f20c3172c25122077afee3cebb6c"} Jun 15 08:30:31.292213 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.291949 2564 scope.go:117] "RemoveContainer" containerID="f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19" Jun 15 08:30:31.301159 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.301145 2564 scope.go:117] "RemoveContainer" containerID="f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19" Jun 15 08:30:31.301402 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:30:31.301384 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19\": container with ID starting with f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19 not found: ID does not exist" containerID="f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19" Jun 15 08:30:31.301443 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.301414 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19"} err="failed to get container status \"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19\": rpc error: code = NotFound desc = could not find container \"f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19\": container with ID starting with f60672eebd0edf55893403d22026391cebf70a45363b33bc00e44a2ff1b36e19 not found: ID does not exist" Jun 15 08:30:31.307048 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.307023 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:31.310018 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:31.309999 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-w6q8d"] Jun 15 08:30:33.198969 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:33.198939 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" path="/var/lib/kubelet/pods/c4efc2ca-4076-48f1-9e01-d5362bcba7c9/volumes" Jun 15 08:30:39.280539 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:39.280508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l6j9" Jun 15 08:30:45.211356 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:45.211321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:55.830352 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:55.830309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:55.898923 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:55.898888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:56.090037 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.089942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:30:56.983897 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.983848 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb"] Jun 15 08:30:56.984267 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.984184 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" containerName="authorino" Jun 15 08:30:56.984267 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.984195 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" containerName="authorino" Jun 15 08:30:56.984267 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.984267 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4efc2ca-4076-48f1-9e01-d5362bcba7c9" containerName="authorino" Jun 15 08:30:56.987360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.987342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:56.990266 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.990236 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 08:30:56.990847 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.990826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sggmm\"" Jun 15 08:30:56.990991 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.990832 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 08:30:56.996658 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:56.996634 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb"] Jun 15 08:30:57.049416 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.049387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.049557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.049426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.049557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.049456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.149880 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.149842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.150004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.149988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.150050 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.150027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.150444 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.150425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.150492 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.150473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.161311 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.161284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.297383 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.297305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:30:57.427690 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:57.427670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb"] Jun 15 08:30:57.429929 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:30:57.429900 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c0a7a0_c6b9_41f5_8359_5e6727e793f5.slice/crio-1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5 WatchSource:0}: Error finding container 1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5: Status 404 returned error can't find the container with id 1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5 Jun 15 08:30:58.436766 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:58.436733 2564 generic.go:356] "Generic (PLEG): container finished" podID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerID="0cca9b464e6f8f73654aa2f5878be697f207610b82083101f3f15398e7866594" exitCode=0 Jun 15 08:30:58.437151 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:58.436770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" event={"ID":"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5","Type":"ContainerDied","Data":"0cca9b464e6f8f73654aa2f5878be697f207610b82083101f3f15398e7866594"} Jun 15 08:30:58.437151 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:30:58.436834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" event={"ID":"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5","Type":"ContainerStarted","Data":"1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5"} Jun 15 08:31:00.449477 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:00.449444 2564 generic.go:356] "Generic (PLEG): container finished" podID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerID="0ab4900d1bff34b316b71be0fcef6d50c3ceb6333b72627ed423fc5c5d23453b" exitCode=0 Jun 15 08:31:00.449879 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:00.449535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" event={"ID":"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5","Type":"ContainerDied","Data":"0ab4900d1bff34b316b71be0fcef6d50c3ceb6333b72627ed423fc5c5d23453b"} Jun 15 08:31:01.456046 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:01.456014 2564 generic.go:356] "Generic (PLEG): container finished" podID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerID="0685cbc60b4fe6c9e24d1217baf9c84cd66d5df18f19398e43940efdbf7d321d" exitCode=0 Jun 15 08:31:01.456427 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:01.456104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" event={"ID":"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5","Type":"ContainerDied","Data":"0685cbc60b4fe6c9e24d1217baf9c84cd66d5df18f19398e43940efdbf7d321d"} Jun 15 08:31:02.585556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.585528 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:31:02.699547 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.699518 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc\") pod \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " Jun 15 08:31:02.699735 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.699561 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle\") pod \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " Jun 15 08:31:02.699735 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.699594 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util\") pod \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\" (UID: \"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5\") " Jun 15 08:31:02.700094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.700071 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle" (OuterVolumeSpecName: "bundle") pod "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" (UID: "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:31:02.701614 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.701588 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc" (OuterVolumeSpecName: "kube-api-access-qfrcc") pod "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" (UID: "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5"). InnerVolumeSpecName "kube-api-access-qfrcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:31:02.706142 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.706123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util" (OuterVolumeSpecName: "util") pod "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" (UID: "b6c0a7a0-c6b9-41f5-8359-5e6727e793f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:31:02.800776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.800703 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-kube-api-access-qfrcc\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:02.800776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.800728 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-bundle\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:02.800776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:02.800740 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6c0a7a0-c6b9-41f5-8359-5e6727e793f5-util\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:03.468754 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:03.468681 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" Jun 15 08:31:03.468754 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:03.468678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748dc7sb" event={"ID":"b6c0a7a0-c6b9-41f5-8359-5e6727e793f5","Type":"ContainerDied","Data":"1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5"} Jun 15 08:31:03.468754 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:03.468731 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f8f8a4d1a989a12079a7823ecf714ac7287381e0f8887ecf8cf9cada1dac7d5" Jun 15 08:31:04.399859 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:04.399825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:10.197913 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:10.197882 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:10.294251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:10.294223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:26.871915 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:26.871858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:26.974678 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:26.974646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:57.327526 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.327435 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:57.416461 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.416427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:31:57.533821 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.533788 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tvqx5"] Jun 15 08:31:57.534133 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534120 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="pull" Jun 15 08:31:57.534178 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534134 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="pull" Jun 15 08:31:57.534178 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534145 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="util" Jun 15 08:31:57.534178 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534152 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="util" Jun 15 08:31:57.534178 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534161 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="extract" Jun 15 08:31:57.534178 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534166 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="extract" Jun 15 08:31:57.534336 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.534230 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c0a7a0-c6b9-41f5-8359-5e6727e793f5" containerName="extract" Jun 15 08:31:57.537048 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.537032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:57.543961 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.543891 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tvqx5"] Jun 15 08:31:57.676247 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.676162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvgw\" (UniqueName: \"kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw\") pod \"authorino-5d4b67c446-tvqx5\" (UID: \"6028ce26-1514-42d8-b501-952291610e8a\") " pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:57.760611 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.760582 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tvqx5"] Jun 15 08:31:57.760886 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:31:57.760831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2rvgw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-tvqx5" podUID="6028ce26-1514-42d8-b501-952291610e8a" Jun 15 08:31:57.777256 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.777226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvgw\" (UniqueName: \"kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw\") pod \"authorino-5d4b67c446-tvqx5\" (UID: \"6028ce26-1514-42d8-b501-952291610e8a\") " pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:57.784097 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.784076 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cd7b74cd9-pz64p"] Jun 15 08:31:57.787313 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.787285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:57.788627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.788606 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvgw\" (UniqueName: \"kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw\") pod \"authorino-5d4b67c446-tvqx5\" (UID: \"6028ce26-1514-42d8-b501-952291610e8a\") " pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:57.794021 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.793998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd7b74cd9-pz64p"] Jun 15 08:31:57.877625 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.877598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ddwh\" (UniqueName: \"kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh\") pod \"authorino-cd7b74cd9-pz64p\" (UID: \"4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9\") " pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:57.877765 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.877633 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd7b74cd9-pz64p"] Jun 15 08:31:57.877907 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:31:57.877885 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5ddwh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-cd7b74cd9-pz64p" podUID="4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9" Jun 15 08:31:57.905305 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.905280 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:31:57.908536 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.908521 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:57.910813 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.910796 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 08:31:57.916015 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.915994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:31:57.978760 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.978729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljjl\" (UniqueName: \"kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:57.978965 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.978797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ddwh\" (UniqueName: \"kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh\") pod \"authorino-cd7b74cd9-pz64p\" (UID: \"4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9\") " pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:57.978965 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.978819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:57.987529 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:57.987507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ddwh\" (UniqueName: \"kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh\") pod \"authorino-cd7b74cd9-pz64p\" (UID: \"4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9\") " pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:58.080117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.080080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljjl\" (UniqueName: \"kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:58.080283 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.080172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:58.082509 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.082480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:58.088294 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.088272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljjl\" (UniqueName: \"kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl\") pod \"authorino-6858f7cb97-l4tzb\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:58.218268 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.218220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:31:58.348103 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.348080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:31:58.349693 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:31:58.349669 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4c82a1a_fbd9_45be_90a0_f170a71b801a.slice/crio-8338515e2d3b48dd1235eb6d189909f578ab8374524b6a53b3ff1c9bdc5e735b WatchSource:0}: Error finding container 8338515e2d3b48dd1235eb6d189909f578ab8374524b6a53b3ff1c9bdc5e735b: Status 404 returned error can't find the container with id 8338515e2d3b48dd1235eb6d189909f578ab8374524b6a53b3ff1c9bdc5e735b Jun 15 08:31:58.764385 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.764354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" event={"ID":"f4c82a1a-fbd9-45be-90a0-f170a71b801a","Type":"ContainerStarted","Data":"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f"} Jun 15 08:31:58.764523 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.764398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" event={"ID":"f4c82a1a-fbd9-45be-90a0-f170a71b801a","Type":"ContainerStarted","Data":"8338515e2d3b48dd1235eb6d189909f578ab8374524b6a53b3ff1c9bdc5e735b"} Jun 15 08:31:58.764523 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.764441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:58.764616 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.764445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:58.772394 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.772375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:58.776649 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.776628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:58.782081 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.782043 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" podStartSLOduration=1.446025258 podStartE2EDuration="1.782027063s" totalImagesPullingTime="336.001805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:31:58.779507136 +0000 UTC m=+804.045127105" watchObservedRunningTime="2026-06-15 08:31:58.782027063 +0000 UTC m=+804.047647033" Jun 15 08:31:58.814830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.814779 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:31:58.815025 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.815001 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rqlx7" podUID="29371fa1-4c95-4f89-bec4-cf65c16cc166" containerName="authorino" containerID="cri-o://4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52" gracePeriod=30 Jun 15 08:31:58.887155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.887121 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ddwh\" (UniqueName: \"kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh\") pod \"4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9\" (UID: \"4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9\") " Jun 15 08:31:58.887325 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.887274 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rvgw\" (UniqueName: \"kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw\") pod \"6028ce26-1514-42d8-b501-952291610e8a\" (UID: \"6028ce26-1514-42d8-b501-952291610e8a\") " Jun 15 08:31:58.889269 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.889235 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh" (OuterVolumeSpecName: "kube-api-access-5ddwh") pod "4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9" (UID: "4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9"). InnerVolumeSpecName "kube-api-access-5ddwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:31:58.889269 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.889268 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw" (OuterVolumeSpecName: "kube-api-access-2rvgw") pod "6028ce26-1514-42d8-b501-952291610e8a" (UID: "6028ce26-1514-42d8-b501-952291610e8a"). InnerVolumeSpecName "kube-api-access-2rvgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:31:58.988399 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.988370 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rvgw\" (UniqueName: \"kubernetes.io/projected/6028ce26-1514-42d8-b501-952291610e8a-kube-api-access-2rvgw\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:58.988399 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:58.988399 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ddwh\" (UniqueName: \"kubernetes.io/projected/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9-kube-api-access-5ddwh\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:59.057603 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.057582 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:31:59.190133 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.190093 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2nkw\" (UniqueName: \"kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw\") pod \"29371fa1-4c95-4f89-bec4-cf65c16cc166\" (UID: \"29371fa1-4c95-4f89-bec4-cf65c16cc166\") " Jun 15 08:31:59.192145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.192123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw" (OuterVolumeSpecName: "kube-api-access-q2nkw") pod "29371fa1-4c95-4f89-bec4-cf65c16cc166" (UID: "29371fa1-4c95-4f89-bec4-cf65c16cc166"). InnerVolumeSpecName "kube-api-access-q2nkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:31:59.291559 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.291480 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2nkw\" (UniqueName: \"kubernetes.io/projected/29371fa1-4c95-4f89-bec4-cf65c16cc166-kube-api-access-q2nkw\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:31:59.771888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771833 2564 generic.go:356] "Generic (PLEG): container finished" podID="29371fa1-4c95-4f89-bec4-cf65c16cc166" containerID="4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52" exitCode=0 Jun 15 08:31:59.771888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771884 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rqlx7" Jun 15 08:31:59.772360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rqlx7" event={"ID":"29371fa1-4c95-4f89-bec4-cf65c16cc166","Type":"ContainerDied","Data":"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52"} Jun 15 08:31:59.772360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rqlx7" event={"ID":"29371fa1-4c95-4f89-bec4-cf65c16cc166","Type":"ContainerDied","Data":"805f0e5dffcd3925a7fe0b5da9d38793a8adda4b6dce8a4ff7f9bc5a0cd5f278"} Jun 15 08:31:59.772360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771987 2564 scope.go:117] "RemoveContainer" containerID="4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52" Jun 15 08:31:59.772360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.771996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tvqx5" Jun 15 08:31:59.772360 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.772354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd7b74cd9-pz64p" Jun 15 08:31:59.781144 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.781125 2564 scope.go:117] "RemoveContainer" containerID="4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52" Jun 15 08:31:59.781388 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:31:59.781370 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52\": container with ID starting with 4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52 not found: ID does not exist" containerID="4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52" Jun 15 08:31:59.781434 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.781395 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52"} err="failed to get container status \"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52\": rpc error: code = NotFound desc = could not find container \"4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52\": container with ID starting with 4d2d619136e8cde0953be7e0320946a43b1360c46938d6466a84c6fe550d2b52 not found: ID does not exist" Jun 15 08:31:59.800236 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.800197 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tvqx5"] Jun 15 08:31:59.803724 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.803703 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tvqx5"] Jun 15 08:31:59.824058 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.824036 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd7b74cd9-pz64p"] Jun 15 08:31:59.828452 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.828431 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cd7b74cd9-pz64p"] Jun 15 08:31:59.838441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.838417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:31:59.841684 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:31:59.841656 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rqlx7"] Jun 15 08:32:01.198957 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:01.198927 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29371fa1-4c95-4f89-bec4-cf65c16cc166" path="/var/lib/kubelet/pods/29371fa1-4c95-4f89-bec4-cf65c16cc166/volumes" Jun 15 08:32:01.199328 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:01.199244 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9" path="/var/lib/kubelet/pods/4fb441b8-d962-4a2a-a01c-ce7ec4b0a5f9/volumes" Jun 15 08:32:01.199445 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:01.199431 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6028ce26-1514-42d8-b501-952291610e8a" path="/var/lib/kubelet/pods/6028ce26-1514-42d8-b501-952291610e8a/volumes" Jun 15 08:32:02.401266 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:02.401228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:02.538234 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:02.538127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:02.640820 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:02.640788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:02.713678 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:02.713653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:05.771552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:05.771517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:05.867218 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:05.867176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:34.322671 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:34.322640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:34.579031 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:34.578956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:35.016522 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:35.016489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:35.132200 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:35.132169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:32:35.342714 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:32:35.342629 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:33:22.728064 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.728018 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:33:22.728488 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.728346 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29371fa1-4c95-4f89-bec4-cf65c16cc166" containerName="authorino" Jun 15 08:33:22.728488 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.728358 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29371fa1-4c95-4f89-bec4-cf65c16cc166" containerName="authorino" Jun 15 08:33:22.728488 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.728433 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29371fa1-4c95-4f89-bec4-cf65c16cc166" containerName="authorino" Jun 15 08:33:22.731718 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.731696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.736981 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.736958 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 08:33:22.743425 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.743401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:33:22.795445 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.795418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.795573 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.795473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.795573 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.795544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs46p\" (UniqueName: \"kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.896277 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.896252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.896370 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.896295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs46p\" (UniqueName: \"kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.896370 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.896322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.896972 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.896955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.898389 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.898371 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:22.905186 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:22.905167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs46p\" (UniqueName: \"kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p\") pod \"authorino-66956cdccc-gf252\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:23.060760 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:23.060713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:33:23.190551 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:23.190528 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:33:23.191856 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:33:23.191833 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda810617_7e7a_455a_89ca_47356e326078.slice/crio-77e528c7e43ec0b184c8c76add7c74e350944d1ce5449ae481b75493d968f3f2 WatchSource:0}: Error finding container 77e528c7e43ec0b184c8c76add7c74e350944d1ce5449ae481b75493d968f3f2: Status 404 returned error can't find the container with id 77e528c7e43ec0b184c8c76add7c74e350944d1ce5449ae481b75493d968f3f2 Jun 15 08:33:23.209721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:23.209698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66956cdccc-gf252" event={"ID":"da810617-7e7a-455a-89ca-47356e326078","Type":"ContainerStarted","Data":"77e528c7e43ec0b184c8c76add7c74e350944d1ce5449ae481b75493d968f3f2"} Jun 15 08:33:24.216785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.216752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66956cdccc-gf252" event={"ID":"da810617-7e7a-455a-89ca-47356e326078","Type":"ContainerStarted","Data":"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5"} Jun 15 08:33:24.233761 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.233716 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66956cdccc-gf252" podStartSLOduration=1.765210392 podStartE2EDuration="2.233701247s" totalImagesPullingTime="468.490855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:33:24.232503577 +0000 UTC m=+889.498123549" watchObservedRunningTime="2026-06-15 08:33:24.233701247 +0000 UTC m=+889.499321217" Jun 15 08:33:24.265452 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.265425 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:33:24.265600 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.265581 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" podUID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" containerName="authorino" containerID="cri-o://0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f" gracePeriod=30 Jun 15 08:33:24.511157 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.511135 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:33:24.612054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.612004 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qljjl\" (UniqueName: \"kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl\") pod \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " Jun 15 08:33:24.612186 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.612118 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert\") pod \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\" (UID: \"f4c82a1a-fbd9-45be-90a0-f170a71b801a\") " Jun 15 08:33:24.614065 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.614042 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl" (OuterVolumeSpecName: "kube-api-access-qljjl") pod "f4c82a1a-fbd9-45be-90a0-f170a71b801a" (UID: "f4c82a1a-fbd9-45be-90a0-f170a71b801a"). InnerVolumeSpecName "kube-api-access-qljjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:33:24.621579 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.621559 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f4c82a1a-fbd9-45be-90a0-f170a71b801a" (UID: "f4c82a1a-fbd9-45be-90a0-f170a71b801a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:33:24.713421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.713399 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qljjl\" (UniqueName: \"kubernetes.io/projected/f4c82a1a-fbd9-45be-90a0-f170a71b801a-kube-api-access-qljjl\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:33:24.713421 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.713419 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4c82a1a-fbd9-45be-90a0-f170a71b801a-tls-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:33:24.926449 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:24.926422 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:33:25.027611 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.027557 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:33:25.222540 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.222513 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" containerID="0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f" exitCode=0 Jun 15 08:33:25.222850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.222542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" event={"ID":"f4c82a1a-fbd9-45be-90a0-f170a71b801a","Type":"ContainerDied","Data":"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f"} Jun 15 08:33:25.222850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.222582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" event={"ID":"f4c82a1a-fbd9-45be-90a0-f170a71b801a","Type":"ContainerDied","Data":"8338515e2d3b48dd1235eb6d189909f578ab8374524b6a53b3ff1c9bdc5e735b"} Jun 15 08:33:25.222850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.222598 2564 scope.go:117] "RemoveContainer" containerID="0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f" Jun 15 08:33:25.222850 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.222554 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6858f7cb97-l4tzb" Jun 15 08:33:25.231170 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.231153 2564 scope.go:117] "RemoveContainer" containerID="0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f" Jun 15 08:33:25.231425 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:33:25.231409 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f\": container with ID starting with 0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f not found: ID does not exist" containerID="0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f" Jun 15 08:33:25.231475 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.231433 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f"} err="failed to get container status \"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f\": rpc error: code = NotFound desc = could not find container \"0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f\": container with ID starting with 0058219b0927967c4dcc92f194735f6794d65e953a4b8c8ad9432c93d3f4705f not found: ID does not exist" Jun 15 08:33:25.238308 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.238285 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:33:25.242154 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:25.242136 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6858f7cb97-l4tzb"] Jun 15 08:33:27.199767 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:27.199734 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" path="/var/lib/kubelet/pods/f4c82a1a-fbd9-45be-90a0-f170a71b801a/volumes" Jun 15 08:33:35.233498 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:35.233470 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:33:35.236143 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:35.236117 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:33:50.870714 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:50.870666 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:33:51.181888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:33:51.181790 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:10.914552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:10.914509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:34:11.469194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:11.469159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:23.117126 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:23.117087 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:34:23.777950 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:23.777904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:36.664590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.664557 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb"] Jun 15 08:34:36.665065 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.664931 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" containerName="authorino" Jun 15 08:34:36.665065 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.664944 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" containerName="authorino" Jun 15 08:34:36.665065 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.665001 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c82a1a-fbd9-45be-90a0-f170a71b801a" containerName="authorino" Jun 15 08:34:36.668173 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.668153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.671628 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.671606 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 08:34:36.671743 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.671605 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 08:34:36.671743 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.671665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 15 08:34:36.671743 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.671685 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bzqr8\"" Jun 15 08:34:36.681220 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.681202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb"] Jun 15 08:34:36.702233 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.702209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:34:36.762295 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.762386 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.762386 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.762465 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.762504 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.762538 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.762498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxpr\" (UniqueName: \"kubernetes.io/projected/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kube-api-access-hxxpr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863560 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863643 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863643 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxpr\" (UniqueName: \"kubernetes.io/projected/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kube-api-access-hxxpr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.863713 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.863706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.864087 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.864066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.864145 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.864084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.864182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.864155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.865896 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.865857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.866176 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.866158 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.872408 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.872387 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxpr\" (UniqueName: \"kubernetes.io/projected/450cafdf-ff9e-47df-86e5-d7e2b9eb0916-kube-api-access-hxxpr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb\" (UID: \"450cafdf-ff9e-47df-86e5-d7e2b9eb0916\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:36.981210 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:36.981185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:37.126243 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:37.126188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb"] Jun 15 08:34:37.132857 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:34:37.132832 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450cafdf_ff9e_47df_86e5_d7e2b9eb0916.slice/crio-b5a59b8f83d3186400773c02bd15072e091dddab3a747a9bf49bd48784c21908 WatchSource:0}: Error finding container b5a59b8f83d3186400773c02bd15072e091dddab3a747a9bf49bd48784c21908: Status 404 returned error can't find the container with id b5a59b8f83d3186400773c02bd15072e091dddab3a747a9bf49bd48784c21908 Jun 15 08:34:37.488172 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:37.488142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:37.621662 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:37.621625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" event={"ID":"450cafdf-ff9e-47df-86e5-d7e2b9eb0916","Type":"ContainerStarted","Data":"b5a59b8f83d3186400773c02bd15072e091dddab3a747a9bf49bd48784c21908"} Jun 15 08:34:41.648485 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:41.648448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" event={"ID":"450cafdf-ff9e-47df-86e5-d7e2b9eb0916","Type":"ContainerStarted","Data":"beb5b0a520edbce9c686298b59111dac6cdbb6e74bed56520d1b47a7efc316fa"} Jun 15 08:34:42.655319 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:42.655277 2564 generic.go:356] "Generic (PLEG): container finished" podID="450cafdf-ff9e-47df-86e5-d7e2b9eb0916" containerID="beb5b0a520edbce9c686298b59111dac6cdbb6e74bed56520d1b47a7efc316fa" exitCode=0 Jun 15 08:34:42.655782 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:42.655327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" event={"ID":"450cafdf-ff9e-47df-86e5-d7e2b9eb0916","Type":"ContainerDied","Data":"beb5b0a520edbce9c686298b59111dac6cdbb6e74bed56520d1b47a7efc316fa"} Jun 15 08:34:44.669139 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:44.669100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" event={"ID":"450cafdf-ff9e-47df-86e5-d7e2b9eb0916","Type":"ContainerStarted","Data":"57f8dce54fec97fcd8a8e7d4ce18e19a4204b3151a11c50793e12d737352ac26"} Jun 15 08:34:44.688798 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:44.688749 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" podStartSLOduration=2.567511818 podStartE2EDuration="8.688733518s" totalImagesPullingTime="4.811723248s" totalInitContainerRuntime="1.309498452s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:34:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:34:44.687909738 +0000 UTC m=+969.953529732" watchObservedRunningTime="2026-06-15 08:34:44.688733518 +0000 UTC m=+969.954353488" Jun 15 08:34:46.981669 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:46.981637 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:46.982152 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:46.981718 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:46.993954 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:46.993932 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:47.038740 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:47.038699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:34:47.695944 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:47.695920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb" Jun 15 08:34:48.178241 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:48.178158 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:55.477616 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.477546 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f"] Jun 15 08:34:55.493797 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.493774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.494079 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.494056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f"] Jun 15 08:34:55.496286 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.496267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 15 08:34:55.502972 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.502950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:34:55.612983 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.612954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.613091 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.613011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.613091 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.613070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ba02c8-438f-42da-8eb6-007318a97625-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.613165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.613098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.613165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.613121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85rc\" (UniqueName: \"kubernetes.io/projected/75ba02c8-438f-42da-8eb6-007318a97625-kube-api-access-f85rc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.613165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.613140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714399 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ba02c8-438f-42da-8eb6-007318a97625-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714499 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714499 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85rc\" (UniqueName: \"kubernetes.io/projected/75ba02c8-438f-42da-8eb6-007318a97625-kube-api-access-f85rc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714499 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714621 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714671 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714841 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714946 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.714999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.714981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.716687 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.716669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ba02c8-438f-42da-8eb6-007318a97625-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.717075 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.717057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ba02c8-438f-42da-8eb6-007318a97625-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.723113 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.723088 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85rc\" (UniqueName: \"kubernetes.io/projected/75ba02c8-438f-42da-8eb6-007318a97625-kube-api-access-f85rc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-v8r6f\" (UID: \"75ba02c8-438f-42da-8eb6-007318a97625\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.803644 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.803585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:34:55.935709 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:55.935677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f"] Jun 15 08:34:55.937088 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:34:55.937068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ba02c8_438f_42da_8eb6_007318a97625.slice/crio-305d2ed7c0740c93b437f490782e355f81035a3fe9703c39b94d3c02ce961fe9 WatchSource:0}: Error finding container 305d2ed7c0740c93b437f490782e355f81035a3fe9703c39b94d3c02ce961fe9: Status 404 returned error can't find the container with id 305d2ed7c0740c93b437f490782e355f81035a3fe9703c39b94d3c02ce961fe9 Jun 15 08:34:56.737490 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:56.737458 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" event={"ID":"75ba02c8-438f-42da-8eb6-007318a97625","Type":"ContainerStarted","Data":"4a0b5a547a266ca7b7e2921f520a4d2bf8f16aa6c00d799e13bc8223ffbd042e"} Jun 15 08:34:56.737904 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:56.737500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" event={"ID":"75ba02c8-438f-42da-8eb6-007318a97625","Type":"ContainerStarted","Data":"305d2ed7c0740c93b437f490782e355f81035a3fe9703c39b94d3c02ce961fe9"} Jun 15 08:34:56.780316 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:56.780286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:34:57.743978 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:57.743944 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ba02c8-438f-42da-8eb6-007318a97625" containerID="4a0b5a547a266ca7b7e2921f520a4d2bf8f16aa6c00d799e13bc8223ffbd042e" exitCode=0 Jun 15 08:34:57.744323 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:57.743987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" event={"ID":"75ba02c8-438f-42da-8eb6-007318a97625","Type":"ContainerDied","Data":"4a0b5a547a266ca7b7e2921f520a4d2bf8f16aa6c00d799e13bc8223ffbd042e"} Jun 15 08:34:58.751373 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:58.751333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" event={"ID":"75ba02c8-438f-42da-8eb6-007318a97625","Type":"ContainerStarted","Data":"f1886afcea554d957d86e820092ee9c4cef9815788f7cc890f2d4abf97c95044"} Jun 15 08:34:58.773804 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:34:58.773757 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" podStartSLOduration=2.260369184 podStartE2EDuration="3.77374195s" totalImagesPullingTime="226.255257ms" totalInitContainerRuntime="1.287117509s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:34:58.772207253 +0000 UTC m=+984.037827259" watchObservedRunningTime="2026-06-15 08:34:58.77374195 +0000 UTC m=+984.039361921" Jun 15 08:35:05.804642 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:35:05.804607 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:35:05.805127 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:35:05.804667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:35:05.817812 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:35:05.817789 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:35:06.806782 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:35:06.806750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-v8r6f" Jun 15 08:35:28.335858 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:35:28.335823 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:03.742314 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:03.742283 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:03.806623 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:03.806598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:21.734099 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:21.734056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:21.834945 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:21.834908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:26.541962 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:26.541857 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:59.108587 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.108547 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-585db6ff9b-j8cbp"] Jun 15 08:36:59.112047 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.112024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.120117 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.120094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-585db6ff9b-j8cbp"] Jun 15 08:36:59.183960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.183936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9856e41d-e328-4df4-a601-d7550fd2b209-tls-cert\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.184100 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.183984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggz2h\" (UniqueName: \"kubernetes.io/projected/9856e41d-e328-4df4-a601-d7550fd2b209-kube-api-access-ggz2h\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.184100 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.184004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9856e41d-e328-4df4-a601-d7550fd2b209-oidc-ca\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.285165 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.285136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9856e41d-e328-4df4-a601-d7550fd2b209-tls-cert\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.285333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.285223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggz2h\" (UniqueName: \"kubernetes.io/projected/9856e41d-e328-4df4-a601-d7550fd2b209-kube-api-access-ggz2h\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.285333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.285251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9856e41d-e328-4df4-a601-d7550fd2b209-oidc-ca\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.285856 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.285831 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9856e41d-e328-4df4-a601-d7550fd2b209-oidc-ca\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.287543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.287520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9856e41d-e328-4df4-a601-d7550fd2b209-tls-cert\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.294586 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.294560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggz2h\" (UniqueName: \"kubernetes.io/projected/9856e41d-e328-4df4-a601-d7550fd2b209-kube-api-access-ggz2h\") pod \"authorino-585db6ff9b-j8cbp\" (UID: \"9856e41d-e328-4df4-a601-d7550fd2b209\") " pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.421440 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.421384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-585db6ff9b-j8cbp" Jun 15 08:36:59.528251 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.528221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:36:59.562776 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.562753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-585db6ff9b-j8cbp"] Jun 15 08:36:59.564385 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:36:59.564358 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9856e41d_e328_4df4_a601_d7550fd2b209.slice/crio-0d88da746ea28a1649b3c62409788c36e3add21b1cd3964cff6d80df2cd33112 WatchSource:0}: Error finding container 0d88da746ea28a1649b3c62409788c36e3add21b1cd3964cff6d80df2cd33112: Status 404 returned error can't find the container with id 0d88da746ea28a1649b3c62409788c36e3add21b1cd3964cff6d80df2cd33112 Jun 15 08:36:59.565601 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.565586 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:36:59.626454 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:36:59.626426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:37:00.400390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.400304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-585db6ff9b-j8cbp" event={"ID":"9856e41d-e328-4df4-a601-d7550fd2b209","Type":"ContainerStarted","Data":"d6f22b5b4fe9e0b0286575f085e1a0f8841d1e2befd26ec95e61966eff404f48"} Jun 15 08:37:00.400390 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.400348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-585db6ff9b-j8cbp" event={"ID":"9856e41d-e328-4df4-a601-d7550fd2b209","Type":"ContainerStarted","Data":"0d88da746ea28a1649b3c62409788c36e3add21b1cd3964cff6d80df2cd33112"} Jun 15 08:37:00.420993 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.420930 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-585db6ff9b-j8cbp" podStartSLOduration=1.030005389 podStartE2EDuration="1.420907199s" totalImagesPullingTime="390.90181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:37:00.416561164 +0000 UTC m=+1105.682181147" watchObservedRunningTime="2026-06-15 08:37:00.420907199 +0000 UTC m=+1105.686527175" Jun 15 08:37:00.454546 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.454515 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:37:00.454751 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.454724 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-66956cdccc-gf252" podUID="da810617-7e7a-455a-89ca-47356e326078" containerName="authorino" containerID="cri-o://dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5" gracePeriod=30 Jun 15 08:37:00.651156 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.651033 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:37:00.724561 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.724537 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:37:00.749185 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.749142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:37:00.800230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.800195 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca\") pod \"da810617-7e7a-455a-89ca-47356e326078\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " Jun 15 08:37:00.800230 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.800233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert\") pod \"da810617-7e7a-455a-89ca-47356e326078\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " Jun 15 08:37:00.800445 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.800279 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs46p\" (UniqueName: \"kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p\") pod \"da810617-7e7a-455a-89ca-47356e326078\" (UID: \"da810617-7e7a-455a-89ca-47356e326078\") " Jun 15 08:37:00.802455 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.802419 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p" (OuterVolumeSpecName: "kube-api-access-rs46p") pod "da810617-7e7a-455a-89ca-47356e326078" (UID: "da810617-7e7a-455a-89ca-47356e326078"). InnerVolumeSpecName "kube-api-access-rs46p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:37:00.806599 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.806565 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "da810617-7e7a-455a-89ca-47356e326078" (UID: "da810617-7e7a-455a-89ca-47356e326078"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:37:00.811314 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.811274 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "da810617-7e7a-455a-89ca-47356e326078" (UID: "da810617-7e7a-455a-89ca-47356e326078"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:37:00.902054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.901955 2564 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/da810617-7e7a-455a-89ca-47356e326078-oidc-ca\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:37:00.902054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.901995 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da810617-7e7a-455a-89ca-47356e326078-tls-cert\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:37:00.902054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:00.902007 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs46p\" (UniqueName: \"kubernetes.io/projected/da810617-7e7a-455a-89ca-47356e326078-kube-api-access-rs46p\") on node \"ip-10-0-134-160.ec2.internal\" DevicePath \"\"" Jun 15 08:37:01.407317 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.407269 2564 generic.go:356] "Generic (PLEG): container finished" podID="da810617-7e7a-455a-89ca-47356e326078" containerID="dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5" exitCode=0 Jun 15 08:37:01.407317 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.407320 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66956cdccc-gf252" Jun 15 08:37:01.407840 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.407357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66956cdccc-gf252" event={"ID":"da810617-7e7a-455a-89ca-47356e326078","Type":"ContainerDied","Data":"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5"} Jun 15 08:37:01.407840 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.407411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66956cdccc-gf252" event={"ID":"da810617-7e7a-455a-89ca-47356e326078","Type":"ContainerDied","Data":"77e528c7e43ec0b184c8c76add7c74e350944d1ce5449ae481b75493d968f3f2"} Jun 15 08:37:01.407840 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.407437 2564 scope.go:117] "RemoveContainer" containerID="dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5" Jun 15 08:37:01.416677 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.416658 2564 scope.go:117] "RemoveContainer" containerID="dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5" Jun 15 08:37:01.416952 ip-10-0-134-160 kubenswrapper[2564]: E0615 08:37:01.416934 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5\": container with ID starting with dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5 not found: ID does not exist" containerID="dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5" Jun 15 08:37:01.417024 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.416964 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5"} err="failed to get container status \"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5\": rpc error: code = NotFound desc = could not find container \"dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5\": container with ID starting with dbfa8eaf0c62498fa1eb80f92b9ce7ae811d15f3949425f2496b557f2dd403d5 not found: ID does not exist" Jun 15 08:37:01.425148 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.425128 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:37:01.429539 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:01.429521 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66956cdccc-gf252"] Jun 15 08:37:03.199060 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:03.199028 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da810617-7e7a-455a-89ca-47356e326078" path="/var/lib/kubelet/pods/da810617-7e7a-455a-89ca-47356e326078/volumes" Jun 15 08:37:50.766628 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:37:50.766598 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:00.672375 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:00.672168 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:09.873313 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:09.873273 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:20.181086 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:20.181047 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:29.373011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:29.372974 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:35.277893 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:35.277851 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:38:35.282602 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:35.282575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:38:39.771822 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:39.771785 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:38:47.524701 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:47.524593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:38:48.876938 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:38:48.876905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:27.094730 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:27.094621 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:28.160525 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:28.160475 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:30.386297 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:30.386260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:30.483059 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:30.483012 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:38.904620 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:38.904588 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:44.870877 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:44.870824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:44.927550 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:44.927517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:39:54.471763 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:39:54.471723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:40:10.267050 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:10.267012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:40:17.208640 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:17.208601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:17.435671 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:17.435623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:41.189780 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:41.189747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:47.328795 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:47.328749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:47.429004 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:47.428976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:47.526354 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:47.526322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:47.685882 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:47.685830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:47.786539 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:47.786505 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:40:49.501475 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:40:49.501445 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:41:04.360533 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:04.360438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:04.464829 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:04.464795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:04.566911 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:04.566851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:05.772661 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:05.772628 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:41:06.715254 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:06.715214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:10.514241 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:10.514197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:10.614835 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:10.614796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:18.661988 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:18.661941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:18.762563 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:18.762520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:18.861370 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:18.861340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:18.969094 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:18.969056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:20.185732 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:20.185696 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:41:35.458430 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:35.458397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:35.574441 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:35.574407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:35.704798 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:35.704762 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:36.767563 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:36.767527 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:41:41.745608 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:41.745563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:41.813726 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:41.813705 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:57.956936 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:57.956891 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:58.054556 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:58.054527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:41:58.160221 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:41:58.160189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:04.364687 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:04.364629 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:04.522979 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:04.522949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:04.632152 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:04.632065 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:04.732017 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:04.731983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:10.913951 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:10.913918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:10.983996 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:10.983967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:42:37.366011 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:37.365924 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:42:46.274952 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:42:46.274918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:43:03.187228 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:03.187189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:43:11.574985 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:11.574948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:43:29.071046 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:29.071001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:43:35.319410 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:35.319381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:43:35.325656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:35.325638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:43:37.465014 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:43:37.464976 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:44:09.980779 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:09.980696 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:44:19.192955 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:19.192916 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:44:27.078799 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:27.078767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:44:30.330000 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:30.329962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:44:35.191019 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:35.190984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:44:43.680612 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:44:43.680579 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:45:09.173223 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:45:09.173184 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:45:22.676627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:45:22.676590 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:45:51.279910 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:45:51.279800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:45:54.078073 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:45:54.078038 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:46:10.474016 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:10.473977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:46:15.103786 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:15.103753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:46:18.273089 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:18.273054 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:46:37.270724 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:37.270687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:46:45.771880 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:45.771828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:46:54.864682 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:46:54.864608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:03.176749 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:03.176715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:12.673333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:12.673294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:21.668242 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:21.668209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:30.191656 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:30.191624 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:38.565023 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:38.564990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:47.077749 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:47.077718 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:47:55.371968 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:47:55.371932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:48:35.355821 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:48:35.355790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:48:35.363451 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:48:35.363428 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:50:18.481785 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:50:18.481744 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:50:22.779515 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:50:22.779488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:50:48.775480 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:50:48.775443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:50:53.174634 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:50:53.174595 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:00.815966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:00.815929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:11.465552 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:11.465518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:19.972960 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:19.972917 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:30.169202 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:30.169127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:39.590775 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:39.590744 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:49.375155 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:49.375120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:51:59.001048 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:51:59.001016 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:52:09.506333 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:52:09.506301 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:52:18.828613 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:52:18.828577 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:52:51.678490 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:52:51.678455 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:53:34.578090 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:34.578053 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:53:35.397817 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:35.397738 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:53:35.404530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:35.404508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:53:42.495611 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:42.495572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:53:46.658047 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:46.658013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:53:51.881977 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:53:51.881892 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:00.397212 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:00.397178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:09.234471 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:09.234439 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:21.895248 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:21.895203 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:31.013182 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:31.013106 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:36.802409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:36.802373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:45.595667 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:45.595634 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:54:53.400802 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:54:53.400773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:00.982649 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:00.982614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:55:01.910790 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:01.910756 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:12.372002 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:12.371972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:20.342405 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:20.342377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:55:20.464334 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:20.464296 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:55:30.624925 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:30.624886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:38.978896 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:38.978844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:48.010830 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:48.010794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:55:56.607363 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:55:56.607293 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:13.491063 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:13.491023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:14.205510 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:14.205468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:56:21.989282 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:21.989249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:30.789424 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:30.789390 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:39.301225 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:39.301191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:48.322518 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:48.322484 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:56:56.886372 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:56:56.886344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:05.677361 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:05.677322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:16.658624 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:16.658585 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:25.869238 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:25.869150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:36.887139 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:36.887102 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:46.277098 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:46.277064 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:51.379033 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:51.378998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:57:58.677809 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:57:58.677771 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:58:04.075724 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:04.075685 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:58:18.476951 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:18.476917 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:58:27.072943 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:27.072900 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l6j9"] Jun 15 08:58:35.437721 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:35.437685 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:58:35.442291 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:35.442270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7827g_5830691a-6638-49a1-ab61-978776f82fe1/ovn-acl-logging/0.log" Jun 15 08:58:36.541579 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:36.541545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:36.613884 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:36.613846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:36.713847 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:36.713816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:36.813973 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:36.813885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:40.141409 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:40.141371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:42.786877 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:42.786827 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:42.971873 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:42.971825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:43.071978 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:43.071910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:45.024999 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:45.024971 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:49.195604 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:49.195560 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:50.330918 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:50.330886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:52.749217 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:52.749183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:55.689386 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:55.689307 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:56.896451 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:56.896421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:58:56.996586 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:58:56.996559 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:00.043364 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:00.043331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:03.404378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:03.404351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:03.504346 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:03.504316 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:10.411267 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:10.411223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:10.864052 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:10.864026 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-585db6ff9b-j8cbp_9856e41d-e328-4df4-a601-d7550fd2b209/authorino/0.log" Jun 15 08:59:16.686557 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:16.686528 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-rs5br_a7d1e815-9ee8-40fd-ab63-8695141df36e/copy-manifests/0.log" Jun 15 08:59:16.694770 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:16.694745 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-rs5br_a7d1e815-9ee8-40fd-ab63-8695141df36e/manager/0.log" Jun 15 08:59:17.727682 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.727655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/util/0.log" Jun 15 08:59:17.735391 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.735362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/pull/0.log" Jun 15 08:59:17.742753 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.742737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/extract/0.log" Jun 15 08:59:17.857797 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.857761 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/util/0.log" Jun 15 08:59:17.865085 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.865062 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/pull/0.log" Jun 15 08:59:17.872192 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.872173 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/extract/0.log" Jun 15 08:59:17.985640 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.985548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/util/0.log" Jun 15 08:59:17.994658 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:17.994634 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/pull/0.log" Jun 15 08:59:18.004605 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.004586 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/extract/0.log" Jun 15 08:59:18.125617 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.125592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/util/0.log" Jun 15 08:59:18.134077 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.134053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/pull/0.log" Jun 15 08:59:18.144317 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.144297 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/extract/0.log" Jun 15 08:59:18.262377 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.262295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-585db6ff9b-j8cbp_9856e41d-e328-4df4-a601-d7550fd2b209/authorino/0.log" Jun 15 08:59:18.619966 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:18.619885 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rcbjg_bd97de93-4fd7-4f09-8a1c-77f5a737c135/kuadrant-console-plugin/0.log" Jun 15 08:59:19.040437 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:19.040413 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5l6j9_8bf6ed8a-939d-4946-8ce3-9b967eb74d2b/limitador/0.log" Jun 15 08:59:19.886368 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:19.886340 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b895ff9c6-j49fw_43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1/kube-auth-proxy/0.log" Jun 15 08:59:20.406876 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:20.406836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5fb9cfcd-dk2fg_fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49/router/0.log" Jun 15 08:59:21.140194 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:21.140164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb_450cafdf-ff9e-47df-86e5-d7e2b9eb0916/storage-initializer/0.log" Jun 15 08:59:21.154095 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:21.154072 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd4rzb_450cafdf-ff9e-47df-86e5-d7e2b9eb0916/main/0.log" Jun 15 08:59:21.403530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:21.403472 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-v8r6f_75ba02c8-438f-42da-8eb6-007318a97625/storage-initializer/0.log" Jun 15 08:59:21.412894 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:21.412860 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-v8r6f_75ba02c8-438f-42da-8eb6-007318a97625/main/0.log" Jun 15 08:59:21.767590 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:21.767561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:25.668384 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.668353 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88cvp/must-gather-22gq8"] Jun 15 08:59:25.668750 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.668697 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da810617-7e7a-455a-89ca-47356e326078" containerName="authorino" Jun 15 08:59:25.668750 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.668708 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="da810617-7e7a-455a-89ca-47356e326078" containerName="authorino" Jun 15 08:59:25.668824 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.668762 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="da810617-7e7a-455a-89ca-47356e326078" containerName="authorino" Jun 15 08:59:25.671953 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.671937 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.675933 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.675911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88cvp\"/\"openshift-service-ca.crt\"" Jun 15 08:59:25.676519 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.676501 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88cvp\"/\"default-dockercfg-4qtf6\"" Jun 15 08:59:25.676627 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.676539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88cvp\"/\"kube-root-ca.crt\"" Jun 15 08:59:25.687277 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.687255 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/must-gather-22gq8"] Jun 15 08:59:25.689751 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.689726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:25.756526 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.756501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9efcaec-2595-4816-822e-15ab7c96c03e-must-gather-output\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.756622 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.756567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pfv\" (UniqueName: \"kubernetes.io/projected/b9efcaec-2595-4816-822e-15ab7c96c03e-kube-api-access-c8pfv\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.803225 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.803202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" limit=1024 Jun 15 08:59:25.857918 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.857891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9efcaec-2595-4816-822e-15ab7c96c03e-must-gather-output\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.858026 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.857979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pfv\" (UniqueName: \"kubernetes.io/projected/b9efcaec-2595-4816-822e-15ab7c96c03e-kube-api-access-c8pfv\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.858229 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.858211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9efcaec-2595-4816-822e-15ab7c96c03e-must-gather-output\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.873798 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.873772 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pfv\" (UniqueName: \"kubernetes.io/projected/b9efcaec-2595-4816-822e-15ab7c96c03e-kube-api-access-c8pfv\") pod \"must-gather-22gq8\" (UID: \"b9efcaec-2595-4816-822e-15ab7c96c03e\") " pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:25.981632 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:25.981615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/must-gather-22gq8" Jun 15 08:59:26.130240 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:26.130099 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/must-gather-22gq8"] Jun 15 08:59:26.133826 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:59:26.133793 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9efcaec_2595_4816_822e_15ab7c96c03e.slice/crio-fd5d46efd3108b27d141b0a7fe5184c35e428a4a2df188f8464251f4df665f30 WatchSource:0}: Error finding container fd5d46efd3108b27d141b0a7fe5184c35e428a4a2df188f8464251f4df665f30: Status 404 returned error can't find the container with id fd5d46efd3108b27d141b0a7fe5184c35e428a4a2df188f8464251f4df665f30 Jun 15 08:59:26.135378 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:26.135361 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:59:26.594303 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:26.594273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/must-gather-22gq8" event={"ID":"b9efcaec-2595-4816-822e-15ab7c96c03e","Type":"ContainerStarted","Data":"fd5d46efd3108b27d141b0a7fe5184c35e428a4a2df188f8464251f4df665f30"} Jun 15 08:59:27.604894 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:27.604844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/must-gather-22gq8" event={"ID":"b9efcaec-2595-4816-822e-15ab7c96c03e","Type":"ContainerStarted","Data":"6eb238720d875669a29c2ff267506be6e0d17755200ec24a91d023e9f0ec933d"} Jun 15 08:59:27.605379 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:27.604912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/must-gather-22gq8" event={"ID":"b9efcaec-2595-4816-822e-15ab7c96c03e","Type":"ContainerStarted","Data":"bcbd99315eba4dd7d753bada7c120930a970bbf16ebacbb75760c645950d3ee3"} Jun 15 08:59:27.624480 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:27.624423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88cvp/must-gather-22gq8" podStartSLOduration=1.904531945 podStartE2EDuration="2.624404942s" totalImagesPullingTime="719.872997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:59:27.620120889 +0000 UTC m=+2452.885740860" watchObservedRunningTime="2026-06-15 08:59:27.624404942 +0000 UTC m=+2452.890024913" Jun 15 08:59:28.786807 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:28.786777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rvs4s_5674de82-e968-492d-a50b-e494a202d456/global-pull-secret-syncer/0.log" Jun 15 08:59:28.871828 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:28.871794 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4zdpm_48d6b96b-95f6-4958-89ed-5e7abb05ae4d/konnectivity-agent/0.log" Jun 15 08:59:29.035885 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:29.035839 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-160.ec2.internal_5fb99caa2341a0560c862ba7933daeb2/haproxy/0.log" Jun 15 08:59:32.728570 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.728539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/extract/0.log" Jun 15 08:59:32.768888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.767686 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/util/0.log" Jun 15 08:59:32.801116 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.801084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwqzw_e75bb6bf-8d20-47fd-8d44-6e33f19ca3c3/pull/0.log" Jun 15 08:59:32.842940 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.842910 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/extract/0.log" Jun 15 08:59:32.868635 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.868555 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/util/0.log" Jun 15 08:59:32.893819 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.893790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k25xq_18e67466-a33f-4685-b746-a6fb9088db85/pull/0.log" Jun 15 08:59:32.924066 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.924037 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/extract/0.log" Jun 15 08:59:32.956893 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.955625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/util/0.log" Jun 15 08:59:32.985886 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:32.985016 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h5pk7_3a8a0202-c4b9-44f2-9873-6f024c6f3ae0/pull/0.log" Jun 15 08:59:33.044930 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.044893 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/extract/0.log" Jun 15 08:59:33.088072 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.088041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/util/0.log" Jun 15 08:59:33.120759 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.120653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4wd6_4ee44047-7f5a-48ac-8e9c-e782ffcc69c2/pull/0.log" Jun 15 08:59:33.454891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.454598 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-585db6ff9b-j8cbp_9856e41d-e328-4df4-a601-d7550fd2b209/authorino/0.log" Jun 15 08:59:33.530623 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.530592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rcbjg_bd97de93-4fd7-4f09-8a1c-77f5a737c135/kuadrant-console-plugin/0.log" Jun 15 08:59:33.708285 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:33.708207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5l6j9_8bf6ed8a-939d-4946-8ce3-9b967eb74d2b/limitador/0.log" Jun 15 08:59:35.478413 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.478373 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/alertmanager/0.log" Jun 15 08:59:35.504823 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.504789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/config-reloader/0.log" Jun 15 08:59:35.528982 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.528929 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/kube-rbac-proxy-web/0.log" Jun 15 08:59:35.552052 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.552017 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/kube-rbac-proxy/0.log" Jun 15 08:59:35.580611 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.580574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/kube-rbac-proxy-metric/0.log" Jun 15 08:59:35.602930 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.602898 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/prom-label-proxy/0.log" Jun 15 08:59:35.624768 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.624641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ad6fc59-c600-4be7-a6bc-43e186fa1673/init-config-reloader/0.log" Jun 15 08:59:35.712410 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.712381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4z6bl_1b7de6b8-aaed-416d-a783-d7024da7e41e/kube-state-metrics/0.log" Jun 15 08:59:35.732301 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.732220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4z6bl_1b7de6b8-aaed-416d-a783-d7024da7e41e/kube-rbac-proxy-main/0.log" Jun 15 08:59:35.757489 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.757356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4z6bl_1b7de6b8-aaed-416d-a783-d7024da7e41e/kube-rbac-proxy-self/0.log" Jun 15 08:59:35.786280 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.786247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67465b6d87-z8zrs_569ef4e2-f912-4ec9-adfc-dba87df1bf7e/metrics-server/0.log" Jun 15 08:59:35.825631 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.825599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-9668m_6f7d791f-8be1-404b-8668-494925ce5a65/monitoring-plugin/0.log" Jun 15 08:59:35.860860 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.860833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-448nd_812a7c6f-aff4-4a65-866d-f51fcd49ba22/node-exporter/0.log" Jun 15 08:59:35.886705 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.886677 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-448nd_812a7c6f-aff4-4a65-866d-f51fcd49ba22/kube-rbac-proxy/0.log" Jun 15 08:59:35.924720 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:35.924689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-448nd_812a7c6f-aff4-4a65-866d-f51fcd49ba22/init-textfile/0.log" Jun 15 08:59:39.907676 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:39.907641 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2"] Jun 15 08:59:39.914429 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:39.914403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:39.923805 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:39.923774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2"] Jun 15 08:59:40.007891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.007680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skldh\" (UniqueName: \"kubernetes.io/projected/fca9ace5-f540-4011-96be-abcfc641f2bb-kube-api-access-skldh\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.007891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.007747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-proc\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.007891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.007773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-lib-modules\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.007891 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.007818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-sys\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.008276 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.007924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-podres\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.099545 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.099514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-27mbf_276010f8-5e47-40d4-81d1-8e70753a137d/download-server/0.log" Jun 15 08:59:40.109112 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-sys\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-podres\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-sys\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skldh\" (UniqueName: \"kubernetes.io/projected/fca9ace5-f540-4011-96be-abcfc641f2bb-kube-api-access-skldh\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-proc\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109288 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-lib-modules\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-podres\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-lib-modules\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.109543 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.109363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fca9ace5-f540-4011-96be-abcfc641f2bb-proc\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.119242 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.119209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skldh\" (UniqueName: \"kubernetes.io/projected/fca9ace5-f540-4011-96be-abcfc641f2bb-kube-api-access-skldh\") pod \"perf-node-gather-daemonset-njpm2\" (UID: \"fca9ace5-f540-4011-96be-abcfc641f2bb\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.232594 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.232558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:40.405672 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.405628 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2"] Jun 15 08:59:40.408845 ip-10-0-134-160 kubenswrapper[2564]: W0615 08:59:40.408813 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfca9ace5_f540_4011_96be_abcfc641f2bb.slice/crio-c72ec2934a0bda4a9371ac00ecd3dfcd1e75d5122475beec6e9be6d13835b926 WatchSource:0}: Error finding container c72ec2934a0bda4a9371ac00ecd3dfcd1e75d5122475beec6e9be6d13835b926: Status 404 returned error can't find the container with id c72ec2934a0bda4a9371ac00ecd3dfcd1e75d5122475beec6e9be6d13835b926 Jun 15 08:59:40.721671 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.721638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" event={"ID":"fca9ace5-f540-4011-96be-abcfc641f2bb","Type":"ContainerStarted","Data":"c528072284d0ec436adfc4c6e24202c14e36b3f96009a2ff1ef3f9a97de458ac"} Jun 15 08:59:40.721888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.721695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" event={"ID":"fca9ace5-f540-4011-96be-abcfc641f2bb","Type":"ContainerStarted","Data":"c72ec2934a0bda4a9371ac00ecd3dfcd1e75d5122475beec6e9be6d13835b926"} Jun 15 08:59:40.721888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:40.721722 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:41.883134 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:41.883109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdqbq_41c1893c-ac8e-442e-bb13-902f9d138ca7/dns/0.log" Jun 15 08:59:41.907748 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:41.907726 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdqbq_41c1893c-ac8e-442e-bb13-902f9d138ca7/kube-rbac-proxy/0.log" Jun 15 08:59:42.029887 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:42.029836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqdtl_5273e8f5-cc36-4d0f-b3aa-703c939dd650/dns-node-resolver/0.log" Jun 15 08:59:42.645716 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:42.645689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cqbv7_287d5ac4-6d9a-4c70-94ea-1a03da6bd642/node-ca/0.log" Jun 15 08:59:43.808548 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:43.808521 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b895ff9c6-j49fw_43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1/kube-auth-proxy/0.log" Jun 15 08:59:44.082442 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:44.082373 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5fb9cfcd-dk2fg_fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49/router/0.log" Jun 15 08:59:44.771054 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:44.771020 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d9pbc_96724c47-bd66-4551-aaee-79a1f426be4e/serve-healthcheck-canary/0.log" Jun 15 08:59:45.323080 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:45.323052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fh7f_93f1ac1c-a8a1-4a29-9476-66b5611847e3/kube-rbac-proxy/0.log" Jun 15 08:59:45.345016 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:45.344988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fh7f_93f1ac1c-a8a1-4a29-9476-66b5611847e3/exporter/0.log" Jun 15 08:59:45.368290 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:45.368267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5fh7f_93f1ac1c-a8a1-4a29-9476-66b5611847e3/extractor/0.log" Jun 15 08:59:46.740888 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:46.740789 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" Jun 15 08:59:46.761037 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:46.760971 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-njpm2" podStartSLOduration=7.760952505 podStartE2EDuration="7.760952505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:59:40.742896056 +0000 UTC m=+2466.008516027" watchObservedRunningTime="2026-06-15 08:59:46.760952505 +0000 UTC m=+2472.026572476" Jun 15 08:59:48.473147 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:48.473093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-rs5br_a7d1e815-9ee8-40fd-ab63-8695141df36e/manager/0.log" Jun 15 08:59:48.497602 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:48.497574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-rs5br_a7d1e815-9ee8-40fd-ab63-8695141df36e/copy-manifests/0.log" Jun 15 08:59:50.289135 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:50.289038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bd5868f66-l86kh_4852ade3-52cb-40bf-9bc8-8907468b4140/manager/0.log" Jun 15 08:59:53.756530 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:53.756498 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b895ff9c6-j49fw_43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1/kube-auth-proxy/0.log" Jun 15 08:59:53.978207 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:53.978179 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5fb9cfcd-dk2fg_fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49/router/0.log" Jun 15 08:59:55.228621 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:55.228558 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b895ff9c6-j49fw_43ec0eea-710d-4cb4-8adc-5ef7ed6f4bb1/kube-auth-proxy/0.log" Jun 15 08:59:55.456061 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:55.456031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5fb9cfcd-dk2fg_fe67cfa0-81ce-45cf-afd5-0eafaa1f5b49/router/0.log" Jun 15 08:59:55.836658 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:55.836621 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7nb7f_c71746ed-4290-4b34-8b8a-cdce86159b5b/kube-storage-version-migrator-operator/1.log" Jun 15 08:59:55.837636 ip-10-0-134-160 kubenswrapper[2564]: I0615 08:59:55.837608 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7nb7f_c71746ed-4290-4b34-8b8a-cdce86159b5b/kube-storage-version-migrator-operator/0.log"