Jun 10 01:01:50.335867 ip-10-0-132-148 systemd[1]: Starting Kubernetes Kubelet... Jun 10 01:01:50.704677 ip-10-0-132-148 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:50.704677 ip-10-0-132-148 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 01:01:50.704677 ip-10-0-132-148 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:50.704677 ip-10-0-132-148 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 01:01:50.704677 ip-10-0-132-148 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:50.705520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.705421 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 01:01:50.710914 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710892 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.710914 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710910 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.710914 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710915 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.710914 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710919 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710922 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710925 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710928 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710930 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710933 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710935 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710938 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710941 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710943 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710946 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710949 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710952 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710954 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710957 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710959 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710962 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710964 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710967 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710970 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710972 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.711083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710975 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710977 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710980 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710983 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710985 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710988 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710990 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.710996 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711000 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711003 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711005 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711008 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711010 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711014 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711017 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711020 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711022 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711025 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711028 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.711616 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711030 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711033 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711035 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711038 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711042 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711046 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711049 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711051 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711055 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711058 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711062 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711065 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711067 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711070 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711073 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711076 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711080 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711084 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711088 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.712119 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711090 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711093 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711096 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711099 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711102 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711105 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711109 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711113 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711115 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711118 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711121 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711125 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711128 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711130 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711133 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711136 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711138 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711141 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711144 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711146 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.712604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711149 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711153 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711155 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711158 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711161 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711163 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711166 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711169 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711172 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711174 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711177 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711179 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711182 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711185 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711187 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711190 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711192 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711927 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711935 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711939 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.713100 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711942 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711944 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711947 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711950 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711953 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711958 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711963 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711966 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711969 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711972 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711976 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711980 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711983 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711986 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711989 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.711992 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712036 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712041 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712044 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.713594 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712047 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712050 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712053 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712056 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712059 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712061 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712064 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712067 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712070 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712073 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712076 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712078 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712082 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712086 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712089 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712091 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712095 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712097 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712100 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712102 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.714068 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712105 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712108 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712110 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712113 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712115 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712118 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712121 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712123 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712127 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712129 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712132 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712135 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712137 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712140 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712142 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712145 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712147 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712149 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712152 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712156 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.714584 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712159 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712161 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712164 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712167 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712171 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712173 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712176 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712179 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712181 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712184 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712186 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712189 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712191 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712194 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712196 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712199 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712201 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712204 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712206 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712210 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.715142 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712213 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712216 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712219 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712221 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712225 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712227 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712230 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712233 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712235 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712239 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712242 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712244 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712247 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712250 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712252 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712262 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712266 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712708 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712715 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712718 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.715640 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712721 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712724 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712727 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712730 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712733 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712736 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712739 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712742 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712745 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712747 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712750 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712753 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712755 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712758 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712761 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712765 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712767 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712770 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712772 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712775 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.716123 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712777 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712780 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712782 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712786 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712790 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712792 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712795 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712798 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712800 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712803 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712806 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712808 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712811 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712813 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712815 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712818 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712820 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712823 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712825 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.716638 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712828 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712831 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712833 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712836 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712839 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712842 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712845 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712848 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712851 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712854 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712856 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712859 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712861 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712864 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712866 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712869 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712871 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712874 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712876 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712879 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.717164 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712881 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712883 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712887 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712889 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712892 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712894 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712897 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712899 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712902 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712904 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712907 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712909 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712912 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712914 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712917 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712919 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712922 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712931 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712935 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.717670 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712939 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712942 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712945 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712948 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712950 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712953 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712955 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712959 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712962 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712966 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712969 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712971 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712974 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712976 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712979 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712981 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712984 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.712986 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713057 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713065 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713070 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 01:01:50.718134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713075 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713079 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713082 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713086 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713090 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713093 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713096 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713099 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713103 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713108 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713111 2573 flags.go:64] FLAG: --cgroup-root="" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713114 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713117 2573 flags.go:64] FLAG: --client-ca-file="" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713120 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713123 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713139 2573 flags.go:64] FLAG: --cluster-domain="" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713143 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713146 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713149 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713152 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713156 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713159 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713162 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 01:01:50.718662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713165 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713168 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713171 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713174 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713177 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713180 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713184 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713187 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713190 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713192 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713195 2573 flags.go:64] FLAG: --enable-server="true" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713198 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713202 2573 flags.go:64] FLAG: --event-burst="100" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713205 2573 flags.go:64] FLAG: --event-qps="50" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713207 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713210 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713213 2573 flags.go:64] FLAG: --eviction-hard="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713217 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713221 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713224 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713227 2573 flags.go:64] FLAG: --eviction-soft="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713230 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713233 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713236 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713239 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 01:01:50.719237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713243 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713245 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713248 2573 flags.go:64] FLAG: --feature-gates="" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713252 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713255 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713258 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713261 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713264 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713267 2573 flags.go:64] FLAG: --help="false" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713270 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713273 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713276 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713279 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713282 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713285 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713288 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713291 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713293 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713296 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713299 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713302 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713305 2573 flags.go:64] FLAG: --kube-reserved="" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713308 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713310 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 01:01:50.719911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713313 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713319 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713322 2573 flags.go:64] FLAG: --lock-file="" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713325 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713328 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713331 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713337 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713340 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713343 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713346 2573 flags.go:64] FLAG: --logging-format="text" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713349 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713352 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713355 2573 flags.go:64] FLAG: --manifest-url="" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713357 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713362 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713364 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713368 2573 flags.go:64] FLAG: --max-pods="110" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713371 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713374 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713377 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713380 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713383 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713385 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713388 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713396 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 01:01:50.720556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713399 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713402 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713405 2573 flags.go:64] FLAG: --pod-cidr="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713407 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713413 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713415 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713419 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713421 2573 flags.go:64] FLAG: --port="10250" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713425 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713429 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033a14af354edec5a" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713432 2573 flags.go:64] FLAG: --qos-reserved="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713435 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713438 2573 flags.go:64] FLAG: --register-node="true" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713441 2573 flags.go:64] FLAG: --register-with-taints="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713445 2573 flags.go:64] FLAG: --registry-burst="10" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713448 2573 flags.go:64] FLAG: --registry-qps="5" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713451 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713454 2573 flags.go:64] FLAG: --reserved-memory="" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713458 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713460 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713476 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713480 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713482 2573 flags.go:64] FLAG: --runonce="false" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713485 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713488 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 01:01:50.721167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713491 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713494 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713497 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713500 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713503 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713506 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713509 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713512 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713514 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713517 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713520 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713523 2573 flags.go:64] FLAG: --system-cgroups="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713525 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713530 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713533 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713536 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713542 2573 flags.go:64] FLAG: --tls-min-version="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713545 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713548 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713550 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713553 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713556 2573 flags.go:64] FLAG: --v="2" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713560 2573 flags.go:64] FLAG: --version="false" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713565 2573 flags.go:64] FLAG: --vmodule="" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713568 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 01:01:50.721781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713572 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713688 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713692 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713695 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713698 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713700 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713703 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713707 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713711 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713714 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713717 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713721 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713725 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713728 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713731 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713734 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713737 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713740 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713742 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713745 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.722396 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713747 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713750 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713754 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713758 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713761 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713763 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713766 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713769 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713771 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713774 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713777 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713780 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713783 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713786 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713788 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713791 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713793 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713796 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713798 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713801 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.722909 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713803 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713806 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713809 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713811 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713814 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713817 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713819 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713822 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713824 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713827 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713830 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713832 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713835 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713837 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713841 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713845 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713848 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713850 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713853 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713856 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.723404 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713858 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713861 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713863 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713866 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713869 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713874 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713877 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713880 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713882 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713885 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713888 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713891 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713894 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713897 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713899 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713902 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713905 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713907 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713910 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.723926 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713912 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713915 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713918 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713920 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713923 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713925 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713928 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713932 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713935 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713938 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713941 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713943 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713946 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713948 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713951 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713953 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713956 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713958 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713961 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713964 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.724438 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.713966 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.713972 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.720923 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.720938 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.720960 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.720966 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721020 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721024 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721028 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721031 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721034 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721039 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721043 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721046 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.724943 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721049 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721052 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721055 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721058 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721061 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721064 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721067 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721069 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721072 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721074 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721077 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721079 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721082 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721085 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721087 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721090 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721092 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721095 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721098 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721100 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.725294 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721103 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721107 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721110 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721114 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721118 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721121 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721124 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721127 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721129 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721132 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721134 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721137 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721140 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721142 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721145 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721147 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721150 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721152 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721155 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.725880 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721158 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721160 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721163 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721166 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721169 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721172 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721175 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721177 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721180 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721183 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721186 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721189 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721191 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721194 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721197 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721200 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721203 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721205 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721208 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721211 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.726351 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721214 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721217 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721221 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721224 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721227 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721230 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721233 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721236 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721239 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721242 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721244 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721247 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721249 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721252 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721255 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721257 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721260 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721263 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721265 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.726842 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721268 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721271 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721273 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721276 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721278 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721281 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721284 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721287 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721289 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721292 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721295 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721298 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721300 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.721305 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:50.727306 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721417 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721421 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721424 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721427 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721430 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721433 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721436 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721439 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721442 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721445 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721448 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721450 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721453 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721456 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721458 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721461 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721480 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721483 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721486 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721489 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:50.727666 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721492 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721495 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721498 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721500 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721503 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721506 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721510 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721514 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721518 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721521 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721524 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721527 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721530 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721533 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721536 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721539 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721541 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721544 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721546 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:50.728159 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721549 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721552 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721554 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721558 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721562 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721565 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721568 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721571 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721574 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721576 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721579 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721581 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721584 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721586 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721589 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721591 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721594 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721596 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721599 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:50.728646 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721602 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721604 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721608 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721612 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721615 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721618 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721621 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721624 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721626 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721629 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721631 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721634 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721636 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721638 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721641 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721644 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721646 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721649 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721651 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721654 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:50.729106 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721656 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721659 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721661 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721664 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721667 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721669 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721672 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721674 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721676 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721679 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721681 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721684 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721687 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721689 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721692 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721694 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721697 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721700 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721702 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721705 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:50.729649 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:50.721707 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.721712 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.721808 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.724040 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.725539 2573 server.go:1019] "Starting client certificate rotation" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.725640 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.725670 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.727967 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:01:50.730113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.729738 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:01:50.742783 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.742760 2573 log.go:25] "Validated CRI v1 runtime API" Jun 10 01:01:50.745728 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.745712 2573 log.go:25] "Validated CRI v1 image API" Jun 10 01:01:50.747290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.747274 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 01:01:50.749432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.749409 2573 fs.go:135] Filesystem UUIDs: map[2da67621-33af-41e9-9b63-6a7287fa871b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d68a9754-9471-428c-8f28-f364c7cbe642:/dev/nvme0n1p3] Jun 10 01:01:50.749525 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.749429 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 01:01:50.750785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.750764 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:01:50.755189 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.755072 2573 manager.go:216] Machine: {Timestamp:2026-06-10 01:01:50.753838106 +0000 UTC m=+0.295668598 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3146566 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b5d0a8441d048410bdeed9292153 SystemUUID:ec26b5d0-a844-1d04-8410-bdeed9292153 BootID:9ff18532-b797-485f-b754-ff7a7eaca703 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:2e:f7:9e:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:2e:f7:9e:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:37:37:b3:b1:d6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 01:01:50.755189 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.755185 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 01:01:50.755310 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.755269 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 01:01:50.758508 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.758460 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 01:01:50.758677 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.758512 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 01:01:50.759351 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.759339 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 01:01:50.759407 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.759358 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 01:01:50.759407 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.759369 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:01:50.760053 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.760041 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:01:50.761263 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.761251 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 01:01:50.764775 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.764760 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:01:50.765086 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765073 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 01:01:50.765160 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765113 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 10 01:01:50.765160 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765129 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 01:01:50.765160 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765149 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 01:01:50.765276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765163 2573 kubelet.go:398] "Adding apiserver pod source" Jun 10 01:01:50.765276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765176 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 01:01:50.765583 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765569 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:01:50.765658 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.765592 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:01:50.767614 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.767598 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 01:01:50.769210 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.769193 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 01:01:50.769298 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.769232 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 01:01:50.770426 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770413 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770434 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770443 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770452 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770482 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770492 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770505 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 01:01:50.770515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770514 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 01:01:50.770731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770524 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 01:01:50.770731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770532 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 01:01:50.770731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770552 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 01:01:50.770731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.770560 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 01:01:50.771777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.771766 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 01:01:50.771829 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.771780 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 01:01:50.775066 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.775049 2573 server.go:1268] "Started kubelet" Jun 10 01:01:50.775158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.775134 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 01:01:50.776058 ip-10-0-132-148 systemd[1]: Started Kubernetes Kubelet. Jun 10 01:01:50.776698 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.775612 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 01:01:50.776698 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.776163 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 01:01:50.779413 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.779380 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 01:01:50.779574 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.779552 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 01:01:50.779637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.779625 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 01:01:50.781096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.781054 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 01:01:50.781314 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.781292 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 10 01:01:50.782823 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.781872 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-148.ec2.internal.18b7928cbac74d20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-148.ec2.internal,UID:ip-10-0-132-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-148.ec2.internal,},FirstTimestamp:2026-06-10 01:01:50.775020832 +0000 UTC m=+0.316851324,LastTimestamp:2026-06-10 01:01:50.775020832 +0000 UTC m=+0.316851324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-148.ec2.internal,}" Jun 10 01:01:50.783071 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.783043 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 01:01:50.786436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.786415 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 01:01:50.786540 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.786430 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 01:01:50.786540 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.786515 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:50.787159 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787142 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 01:01:50.787159 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787141 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 01:01:50.787289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787167 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 01:01:50.787289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787280 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 10 01:01:50.787289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787289 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 10 01:01:50.787571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787541 2573 factory.go:55] Registering systemd factory Jun 10 01:01:50.787571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787561 2573 factory.go:223] Registration of the systemd container factory successfully Jun 10 01:01:50.787911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787896 2573 factory.go:153] Registering CRI-O factory Jun 10 01:01:50.787967 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787912 2573 factory.go:223] Registration of the crio container factory successfully Jun 10 01:01:50.787967 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787961 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 01:01:50.788053 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787983 2573 factory.go:103] Registering Raw factory Jun 10 01:01:50.788053 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.787999 2573 manager.go:1196] Started watching for new ooms in manager Jun 10 01:01:50.789174 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.788311 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 01:01:50.789174 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.788367 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 01:01:50.789174 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.788798 2573 manager.go:349] Starting recovery of all containers Jun 10 01:01:50.792811 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.792790 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-shhzv" Jun 10 01:01:50.799268 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.799078 2573 manager.go:354] Recovery completed Jun 10 01:01:50.800857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.800838 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-shhzv" Jun 10 01:01:50.803753 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.803740 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.805706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.805690 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.805762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.805721 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.805762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.805736 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.806268 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806254 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 01:01:50.806328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806268 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 01:01:50.806328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806254 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.806328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806288 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:01:50.806924 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806909 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.806987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806933 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.806987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.806942 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.807421 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.807408 2573 policy_none.go:49] "None policy: Start" Jun 10 01:01:50.807454 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.807428 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 01:01:50.807454 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.807443 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 01:01:50.808568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.808552 2573 policy_none.go:47] "Start" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.851209 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.852283 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.852319 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.852345 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.852378 2573 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853210 2573 manager.go:337] "Starting Device Plugin manager" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.853264 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853275 2573 server.go:87] "Starting device plugin registration server" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853552 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853566 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853642 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853722 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.853732 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.854286 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.854399 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 01:01:50.869594 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.854452 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:50.952694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.952644 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal"] Jun 10 01:01:50.952808 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.952744 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.954204 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954191 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.954595 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954574 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.954757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954612 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.954757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954626 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.954903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954884 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.954955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954916 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.954955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954929 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.954955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.954953 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.956014 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.955999 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.956114 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.956165 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956118 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.956756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956741 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.956838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956765 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.956838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956775 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.956838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956746 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.956838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956833 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.956977 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.956847 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.957886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.957873 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.957935 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.957896 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:50.958545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.958531 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:50.958616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.958549 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:50.958616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.958560 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:50.964130 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:50.964114 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.964223 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.964141 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-148.ec2.internal\": node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:50.984898 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.984877 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:50.989217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.989202 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-148.ec2.internal\" not found" node="ip-10-0-132-148.ec2.internal" Jun 10 01:01:50.993665 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:50.993651 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-148.ec2.internal\" not found" node="ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.085391 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.085363 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.088663 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.088638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.088708 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.088672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.088708 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.088689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b726b16e3f101e7505136e45fb711c88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-148.ec2.internal\" (UID: \"b726b16e3f101e7505136e45fb711c88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.185821 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.185785 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.189087 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b726b16e3f101e7505136e45fb711c88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-148.ec2.internal\" (UID: \"b726b16e3f101e7505136e45fb711c88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.189133 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.189133 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.189192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.189192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce067feaa3096eb3909909a1f623c8f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal\" (UID: \"ce067feaa3096eb3909909a1f623c8f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.189254 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.189165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b726b16e3f101e7505136e45fb711c88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-148.ec2.internal\" (UID: \"b726b16e3f101e7505136e45fb711c88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.286587 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.286512 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.294925 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.294900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.299603 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.299586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:51.387602 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.387558 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.488024 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.487999 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.588578 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.588499 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.689203 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.689153 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.724479 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.724444 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 01:01:51.725113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.724610 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:51.789962 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.789930 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.803121 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.803084 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:56:50 +0000 UTC" deadline="2028-01-19 07:21:26.767207524 +0000 UTC" Jun 10 01:01:51.803121 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.803123 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14118h19m34.964091554s" Jun 10 01:01:51.886619 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:51.886586 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce067feaa3096eb3909909a1f623c8f6.slice/crio-717d35f3c02198b8c31baa14a917a43c22a0c43646cbaa22be84d0ca149c76ad WatchSource:0}: Error finding container 717d35f3c02198b8c31baa14a917a43c22a0c43646cbaa22be84d0ca149c76ad: Status 404 returned error can't find the container with id 717d35f3c02198b8c31baa14a917a43c22a0c43646cbaa22be84d0ca149c76ad Jun 10 01:01:51.886955 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:51.886937 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb726b16e3f101e7505136e45fb711c88.slice/crio-fcf040f716fea7714b2d40592b3163d9209e1ec471f3f4ced1b9f3b99478a0ea WatchSource:0}: Error finding container fcf040f716fea7714b2d40592b3163d9209e1ec471f3f4ced1b9f3b99478a0ea: Status 404 returned error can't find the container with id fcf040f716fea7714b2d40592b3163d9209e1ec471f3f4ced1b9f3b99478a0ea Jun 10 01:01:51.890066 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.890046 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:51.890725 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.890708 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:01:51.926347 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.926318 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:51.987549 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:51.987519 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:51.991085 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:51.991057 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:52.091628 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.091580 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:52.192180 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.192117 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:52.293001 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.292966 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-148.ec2.internal\" not found" Jun 10 01:01:52.336420 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.336381 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:52.387371 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.387337 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" Jun 10 01:01:52.401200 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.401172 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:52.402263 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.402245 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" Jun 10 01:01:52.408131 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.408098 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:52.766076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.766043 2573 apiserver.go:52] "Watching apiserver" Jun 10 01:01:52.774445 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.774418 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 01:01:52.775630 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.775599 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-xqpbs","openshift-ovn-kubernetes/ovnkube-node-rnplz","kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx","openshift-dns/node-resolver-wh67m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal","openshift-multus/multus-additional-cni-plugins-4xq24","openshift-multus/multus-wlwd7","openshift-network-diagnostics/network-check-target-84bxd","kube-system/global-pull-secret-syncer-jg52f","kube-system/konnectivity-agent-4h48k","openshift-cluster-node-tuning-operator/tuned-m6bzn","openshift-image-registry/node-ca-k4qrl","openshift-multus/network-metrics-daemon-d7lj7"] Jun 10 01:01:52.777218 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.777198 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.778413 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.778248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.778413 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.778332 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:01:52.779641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.779527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 01:01:52.779887 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.779866 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 01:01:52.779989 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.779970 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.780089 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.780069 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 01:01:52.780641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.780340 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.780641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.780354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.780641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.780439 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t5jmc\"" Jun 10 01:01:52.781400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.780989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.782660 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.783015 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.783314 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.783525 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-658fx\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.783795 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpcd7\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.783973 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.784149 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 01:01:52.784439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.784400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.784885 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.784401 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.785336 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.785316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.786286 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.786269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.786856 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.786552 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.786915 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.786879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:52.787545 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.786999 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:01:52.787545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787174 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 01:01:52.787545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787279 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:52.787545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787327 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bfh8\"" Jun 10 01:01:52.787545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787347 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.787833 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.787833 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ctk7h\"" Jun 10 01:01:52.788152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.787934 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 01:01:52.788521 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.788501 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cttd9\"" Jun 10 01:01:52.788602 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.788499 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 01:01:52.788696 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.788680 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.788995 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.788969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:01:52.789902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.789878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:52.793322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.792201 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgh54\"" Jun 10 01:01:52.793322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.792520 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 01:01:52.793322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.792821 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 01:01:52.793530 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.793497 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:52.797738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.795831 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.797738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.797077 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 01:01:52.797738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.797190 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.798696 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798612 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ss2ch\"" Jun 10 01:01:52.798846 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-system-cni-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.798916 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-run\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.798916 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95cec5d3-399b-480f-be47-6b4e9260e5d0-hosts-file\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.798916 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798908 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cec5d3-399b-480f-be47-6b4e9260e5d0-tmp-dir\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8zhc\" (UniqueName: \"kubernetes.io/projected/95cec5d3-399b-480f-be47-6b4e9260e5d0-kube-api-access-m8zhc\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-tmp\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-bin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-conf-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.799064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799050 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-modprobe-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-kubernetes\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-sys\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-system-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6rsn\" (UniqueName: \"kubernetes.io/projected/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-kube-api-access-h6rsn\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tb6x\" (UniqueName: \"kubernetes.io/projected/e43b83ba-cc18-4cf7-89bb-c654710ef37d-kube-api-access-9tb6x\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddc9\" (UniqueName: \"kubernetes.io/projected/39f19cd6-5c6b-4051-810a-3deac07037c5-kube-api-access-nddc9\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-os-release\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799233 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j7frh\"" Jun 10 01:01:52.799350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.798910 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-netns\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-hostroot\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-daemon-config\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-var-lib-kubelet\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-socket-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-device-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-sys-fs\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cnibin\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lklj\" (UniqueName: \"kubernetes.io/projected/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kube-api-access-6lklj\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.799788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799777 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39f19cd6-5c6b-4051-810a-3deac07037c5-iptables-alerter-script\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799854 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-kubelet\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cnibin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.799989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-systemd\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hng8\" (UniqueName: \"kubernetes.io/projected/d492c48d-0ac1-49c3-9127-caf36e96c576-kube-api-access-5hng8\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cni-binary-copy\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-dbus\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-multus\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.800360 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-multus-certs\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-etc-kubernetes\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysconfig\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-conf\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-lib-modules\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f19cd6-5c6b-4051-810a-3deac07037c5-host-slash\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-registration-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-socket-dir-parent\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800526 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-os-release\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnkd\" (UniqueName: \"kubernetes.io/projected/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-kube-api-access-rjnkd\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-host\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-tuned\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.801152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.800674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-kubelet-config\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.801805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801249 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 01:01:52.801805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801512 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 01:01:52.801805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 01:01:52.801805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801725 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 01:01:52.801805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 01:01:52.802043 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.801954 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:01:52.822672 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.822650 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmsfq" Jun 10 01:01:52.829793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.829775 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmsfq" Jun 10 01:01:52.857513 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.857449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" event={"ID":"ce067feaa3096eb3909909a1f623c8f6","Type":"ContainerStarted","Data":"717d35f3c02198b8c31baa14a917a43c22a0c43646cbaa22be84d0ca149c76ad"} Jun 10 01:01:52.858870 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.858843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" event={"ID":"b726b16e3f101e7505136e45fb711c88","Type":"ContainerStarted","Data":"fcf040f716fea7714b2d40592b3163d9209e1ec471f3f4ced1b9f3b99478a0ea"} Jun 10 01:01:52.888306 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.888277 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 01:01:52.900836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-systemd\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hng8\" (UniqueName: \"kubernetes.io/projected/d492c48d-0ac1-49c3-9127-caf36e96c576-kube-api-access-5hng8\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cni-binary-copy\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-dbus\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-slash\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.900997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.900979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-node-log\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-bin\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-kubelet\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-netd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-config\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-host\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901190 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-systemd\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-dbus\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.901222 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:52.901290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-multus\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.901347 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.901436 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:01:53.40140447 +0000 UTC m=+2.943234971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-multus\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-multus-certs\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.901526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:53.401504816 +0000 UTC m=+2.943335315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-etc-kubernetes\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-multus-certs\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysconfig\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-etc-kubernetes\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysconfig\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-conf\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-lib-modules\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f19cd6-5c6b-4051-810a-3deac07037c5-host-slash\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-lib-modules\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-conf\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-registration-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-registration-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-socket-dir-parent\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f19cd6-5c6b-4051-810a-3deac07037c5-host-slash\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.901984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cni-binary-copy\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwb7x\" (UniqueName: \"kubernetes.io/projected/a061b0fb-cf9e-4d98-a549-03b08ef65f42-kube-api-access-lwb7x\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-socket-dir-parent\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-os-release\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-os-release\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnkd\" (UniqueName: \"kubernetes.io/projected/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-kube-api-access-rjnkd\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-serviceca\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-host\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-tuned\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-kubelet-config\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.902756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-system-cni-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-run\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95cec5d3-399b-480f-be47-6b4e9260e5d0-hosts-file\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cec5d3-399b-480f-be47-6b4e9260e5d0-tmp-dir\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zhc\" (UniqueName: \"kubernetes.io/projected/95cec5d3-399b-480f-be47-6b4e9260e5d0-kube-api-access-m8zhc\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-tmp\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-bin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-conf-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-var-lib-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-etc-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-ovn\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-env-overrides\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-modprobe-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-kubernetes\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-sys\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.903575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.902952 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-cni-bin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-conf-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-system-cni-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903130 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-run\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95cec5d3-399b-480f-be47-6b4e9260e5d0-hosts-file\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f8a8a53-0662-4190-a27f-c47458abb82b-kubelet-config\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cec5d3-399b-480f-be47-6b4e9260e5d0-tmp-dir\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-system-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07a16d89-3dde-4590-94ce-81a43debd4fb-agent-certs\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6rsn\" (UniqueName: \"kubernetes.io/projected/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-kube-api-access-h6rsn\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-modprobe-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tb6x\" (UniqueName: \"kubernetes.io/projected/e43b83ba-cc18-4cf7-89bb-c654710ef37d-kube-api-access-9tb6x\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nddc9\" (UniqueName: \"kubernetes.io/projected/39f19cd6-5c6b-4051-810a-3deac07037c5-kube-api-access-nddc9\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903707 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-system-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-os-release\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.904234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-sys\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-netns\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-hostroot\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-daemon-config\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-netns\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-var-lib-kubelet\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-socket-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-device-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-sys-fs\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-systemd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cnibin\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lklj\" (UniqueName: \"kubernetes.io/projected/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kube-api-access-6lklj\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-os-release\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-var-lib-kubelet\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-kubernetes\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.906520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904566 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-log-socket\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39f19cd6-5c6b-4051-810a-3deac07037c5-iptables-alerter-script\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-systemd-units\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-socket-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-device-dir\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07a16d89-3dde-4590-94ce-81a43debd4fb-konnectivity-ca\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72g7z\" (UniqueName: \"kubernetes.io/projected/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-kube-api-access-72g7z\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-kubelet\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-hostroot\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cnibin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-sys-fs\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.907280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovn-node-metrics-cert\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-netns\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.904988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-script-lib\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-cnibin\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39f19cd6-5c6b-4051-810a-3deac07037c5-iptables-alerter-script\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-daemon-config\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-sysctl-d\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-multus-cni-dir\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-cnibin\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-host-var-lib-kubelet\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.905929 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.903151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43b83ba-cc18-4cf7-89bb-c654710ef37d-host\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.906876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-etc-tuned\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.908003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.907311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43b83ba-cc18-4cf7-89bb-c654710ef37d-tmp\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.908814 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.908029 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:52.908814 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.908049 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:52.908814 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.908061 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:52.908814 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:52.908113 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:01:53.408096942 +0000 UTC m=+2.949927424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:52.914404 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.912726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6rsn\" (UniqueName: \"kubernetes.io/projected/e28bb9c1-0e07-412b-bd7b-8d6852edfdee-kube-api-access-h6rsn\") pod \"multus-additional-cni-plugins-4xq24\" (UID: \"e28bb9c1-0e07-412b-bd7b-8d6852edfdee\") " pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:52.914953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.914918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hng8\" (UniqueName: \"kubernetes.io/projected/d492c48d-0ac1-49c3-9127-caf36e96c576-kube-api-access-5hng8\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:52.917829 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.917776 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnkd\" (UniqueName: \"kubernetes.io/projected/ff94ac60-f30f-43d0-b7b0-12612a07d1c1-kube-api-access-rjnkd\") pod \"multus-wlwd7\" (UID: \"ff94ac60-f30f-43d0-b7b0-12612a07d1c1\") " pod="openshift-multus/multus-wlwd7" Jun 10 01:01:52.919049 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.918985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zhc\" (UniqueName: \"kubernetes.io/projected/95cec5d3-399b-480f-be47-6b4e9260e5d0-kube-api-access-m8zhc\") pod \"node-resolver-wh67m\" (UID: \"95cec5d3-399b-480f-be47-6b4e9260e5d0\") " pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:52.919049 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.917748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddc9\" (UniqueName: \"kubernetes.io/projected/39f19cd6-5c6b-4051-810a-3deac07037c5-kube-api-access-nddc9\") pod \"iptables-alerter-xqpbs\" (UID: \"39f19cd6-5c6b-4051-810a-3deac07037c5\") " pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:52.919821 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.919794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tb6x\" (UniqueName: \"kubernetes.io/projected/e43b83ba-cc18-4cf7-89bb-c654710ef37d-kube-api-access-9tb6x\") pod \"tuned-m6bzn\" (UID: \"e43b83ba-cc18-4cf7-89bb-c654710ef37d\") " pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:52.919906 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:52.919873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lklj\" (UniqueName: \"kubernetes.io/projected/9f9f0f27-e1df-484e-ac51-d93c8ceb3618-kube-api-access-6lklj\") pod \"aws-ebs-csi-driver-node-2kdqx\" (UID: \"9f9f0f27-e1df-484e-ac51-d93c8ceb3618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:53.006045 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07a16d89-3dde-4590-94ce-81a43debd4fb-konnectivity-ca\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:53.006223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72g7z\" (UniqueName: \"kubernetes.io/projected/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-kube-api-access-72g7z\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.006223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006182 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovn-node-metrics-cert\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-script-lib\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-slash\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-node-log\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-bin\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-bin\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-slash\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-node-log\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-kubelet\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-netd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-config\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-host\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwb7x\" (UniqueName: \"kubernetes.io/projected/a061b0fb-cf9e-4d98-a549-03b08ef65f42-kube-api-access-lwb7x\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006696 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07a16d89-3dde-4590-94ce-81a43debd4fb-konnectivity-ca\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-serviceca\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-cni-netd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-kubelet\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-host\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-var-lib-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-var-lib-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.006893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.006862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-etc-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-ovn\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-env-overrides\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07a16d89-3dde-4590-94ce-81a43debd4fb-agent-certs\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007104 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-etc-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007132 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-config\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007178 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-netns\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-ovn\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-systemd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-systemd\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-host-run-netns\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-serviceca\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-log-socket\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-systemd-units\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-log-socket\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-systemd-units\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a061b0fb-cf9e-4d98-a549-03b08ef65f42-run-openvswitch\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.007788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovnkube-script-lib\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.008109 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.007830 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a061b0fb-cf9e-4d98-a549-03b08ef65f42-env-overrides\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.008937 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.008912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a061b0fb-cf9e-4d98-a549-03b08ef65f42-ovn-node-metrics-cert\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.009904 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.009884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07a16d89-3dde-4590-94ce-81a43debd4fb-agent-certs\") pod \"konnectivity-agent-4h48k\" (UID: \"07a16d89-3dde-4590-94ce-81a43debd4fb\") " pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:53.013897 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.013876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72g7z\" (UniqueName: \"kubernetes.io/projected/1bd7b302-ffc2-4798-8454-5f8287ef2bb1-kube-api-access-72g7z\") pod \"node-ca-k4qrl\" (UID: \"1bd7b302-ffc2-4798-8454-5f8287ef2bb1\") " pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.014280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.014264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwb7x\" (UniqueName: \"kubernetes.io/projected/a061b0fb-cf9e-4d98-a549-03b08ef65f42-kube-api-access-lwb7x\") pod \"ovnkube-node-rnplz\" (UID: \"a061b0fb-cf9e-4d98-a549-03b08ef65f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.090368 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.090277 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xq24" Jun 10 01:01:53.101350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.101326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" Jun 10 01:01:53.109379 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.109353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" Jun 10 01:01:53.115900 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.115878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wh67m" Jun 10 01:01:53.124543 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.124522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqpbs" Jun 10 01:01:53.131372 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.131355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlwd7" Jun 10 01:01:53.139110 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.139093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:01:53.146679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.146660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4qrl" Jun 10 01:01:53.153219 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.153203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:01:53.410173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.410136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:53.410173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.410180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.410209 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410304 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410320 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410341 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410354 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410304 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410385 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.410362809 +0000 UTC m=+3.952193291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410406 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.410397163 +0000 UTC m=+3.952227644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:53.410437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.410427 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.410417049 +0000 UTC m=+3.952247531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:53.765721 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.765691 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9f0f27_e1df_484e_ac51_d93c8ceb3618.slice/crio-cb62e0c726ba7efcdb532b07482f785f22170d3ffcdb5a198811946b57d30aa1 WatchSource:0}: Error finding container cb62e0c726ba7efcdb532b07482f785f22170d3ffcdb5a198811946b57d30aa1: Status 404 returned error can't find the container with id cb62e0c726ba7efcdb532b07482f785f22170d3ffcdb5a198811946b57d30aa1 Jun 10 01:01:53.766816 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.766792 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f19cd6_5c6b_4051_810a_3deac07037c5.slice/crio-02564e3effe71073faa007e8ab1e7542968deca8cc83fbf74f08ccf0adf62acd WatchSource:0}: Error finding container 02564e3effe71073faa007e8ab1e7542968deca8cc83fbf74f08ccf0adf62acd: Status 404 returned error can't find the container with id 02564e3effe71073faa007e8ab1e7542968deca8cc83fbf74f08ccf0adf62acd Jun 10 01:01:53.789607 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.789352 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28bb9c1_0e07_412b_bd7b_8d6852edfdee.slice/crio-397516f94b9c015b0f8f7a298e14d424a300f745fafa620ccf13ba60a5fee06f WatchSource:0}: Error finding container 397516f94b9c015b0f8f7a298e14d424a300f745fafa620ccf13ba60a5fee06f: Status 404 returned error can't find the container with id 397516f94b9c015b0f8f7a298e14d424a300f745fafa620ccf13ba60a5fee06f Jun 10 01:01:53.793309 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.793285 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd7b302_ffc2_4798_8454_5f8287ef2bb1.slice/crio-6ed67d871307303e0909683e0b07a3dc6deb9cc72850f5b7d2b5bc9d7f48713e WatchSource:0}: Error finding container 6ed67d871307303e0909683e0b07a3dc6deb9cc72850f5b7d2b5bc9d7f48713e: Status 404 returned error can't find the container with id 6ed67d871307303e0909683e0b07a3dc6deb9cc72850f5b7d2b5bc9d7f48713e Jun 10 01:01:53.794736 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.794705 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a16d89_3dde_4590_94ce_81a43debd4fb.slice/crio-63f002d65b73157d14c06624458ffd7c578fe2334ffd7e37efd7d9278bdf8b91 WatchSource:0}: Error finding container 63f002d65b73157d14c06624458ffd7c578fe2334ffd7e37efd7d9278bdf8b91: Status 404 returned error can't find the container with id 63f002d65b73157d14c06624458ffd7c578fe2334ffd7e37efd7d9278bdf8b91 Jun 10 01:01:53.796247 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.796219 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda061b0fb_cf9e_4d98_a549_03b08ef65f42.slice/crio-5a19cf44de2e5063b57242a7cebc2b23cc7d3b44553aa491ba7b26a96f1fbed9 WatchSource:0}: Error finding container 5a19cf44de2e5063b57242a7cebc2b23cc7d3b44553aa491ba7b26a96f1fbed9: Status 404 returned error can't find the container with id 5a19cf44de2e5063b57242a7cebc2b23cc7d3b44553aa491ba7b26a96f1fbed9 Jun 10 01:01:53.798016 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.797989 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff94ac60_f30f_43d0_b7b0_12612a07d1c1.slice/crio-3502f0580a4533a09374c9c73347d696dac1411c8a7f224fa51cb10d155e9ce5 WatchSource:0}: Error finding container 3502f0580a4533a09374c9c73347d696dac1411c8a7f224fa51cb10d155e9ce5: Status 404 returned error can't find the container with id 3502f0580a4533a09374c9c73347d696dac1411c8a7f224fa51cb10d155e9ce5 Jun 10 01:01:53.799957 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:01:53.799889 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cec5d3_399b_480f_be47_6b4e9260e5d0.slice/crio-f73dd385ecf832a5537c098a4eb85d6f0ace1b4e13b5fd56f23920df9d384d07 WatchSource:0}: Error finding container f73dd385ecf832a5537c098a4eb85d6f0ace1b4e13b5fd56f23920df9d384d07: Status 404 returned error can't find the container with id f73dd385ecf832a5537c098a4eb85d6f0ace1b4e13b5fd56f23920df9d384d07 Jun 10 01:01:53.832111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.831917 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:52 +0000 UTC" deadline="2027-12-03 20:36:11.697202692 +0000 UTC" Jun 10 01:01:53.832203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.832116 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13003h34m17.865093923s" Jun 10 01:01:53.852718 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.852694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:53.852841 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:53.852795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:01:53.863656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.863625 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"5a19cf44de2e5063b57242a7cebc2b23cc7d3b44553aa491ba7b26a96f1fbed9"} Jun 10 01:01:53.864762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.864736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4h48k" event={"ID":"07a16d89-3dde-4590-94ce-81a43debd4fb","Type":"ContainerStarted","Data":"63f002d65b73157d14c06624458ffd7c578fe2334ffd7e37efd7d9278bdf8b91"} Jun 10 01:01:53.865929 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.865905 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4qrl" event={"ID":"1bd7b302-ffc2-4798-8454-5f8287ef2bb1","Type":"ContainerStarted","Data":"6ed67d871307303e0909683e0b07a3dc6deb9cc72850f5b7d2b5bc9d7f48713e"} Jun 10 01:01:53.866939 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.866912 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerStarted","Data":"397516f94b9c015b0f8f7a298e14d424a300f745fafa620ccf13ba60a5fee06f"} Jun 10 01:01:53.867850 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.867832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wh67m" event={"ID":"95cec5d3-399b-480f-be47-6b4e9260e5d0","Type":"ContainerStarted","Data":"f73dd385ecf832a5537c098a4eb85d6f0ace1b4e13b5fd56f23920df9d384d07"} Jun 10 01:01:53.868780 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.868754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlwd7" event={"ID":"ff94ac60-f30f-43d0-b7b0-12612a07d1c1","Type":"ContainerStarted","Data":"3502f0580a4533a09374c9c73347d696dac1411c8a7f224fa51cb10d155e9ce5"} Jun 10 01:01:53.869782 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.869762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqpbs" event={"ID":"39f19cd6-5c6b-4051-810a-3deac07037c5","Type":"ContainerStarted","Data":"02564e3effe71073faa007e8ab1e7542968deca8cc83fbf74f08ccf0adf62acd"} Jun 10 01:01:53.873757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.873736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" event={"ID":"9f9f0f27-e1df-484e-ac51-d93c8ceb3618","Type":"ContainerStarted","Data":"cb62e0c726ba7efcdb532b07482f785f22170d3ffcdb5a198811946b57d30aa1"} Jun 10 01:01:53.874773 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:53.874753 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" event={"ID":"e43b83ba-cc18-4cf7-89bb-c654710ef37d","Type":"ContainerStarted","Data":"9799500f037438ce48035fbe189f87cd4fefd00ffba27578eeca0d16316fa1b8"} Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.415094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.415145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.415186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415355 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415377 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415390 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415452 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:01:56.415433299 +0000 UTC m=+5.957263784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415945 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.415999 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:56.415982943 +0000 UTC m=+5.957813426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.416055 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:54.416121 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.416086 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:01:56.416075623 +0000 UTC m=+5.957906109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:54.832863 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.832690 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:52 +0000 UTC" deadline="2028-03-23 13:42:09.134406272 +0000 UTC" Jun 10 01:01:54.832863 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.832756 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15660h40m14.301654609s" Jun 10 01:01:54.856094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.855368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:54.856094 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.855520 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:01:54.856094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.855908 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:54.856094 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:54.856004 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:01:54.893522 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.893484 2573 generic.go:356] "Generic (PLEG): container finished" podID="ce067feaa3096eb3909909a1f623c8f6" containerID="f93964e39d54090f139fce1a63cb19d85880581906d9f5af92324ec10aabf5d1" exitCode=0 Jun 10 01:01:54.893709 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.893605 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" event={"ID":"ce067feaa3096eb3909909a1f623c8f6","Type":"ContainerDied","Data":"f93964e39d54090f139fce1a63cb19d85880581906d9f5af92324ec10aabf5d1"} Jun 10 01:01:54.900846 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.900811 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" event={"ID":"b726b16e3f101e7505136e45fb711c88","Type":"ContainerStarted","Data":"56c9d8791950a82434b60d4c2d2c68d3b2b7f8bf3cac05f82343bb443e6c1e7e"} Jun 10 01:01:54.921100 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:54.920460 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-148.ec2.internal" podStartSLOduration=2.920441475 podStartE2EDuration="2.920441475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:54.91983049 +0000 UTC m=+4.461660992" watchObservedRunningTime="2026-06-10 01:01:54.920441475 +0000 UTC m=+4.462271976" Jun 10 01:01:55.853611 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:55.853577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:55.854060 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:55.853729 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:01:55.924882 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:55.924837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" event={"ID":"ce067feaa3096eb3909909a1f623c8f6","Type":"ContainerStarted","Data":"4fac96e191a5f950681cd5cfe95f075eb4799548f13b452860a209cd3dde40fc"} Jun 10 01:01:56.433700 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:56.433661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:56.433891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:56.433764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:56.433891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:56.433796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:56.434005 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.433925 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:56.434005 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.433987 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:02:00.43396947 +0000 UTC m=+9.975799951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:56.434458 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434432 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:56.434559 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434492 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:56.434559 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434508 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:56.434669 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434594 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:02:00.43455652 +0000 UTC m=+9.976387016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:56.434669 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434667 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:56.434776 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.434707 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:00.434689388 +0000 UTC m=+9.976519868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:56.855518 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:56.855039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:56.855518 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.855164 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:01:56.855518 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:56.855254 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:56.855518 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:56.855352 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:01:57.853167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:57.853132 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:57.853339 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:57.853285 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:01:58.852970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:58.852934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:01:58.853449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:58.852987 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:01:58.853449 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:58.853079 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:01:58.853449 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:58.853217 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:01:59.853152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:01:59.853118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:01:59.853646 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:01:59.853267 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:00.468734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:00.468789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:00.468844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.468874 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.468946 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:00.469019 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.468952 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.468932333 +0000 UTC m=+18.010762815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:00.469583 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.468993 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:00.469583 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.469088 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:00.469583 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.469103 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:00.469583 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.469054 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.469010107 +0000 UTC m=+18.010840600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:00.469583 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.469163 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.46914634 +0000 UTC m=+18.010976830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:00.852640 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:00.852608 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:00.852796 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.852722 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:00.852945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:00.852796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:00.853740 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:00.853707 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:01.853340 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:01.853309 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:01.853542 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:01.853451 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:02.852924 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:02.852889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:02.853497 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:02.853031 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:02.853497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:02.853075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:02.853497 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:02.853183 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:03.853660 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:03.853620 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:03.854120 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:03.853769 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:04.852772 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:04.852729 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:04.852921 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:04.852857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:04.852982 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:04.852916 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:04.853048 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:04.853030 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:05.853280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:05.853243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:05.853726 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:05.853374 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:06.853562 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:06.853524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:06.854021 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:06.853539 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:06.854021 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:06.853667 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:06.854021 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:06.853735 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:07.852888 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:07.852854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:07.853071 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:07.852993 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:08.531722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:08.531688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:08.531722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:08.531725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:08.531756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531875 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531899 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531881 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531949 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:02:24.531927493 +0000 UTC m=+34.073757987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531953 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531963 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531968 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:24.531957726 +0000 UTC m=+34.073788221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:08.532183 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.531998 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:02:24.531981617 +0000 UTC m=+34.073812102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:08.852650 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:08.852608 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:08.852814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:08.852608 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:08.852814 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.852754 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:08.852925 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:08.852811 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:09.853329 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:09.853294 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:09.853820 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:09.853432 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:10.854354 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:10.854317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:10.854774 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:10.854439 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:10.854774 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:10.854496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:10.854774 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:10.854599 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:11.853529 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:11.853496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:11.853718 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:11.853630 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:12.853733 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.853547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:12.854484 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.853609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:12.854484 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:12.853833 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:12.854484 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:12.853887 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:12.960330 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.960299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wh67m" event={"ID":"95cec5d3-399b-480f-be47-6b4e9260e5d0","Type":"ContainerStarted","Data":"15b9fa3a6f704109068bda43fd0d66a41ad658e23c284e841bb7612ea66bdaa1"} Jun 10 01:02:12.963093 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.963052 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlwd7" event={"ID":"ff94ac60-f30f-43d0-b7b0-12612a07d1c1","Type":"ContainerStarted","Data":"5d7da97be95062e67d38c344f7bef939d0d9ade3005dd1782b58cd1580385c16"} Jun 10 01:02:12.965368 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.965289 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" event={"ID":"9f9f0f27-e1df-484e-ac51-d93c8ceb3618","Type":"ContainerStarted","Data":"6e353dd5f1c48c9cc73bdfd00c88cbdb5bef677eec5cc9e56d613dcbc7514f85"} Jun 10 01:02:12.967040 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.967010 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" event={"ID":"e43b83ba-cc18-4cf7-89bb-c654710ef37d","Type":"ContainerStarted","Data":"a29c7167bade085d3b19607478dc2fc74bc604a238fd2a0cb089019035320689"} Jun 10 01:02:12.969285 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.969266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:02:12.969739 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.969708 2573 generic.go:356] "Generic (PLEG): container finished" podID="a061b0fb-cf9e-4d98-a549-03b08ef65f42" containerID="f396ea7457b0abf81656cdf495e575ccf33974680f3fcdfdb884cc92a4c13c0a" exitCode=1 Jun 10 01:02:12.969862 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.969793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerDied","Data":"f396ea7457b0abf81656cdf495e575ccf33974680f3fcdfdb884cc92a4c13c0a"} Jun 10 01:02:12.969932 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.969870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"e96ed4c763018346df99c440cf45ac74a0bacf9bda024f4615d80a28341f049b"} Jun 10 01:02:12.971750 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.971603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4h48k" event={"ID":"07a16d89-3dde-4590-94ce-81a43debd4fb","Type":"ContainerStarted","Data":"d59f7dbf8529526168e1ad421a2dac0eff27b99a5b17b3af277f50123ffe1180"} Jun 10 01:02:12.975818 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.975764 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wh67m" podStartSLOduration=3.28055342 podStartE2EDuration="21.975747178s" totalImagesPullingTime="18.695193758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:12.975447767 +0000 UTC m=+22.517278273" watchObservedRunningTime="2026-06-10 01:02:12.975747178 +0000 UTC m=+22.517577682" Jun 10 01:02:12.975891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.975832 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-148.ec2.internal" podStartSLOduration=20.975826804 podStartE2EDuration="20.975826804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:55.939928125 +0000 UTC m=+5.481758639" watchObservedRunningTime="2026-06-10 01:02:12.975826804 +0000 UTC m=+22.517657304" Jun 10 01:02:12.976131 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.976109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4qrl" event={"ID":"1bd7b302-ffc2-4798-8454-5f8287ef2bb1","Type":"ContainerStarted","Data":"3478248f8e649c0824e23badda0fb6f669deb100d9c4915f9e8aba1fb2076ae1"} Jun 10 01:02:12.978497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.978459 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerStarted","Data":"c300b7e250678e7389e1e673f02d325f470dfa262d766bab4fa1660cbe14a3d9"} Jun 10 01:02:12.990457 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:12.990422 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m6bzn" podStartSLOduration=4.294073639 podStartE2EDuration="22.990406118s" totalImagesPullingTime="18.696332479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:12.990149076 +0000 UTC m=+22.531979578" watchObservedRunningTime="2026-06-10 01:02:12.990406118 +0000 UTC m=+22.532236619" Jun 10 01:02:13.005819 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.005782 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wlwd7" podStartSLOduration=3.263763481 podStartE2EDuration="22.005768478s" totalImagesPullingTime="18.742004997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.005321656 +0000 UTC m=+22.547152157" watchObservedRunningTime="2026-06-10 01:02:13.005768478 +0000 UTC m=+22.547598978" Jun 10 01:02:13.022573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.022531 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4h48k" podStartSLOduration=11.753777675 podStartE2EDuration="22.022512223s" totalImagesPullingTime="10.268734548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.022177846 +0000 UTC m=+22.564008348" watchObservedRunningTime="2026-06-10 01:02:13.022512223 +0000 UTC m=+22.564342723" Jun 10 01:02:13.053835 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.053790 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k4qrl" podStartSLOduration=3.349980464 podStartE2EDuration="22.05377494s" totalImagesPullingTime="18.703794476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.053313886 +0000 UTC m=+22.595144384" watchObservedRunningTime="2026-06-10 01:02:13.05377494 +0000 UTC m=+22.595605440" Jun 10 01:02:13.852864 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.852676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:13.853079 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:13.852967 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:13.982938 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.982911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:02:13.983443 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.983243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"764a1f5a9791659bc9ac9d8934c7b9c8380dc635e45a36621e81db83d407a101"} Jun 10 01:02:13.983443 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.983309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"fd4dc1f733ecd7fa62376aaddf61022eefe62172796695c0e0ce1817ff4f1169"} Jun 10 01:02:13.983443 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.983351 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"6e2c94cc1b160c3683c422e5a4eb764a4165fa4e9a3e08946a8630bd35c76a24"} Jun 10 01:02:13.983443 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.983382 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"d636035c6c4a28e7c6cdd7b185f6f6f537f13e2e3c662bce821964784e0e1287"} Jun 10 01:02:13.984567 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.984545 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="c300b7e250678e7389e1e673f02d325f470dfa262d766bab4fa1660cbe14a3d9" exitCode=0 Jun 10 01:02:13.984679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.984609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"c300b7e250678e7389e1e673f02d325f470dfa262d766bab4fa1660cbe14a3d9"} Jun 10 01:02:13.985816 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:13.985783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqpbs" event={"ID":"39f19cd6-5c6b-4051-810a-3deac07037c5","Type":"ContainerStarted","Data":"73d3945cc3662bc56e5909c45fe18a398f5028f92e28cc0bbb0e7b12578fe65c"} Jun 10 01:02:14.000404 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.000359 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xqpbs" podStartSLOduration=4.2886725 podStartE2EDuration="23.000346078s" totalImagesPullingTime="18.711673578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:14.00021994 +0000 UTC m=+23.542050474" watchObservedRunningTime="2026-06-10 01:02:14.000346078 +0000 UTC m=+23.542176579" Jun 10 01:02:14.253359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.253334 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 01:02:14.853017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.852980 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:14.853218 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.853028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:14.853218 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:14.853126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:14.853331 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:14.853211 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:14.866573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.866447 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T01:02:14.253351695Z","UUID":"aa7dd30a-e1c2-45e1-ab56-db4dab776f6d","Handler":null,"Name":"","Endpoint":""} Jun 10 01:02:14.868153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.868125 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 01:02:14.868305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.868172 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 01:02:14.989836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:14.989800 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" event={"ID":"9f9f0f27-e1df-484e-ac51-d93c8ceb3618","Type":"ContainerStarted","Data":"0136783d0c1d70c179ff851bed5e952a5a08fd34d03c7c01a443976495a3e5c2"} Jun 10 01:02:15.386156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.386120 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:02:15.622319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.622149 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:02:15.622792 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.622771 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:02:15.853029 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.852991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:15.853200 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:15.853098 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:15.993787 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.993704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" event={"ID":"9f9f0f27-e1df-484e-ac51-d93c8ceb3618","Type":"ContainerStarted","Data":"4c3fc53482ccf6cd832b63d5e6cf889c094bcacc516c083bebb9d4b68dab1e17"} Jun 10 01:02:15.996704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.996686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:02:15.997072 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.997050 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"da027b2bd72643138f5a9a6ff18d075fd0de0183cfea4275f4aa84a9c2111e95"} Jun 10 01:02:15.997680 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:15.997663 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4h48k" Jun 10 01:02:16.009308 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:16.009260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kdqx" podStartSLOduration=3.885647403 podStartE2EDuration="25.009248087s" totalImagesPullingTime="21.123600684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:16.009224027 +0000 UTC m=+25.551054527" watchObservedRunningTime="2026-06-10 01:02:16.009248087 +0000 UTC m=+25.551078587" Jun 10 01:02:16.853508 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:16.853461 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:16.853792 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:16.853613 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:16.853792 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:16.853660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:16.853792 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:16.853746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:17.853505 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:17.853458 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:17.854260 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:17.853606 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:18.005911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.005703 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:02:18.006731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.006699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"f7c96fd85bfa9fa1747f762db422dbe0d66b4801af4fcec95346d18b3a4259be"} Jun 10 01:02:18.006876 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.006762 2573 scope.go:117] "RemoveContainer" containerID="f396ea7457b0abf81656cdf495e575ccf33974680f3fcdfdb884cc92a4c13c0a" Jun 10 01:02:18.006876 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.006788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:18.006876 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.006839 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:18.007001 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.006884 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:18.024061 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.024028 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:18.024369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.024354 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:18.852812 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.852768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:18.853003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:18.852910 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:18.853062 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:18.853031 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:18.853062 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:18.852904 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:19.583128 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.583101 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jg52f"] Jun 10 01:02:19.583446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.583196 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:19.583446 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:19.583285 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:19.586226 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.586198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84bxd"] Jun 10 01:02:19.586384 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.586286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:19.586443 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:19.586380 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:19.586836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.586815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7lj7"] Jun 10 01:02:19.586935 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:19.586919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:19.587028 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:19.587004 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:20.015304 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.015279 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:02:20.015737 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.015714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" event={"ID":"a061b0fb-cf9e-4d98-a549-03b08ef65f42","Type":"ContainerStarted","Data":"a002d7f9f0455a1e08cad345d70494d76103092c4428b6cdfd48f284b22d9ea9"} Jun 10 01:02:20.017589 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.017567 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="dc2a952ee8578db6bb70abfb7a99fc5d86245594fbed5dc472b0d71c83939693" exitCode=0 Jun 10 01:02:20.017685 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.017602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"dc2a952ee8578db6bb70abfb7a99fc5d86245594fbed5dc472b0d71c83939693"} Jun 10 01:02:20.040411 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.040355 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" podStartSLOduration=10.31303397 podStartE2EDuration="29.040338044s" totalImagesPullingTime="18.727304074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:20.039028969 +0000 UTC m=+29.580859481" watchObservedRunningTime="2026-06-10 01:02:20.040338044 +0000 UTC m=+29.582168544" Jun 10 01:02:20.856448 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.854692 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:20.856448 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:20.854841 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:20.856448 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:20.855323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:20.856448 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:20.855486 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:21.853662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:21.853439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:21.853808 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:21.853743 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:22.023741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:22.023662 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="7ba2cd3dd008cbf62c212422c14c4d8397d7ab43c9bb7441efc1bf72aed0ea7a" exitCode=0 Jun 10 01:02:22.023741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:22.023709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"7ba2cd3dd008cbf62c212422c14c4d8397d7ab43c9bb7441efc1bf72aed0ea7a"} Jun 10 01:02:22.853452 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:22.853413 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:22.853626 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:22.853426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:22.853626 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:22.853551 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:22.853753 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:22.853656 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:23.852753 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:23.852725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:23.853287 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:23.852831 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg52f" podUID="6f8a8a53-0662-4190-a27f-c47458abb82b" Jun 10 01:02:24.554430 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:24.554387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:24.554486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:24.554510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554557 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554579 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554588 2573 projected.go:196] Error preparing data for projected volume kube-api-access-4fgb5 for pod openshift-network-diagnostics/network-check-target-84bxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554608 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554634 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5 podName:4563696a-9f71-4373-a8b3-013cc3acc2bd nodeName:}" failed. No retries permitted until 2026-06-10 01:02:56.554620781 +0000 UTC m=+66.096451260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fgb5" (UniqueName: "kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5") pod "network-check-target-84bxd" (UID: "4563696a-9f71-4373-a8b3-013cc3acc2bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554659 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret podName:6f8a8a53-0662-4190-a27f-c47458abb82b nodeName:}" failed. No retries permitted until 2026-06-10 01:02:56.554643885 +0000 UTC m=+66.096474367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret") pod "global-pull-secret-syncer-jg52f" (UID: "6f8a8a53-0662-4190-a27f-c47458abb82b") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554608 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:24.554741 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.554694 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:56.554683999 +0000 UTC m=+66.096514478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:24.853140 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:24.853114 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:24.853140 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:24.853113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:24.853670 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.853232 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84bxd" podUID="4563696a-9f71-4373-a8b3-013cc3acc2bd" Jun 10 01:02:24.853670 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:24.853339 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:02:25.245300 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.245275 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-148.ec2.internal" event="NodeReady" Jun 10 01:02:25.245411 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.245406 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 01:02:25.280153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.280124 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:02:25.281840 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.281825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.289560 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.289539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 01:02:25.289803 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.289766 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 01:02:25.289917 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.289903 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 01:02:25.289986 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.289915 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvz7s\"" Jun 10 01:02:25.314957 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.314922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:02:25.318324 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.318296 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 01:02:25.319190 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.319170 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j2mbz"] Jun 10 01:02:25.321110 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.321095 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jzcvj"] Jun 10 01:02:25.321234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.321216 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.322641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.322625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2mbz"] Jun 10 01:02:25.322715 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.322653 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jzcvj"] Jun 10 01:02:25.322715 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.322713 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.331232 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331208 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 01:02:25.331350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331332 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 01:02:25.331350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331340 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:02:25.331730 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 01:02:25.331893 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 01:02:25.331973 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.331906 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9gnps\"" Jun 10 01:02:25.332054 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.332042 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 01:02:25.420576 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.420548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:25.459188 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459188 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6q7\" (UniqueName: \"kubernetes.io/projected/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-kube-api-access-pz6q7\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctzz\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77209cfa-414b-45ed-bbd8-0834b02c503f-config-volume\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77209cfa-414b-45ed-bbd8-0834b02c503f-tmp-dir\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.459350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hqz\" (UniqueName: \"kubernetes.io/projected/77209cfa-414b-45ed-bbd8-0834b02c503f-kube-api-access-f4hqz\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-cert\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.459568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.459440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.504411 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.504376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:25.560437 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6q7\" (UniqueName: \"kubernetes.io/projected/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-kube-api-access-pz6q7\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.560437 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560441 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctzz\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.560679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77209cfa-414b-45ed-bbd8-0834b02c503f-config-volume\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.560679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77209cfa-414b-45ed-bbd8-0834b02c503f-tmp-dir\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.560679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.560679 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.560860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hqz\" (UniqueName: \"kubernetes.io/projected/77209cfa-414b-45ed-bbd8-0834b02c503f-kube-api-access-f4hqz\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.560860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.560860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-cert\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.560860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.560860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.561044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.561044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.561044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.560941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:25.561208 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:25.561230 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:25.561286 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:25.561298 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:26.061281684 +0000 UTC m=+35.603112174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:25.561345 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:26.061329593 +0000 UTC m=+35.603160082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.561362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.561450 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.561423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77209cfa-414b-45ed-bbd8-0834b02c503f-config-volume\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.561843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.561642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.561843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.561676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77209cfa-414b-45ed-bbd8-0834b02c503f-tmp-dir\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.561843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.561710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.564759 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.564739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.564867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.564795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.564867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.564803 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-cert\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.576286 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.576261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.576391 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.576372 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6q7\" (UniqueName: \"kubernetes.io/projected/e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7-kube-api-access-pz6q7\") pod \"ingress-canary-jzcvj\" (UID: \"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7\") " pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.576513 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.576496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hqz\" (UniqueName: \"kubernetes.io/projected/77209cfa-414b-45ed-bbd8-0834b02c503f-kube-api-access-f4hqz\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:25.576574 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.576559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctzz\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:25.638279 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.638246 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jzcvj" Jun 10 01:02:25.792418 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.792254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jzcvj"] Jun 10 01:02:25.794659 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:02:25.794631 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ccc734_1aa2_4448_9ff8_f96c45c6e6f7.slice/crio-2ad301f26b1ae45e79c24740940751a35249d8a1012dcb0b3e3834b21761896a WatchSource:0}: Error finding container 2ad301f26b1ae45e79c24740940751a35249d8a1012dcb0b3e3834b21761896a: Status 404 returned error can't find the container with id 2ad301f26b1ae45e79c24740940751a35249d8a1012dcb0b3e3834b21761896a Jun 10 01:02:25.853553 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.853514 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:25.860804 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:25.860782 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:26.033229 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.033126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jzcvj" event={"ID":"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7","Type":"ContainerStarted","Data":"2ad301f26b1ae45e79c24740940751a35249d8a1012dcb0b3e3834b21761896a"} Jun 10 01:02:26.064560 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.064527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:26.064702 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.064579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:26.064702 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:26.064670 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:26.064702 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:26.064670 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:26.064702 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:26.064681 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:26.064825 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:26.064728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:27.064715913 +0000 UTC m=+36.606546393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:26.064825 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:26.064742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:27.064735387 +0000 UTC m=+36.606565866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:26.308167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.308054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:26.408895 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.408853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:26.852600 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.852568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:26.852782 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.852568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:26.855058 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.855034 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:02:26.855400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.855083 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:26.855400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.855036 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:26.855400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.855036 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:26.855993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:26.855975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:02:27.072886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:27.072847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:27.072968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:27.073004 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:27.073025 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:27.073089 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:29.073069859 +0000 UTC m=+38.614900360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:27.073102 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:27.073139 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:27.073145 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:29.073131252 +0000 UTC m=+38.614961730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:27.995600 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:27.995566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:28.095427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:28.095385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:28.195607 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:28.195566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:28.244831 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:28.244774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:28.995638 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:28.995608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:29.044616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.044582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jzcvj" event={"ID":"e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7","Type":"ContainerStarted","Data":"63205e71572d7ea95f6ba435dc7d14cf66d2b09f747477b8669d2fe130fbec32"} Jun 10 01:02:29.059521 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.059455 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jzcvj" podStartSLOduration=1.568764858 podStartE2EDuration="4.059441173s" totalImagesPullingTime="2.490676315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:29.058873081 +0000 UTC m=+38.600703581" watchObservedRunningTime="2026-06-10 01:02:29.059441173 +0000 UTC m=+38.601271672" Jun 10 01:02:29.063220 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.063183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:29.089318 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.089273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:29.089478 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.089369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:29.089478 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:29.089415 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:29.089581 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:29.089503 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:29.089581 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:29.089520 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:29.089581 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:29.089506 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:33.089485319 +0000 UTC m=+42.631315798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:29.089581 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:29.089570 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:33.089557329 +0000 UTC m=+42.631387813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:29.115850 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.115823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:29.335015 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.334937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:29.384317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.384285 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:29.986480 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:29.986431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:31.028853 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:31.028813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:31.074990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:31.074941 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:31.393446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:31.393412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:33.121571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:33.121532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:33.121597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:33.121708 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:33.121719 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:33.121768 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:41.121754192 +0000 UTC m=+50.663584670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:33.121705 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:33.122064 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:33.121839 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:41.121821559 +0000 UTC m=+50.663652037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:36.547152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:36.547118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:36.648456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:36.648418 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:37.064835 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:37.064737 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="f929f254d4e8f9eb764fc55144a90168bc8a6007911584b5614be2853142d4d0" exitCode=0 Jun 10 01:02:37.064835 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:37.064795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"f929f254d4e8f9eb764fc55144a90168bc8a6007911584b5614be2853142d4d0"} Jun 10 01:02:40.285232 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:40.285193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:41.186993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:41.186950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:41.187011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:41.187105 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:41.187118 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:41.187128 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:41.187178 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.187152315 +0000 UTC m=+66.728982793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:02:41.187217 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:41.187191 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.187185952 +0000 UTC m=+66.729016430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:42.079306 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:42.079269 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="237da879823d1ad0725cecb6d94adf56fe9f2dc80566e3d7fc621ff560a155b2" exitCode=0 Jun 10 01:02:42.079736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:42.079313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"237da879823d1ad0725cecb6d94adf56fe9f2dc80566e3d7fc621ff560a155b2"} Jun 10 01:02:43.084639 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:43.084598 2573 generic.go:356] "Generic (PLEG): container finished" podID="e28bb9c1-0e07-412b-bd7b-8d6852edfdee" containerID="39c4617f907fd602c398f33285024eb754de28cf2779e2ae76c794e6a8dd6f1c" exitCode=0 Jun 10 01:02:43.085000 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:43.084645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerDied","Data":"39c4617f907fd602c398f33285024eb754de28cf2779e2ae76c794e6a8dd6f1c"} Jun 10 01:02:44.090183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.090150 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xq24" event={"ID":"e28bb9c1-0e07-412b-bd7b-8d6852edfdee","Type":"ContainerStarted","Data":"03930cd4f94ba0765a53a4daa3b5baaec2b31bc196b45bb8d3307d4df31ee390"} Jun 10 01:02:44.111206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.111148 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4xq24" podStartSLOduration=8.239184995 podStartE2EDuration="54.111128236s" totalImagesPullingTime="45.871943241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:44.109811614 +0000 UTC m=+53.651642113" watchObservedRunningTime="2026-06-10 01:02:44.111128236 +0000 UTC m=+53.652958737" Jun 10 01:02:44.230764 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.230724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:44.277269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.277240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:44.647518 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.647462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:44.697358 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:44.697320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:45.121039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:45.121009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:45.221560 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:45.221527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:50.991955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:50.991912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:51.031078 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:51.031043 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnplz" Jun 10 01:02:51.060453 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:51.060419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:51.192342 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:51.192306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:51.240819 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:51.240787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:56.599305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.599255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:02:56.599305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.599305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:56.599886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.599346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:56.602059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.602035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:56.602132 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.602071 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:56.602132 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.602109 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:56.609979 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:56.609956 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:02:56.610090 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:56.610038 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:00.610016283 +0000 UTC m=+130.151846775 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : secret "metrics-daemon-secret" not found Jun 10 01:02:56.611837 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.611819 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:56.613175 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.613158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f8a8a53-0662-4190-a27f-c47458abb82b-original-pull-secret\") pod \"global-pull-secret-syncer-jg52f\" (UID: \"6f8a8a53-0662-4190-a27f-c47458abb82b\") " pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:56.622747 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.622727 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgb5\" (UniqueName: \"kubernetes.io/projected/4563696a-9f71-4373-a8b3-013cc3acc2bd-kube-api-access-4fgb5\") pod \"network-check-target-84bxd\" (UID: \"4563696a-9f71-4373-a8b3-013cc3acc2bd\") " pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:56.762594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.762558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg52f" Jun 10 01:02:56.871986 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.871957 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:02:56.880040 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.880013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:02:56.880856 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.880835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jg52f"] Jun 10 01:02:56.886305 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:02:56.885556 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8a8a53_0662_4190_a27f_c47458abb82b.slice/crio-f8eb1cb2b12fc430f193777fc691838acac73cc8563067eaf920b6c85b5e9d7e WatchSource:0}: Error finding container f8eb1cb2b12fc430f193777fc691838acac73cc8563067eaf920b6c85b5e9d7e: Status 404 returned error can't find the container with id f8eb1cb2b12fc430f193777fc691838acac73cc8563067eaf920b6c85b5e9d7e Jun 10 01:02:56.996059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:56.996022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84bxd"] Jun 10 01:02:56.998499 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:02:56.998457 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4563696a_9f71_4373_a8b3_013cc3acc2bd.slice/crio-32d51684077eab33b07f7b27a12ab27a0e838d11efffe8467ac27cbb06e5667f WatchSource:0}: Error finding container 32d51684077eab33b07f7b27a12ab27a0e838d11efffe8467ac27cbb06e5667f: Status 404 returned error can't find the container with id 32d51684077eab33b07f7b27a12ab27a0e838d11efffe8467ac27cbb06e5667f Jun 10 01:02:57.124287 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:57.124192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84bxd" event={"ID":"4563696a-9f71-4373-a8b3-013cc3acc2bd","Type":"ContainerStarted","Data":"32d51684077eab33b07f7b27a12ab27a0e838d11efffe8467ac27cbb06e5667f"} Jun 10 01:02:57.125169 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:57.125150 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jg52f" event={"ID":"6f8a8a53-0662-4190-a27f-c47458abb82b","Type":"ContainerStarted","Data":"f8eb1cb2b12fc430f193777fc691838acac73cc8563067eaf920b6c85b5e9d7e"} Jun 10 01:02:57.205568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:57.205534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:02:57.205685 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:02:57.205590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:02:57.205685 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:57.205682 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:02:57.205755 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:57.205694 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:02:57.205755 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:57.205738 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:29.205725425 +0000 UTC m=+98.747555904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:02:57.205843 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:57.205681 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:57.205843 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:02:57.205803 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:29.205790233 +0000 UTC m=+98.747620715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:03:00.135069 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:00.134971 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84bxd" event={"ID":"4563696a-9f71-4373-a8b3-013cc3acc2bd","Type":"ContainerStarted","Data":"d2a18928de58d3b0cba2151620754e5f5abf75b4a6b3f509454af5a07bf59aab"} Jun 10 01:03:00.135460 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:00.135116 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:03:00.149723 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:00.149663 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-84bxd" podStartSLOduration=66.279924583 podStartE2EDuration="1m9.14964923s" totalImagesPullingTime="2.869724647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:00.148445629 +0000 UTC m=+69.690276157" watchObservedRunningTime="2026-06-10 01:03:00.14964923 +0000 UTC m=+69.691479754" Jun 10 01:03:02.141671 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:02.141570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jg52f" event={"ID":"6f8a8a53-0662-4190-a27f-c47458abb82b","Type":"ContainerStarted","Data":"94e152e0c133923fcf53c8d6b170baa3b2fd09ffc03bef45dd32bc88df0fe43b"} Jun 10 01:03:02.154402 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:02.154255 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jg52f" podStartSLOduration=66.177993533 podStartE2EDuration="1m11.154237658s" totalImagesPullingTime="4.976244125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:02.154217407 +0000 UTC m=+71.696047907" watchObservedRunningTime="2026-06-10 01:03:02.154237658 +0000 UTC m=+71.696068162" Jun 10 01:03:07.064416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:07.064383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:07.122707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:07.122674 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:29.232981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:29.232934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:03:29.232981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:29.232989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:03:29.233437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:03:29.233086 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:03:29.233437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:03:29.233159 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:04:33.233142905 +0000 UTC m=+162.774973384 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:03:29.233437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:03:29.233092 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:29.233437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:03:29.233178 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:03:29.233437 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:03:29.233244 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:33.233231695 +0000 UTC m=+162.775062175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:03:31.140485 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:03:31.140438 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-84bxd" Jun 10 01:04:00.657558 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:00.657502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:04:00.658047 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:00.657662 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:04:00.658047 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:00.657742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:02.657726406 +0000 UTC m=+252.199556885 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : secret "metrics-daemon-secret" not found Jun 10 01:04:28.290973 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:28.290928 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" Jun 10 01:04:28.334264 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:28.334224 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j2mbz" podUID="77209cfa-414b-45ed-bbd8-0834b02c503f" Jun 10 01:04:28.345060 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:28.345032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:04:28.345192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:28.345041 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:04:29.864205 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:29.864158 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:04:33.279794 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:33.279705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:04:33.279794 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:33.279766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:04:33.280328 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:33.279859 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:04:33.280328 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:33.279894 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:04:33.280328 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:33.279910 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678b848b5d-48h6v: secret "image-registry-tls" not found Jun 10 01:04:33.280328 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:33.279941 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls podName:77209cfa-414b-45ed-bbd8-0834b02c503f nodeName:}" failed. No retries permitted until 2026-06-10 01:06:35.279913442 +0000 UTC m=+284.821743920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls") pod "dns-default-j2mbz" (UID: "77209cfa-414b-45ed-bbd8-0834b02c503f") : secret "dns-default-metrics-tls" not found Jun 10 01:04:33.280328 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:04:33.279975 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls podName:c616df29-8e20-425a-b943-5bf4d25ca117 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:35.279958055 +0000 UTC m=+284.821788552 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls") pod "image-registry-678b848b5d-48h6v" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117") : secret "image-registry-tls" not found Jun 10 01:04:41.853354 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:41.853302 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:04:58.161812 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:04:58.161785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:49.248971 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.248934 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp"] Jun 10 01:05:49.252233 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.252128 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-5b8jw"] Jun 10 01:05:49.252833 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.252798 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" Jun 10 01:05:49.254700 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.254679 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.255136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.255116 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.255237 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.255166 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r884q\"" Jun 10 01:05:49.255289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.255240 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.256793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.256778 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 01:05:49.256871 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.256861 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 01:05:49.256949 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.256930 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.257033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.257018 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.257033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.257027 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d6chm\"" Jun 10 01:05:49.259726 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.259707 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp"] Jun 10 01:05:49.262943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.262924 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 01:05:49.263327 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.263305 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5b8jw"] Jun 10 01:05:49.318495 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-snapshots\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.318706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqlg\" (UniqueName: \"kubernetes.io/projected/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-kube-api-access-skqlg\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.318706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-trusted-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.318706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-service-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.318706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-tmp\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.318706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27j4p\" (UniqueName: \"kubernetes.io/projected/52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0-kube-api-access-27j4p\") pod \"volume-data-source-validator-78dd696465-mwvxp\" (UID: \"52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" Jun 10 01:05:49.318891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.318709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-serving-cert\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.325363 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.325338 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck"] Jun 10 01:05:49.327060 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.327046 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.329163 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.329144 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 01:05:49.329342 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.329326 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 01:05:49.329435 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.329420 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v9l5j\"" Jun 10 01:05:49.335540 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.335520 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q"] Jun 10 01:05:49.337228 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.337122 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8"] Jun 10 01:05:49.337323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.337261 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.339093 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.339075 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck"] Jun 10 01:05:49.339166 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.339147 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.340953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.340932 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 01:05:49.341325 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.341310 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 01:05:49.341706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.341689 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x44mz\"" Jun 10 01:05:49.341946 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.341926 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.342640 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.342592 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.342840 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.342826 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4z7kg\"" Jun 10 01:05:49.342941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.342923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 01:05:49.343295 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.343279 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.343647 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.343632 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.351479 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.351432 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8"] Jun 10 01:05:49.352791 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.352772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q"] Jun 10 01:05:49.419694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27j4p\" (UniqueName: \"kubernetes.io/projected/52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0-kube-api-access-27j4p\") pod \"volume-data-source-validator-78dd696465-mwvxp\" (UID: \"52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-service-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-snapshots\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-trusted-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqlg\" (UniqueName: \"kubernetes.io/projected/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-kube-api-access-skqlg\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7926da5e-90de-4049-bda0-cf59a19507b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.419896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-serving-cert\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.419956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65dnl\" (UniqueName: \"kubernetes.io/projected/5e6f30dd-bccb-4769-8fc9-bb95491b466b-kube-api-access-65dnl\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5qxv\" (UniqueName: \"kubernetes.io/projected/7926da5e-90de-4049-bda0-cf59a19507b5-kube-api-access-x5qxv\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.420258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-tmp\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.420584 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-service-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.420584 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-snapshots\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.420584 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-tmp\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.420681 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.420670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-trusted-ca-bundle\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.422240 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.422216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-serving-cert\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.427082 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.427048 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5"] Jun 10 01:05:49.429246 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.429232 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.431859 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.431834 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7"] Jun 10 01:05:49.431968 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.431909 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 01:05:49.432050 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.431968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.432050 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.431981 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.432050 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.431968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 01:05:49.432198 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.432074 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7cgtw\"" Jun 10 01:05:49.433896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.433873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:49.435251 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.435233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27j4p\" (UniqueName: \"kubernetes.io/projected/52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0-kube-api-access-27j4p\") pod \"volume-data-source-validator-78dd696465-mwvxp\" (UID: \"52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" Jun 10 01:05:49.435667 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.435648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.436271 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.436249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqlg\" (UniqueName: \"kubernetes.io/projected/1e683a7c-85d9-4c67-b66f-1e5355f88a4b-kube-api-access-skqlg\") pod \"insights-operator-896549976-5b8jw\" (UID: \"1e683a7c-85d9-4c67-b66f-1e5355f88a4b\") " pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.437706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.437685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 01:05:49.437789 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.437686 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.437789 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.437741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.437789 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.437746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 01:05:49.437934 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.437741 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j59qh\"" Jun 10 01:05:49.443112 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.443036 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5"] Jun 10 01:05:49.444218 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.444198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7"] Jun 10 01:05:49.490535 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.490500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:49.520707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.520707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czg2j\" (UniqueName: \"kubernetes.io/projected/274782ea-64f5-45e7-bc84-734ded1a8ae8-kube-api-access-czg2j\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.520707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.520793 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7926da5e-90de-4049-bda0-cf59a19507b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.520843 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:50.020827511 +0000 UTC m=+239.562657990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65dnl\" (UniqueName: \"kubernetes.io/projected/5e6f30dd-bccb-4769-8fc9-bb95491b466b-kube-api-access-65dnl\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5qxv\" (UniqueName: \"kubernetes.io/projected/7926da5e-90de-4049-bda0-cf59a19507b5-kube-api-access-x5qxv\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.520941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.520957 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.521015 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls podName:7926da5e-90de-4049-bda0-cf59a19507b5 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:50.020998476 +0000 UTC m=+239.562828967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-kcc4q" (UID: "7926da5e-90de-4049-bda0-cf59a19507b5") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.520966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/274782ea-64f5-45e7-bc84-734ded1a8ae8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.521081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfjm\" (UniqueName: \"kubernetes.io/projected/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-kube-api-access-rbfjm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.521109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/274782ea-64f5-45e7-bc84-734ded1a8ae8-config\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.521162 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:05:49.521428 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:49.521262 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls podName:5e6f30dd-bccb-4769-8fc9-bb95491b466b nodeName:}" failed. No retries permitted until 2026-06-10 01:05:50.021245837 +0000 UTC m=+239.563076333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mdtd8" (UID: "5e6f30dd-bccb-4769-8fc9-bb95491b466b") : secret "samples-operator-tls" not found Jun 10 01:05:49.521793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.521663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:49.521793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.521673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7926da5e-90de-4049-bda0-cf59a19507b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.529058 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.529029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5qxv\" (UniqueName: \"kubernetes.io/projected/7926da5e-90de-4049-bda0-cf59a19507b5-kube-api-access-x5qxv\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:49.529169 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.529094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65dnl\" (UniqueName: \"kubernetes.io/projected/5e6f30dd-bccb-4769-8fc9-bb95491b466b-kube-api-access-65dnl\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:49.564727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.564688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" Jun 10 01:05:49.571154 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.571134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5b8jw" Jun 10 01:05:49.591270 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.591236 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:49.622280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfjm\" (UniqueName: \"kubernetes.io/projected/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-kube-api-access-rbfjm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.622425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/274782ea-64f5-45e7-bc84-734ded1a8ae8-config\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.622425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.622425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czg2j\" (UniqueName: \"kubernetes.io/projected/274782ea-64f5-45e7-bc84-734ded1a8ae8-kube-api-access-czg2j\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.622425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.622656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.622602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/274782ea-64f5-45e7-bc84-734ded1a8ae8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.623624 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.623573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/274782ea-64f5-45e7-bc84-734ded1a8ae8-config\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.623750 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.623626 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.625764 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.625738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/274782ea-64f5-45e7-bc84-734ded1a8ae8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.627808 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.627772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.631180 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.631133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czg2j\" (UniqueName: \"kubernetes.io/projected/274782ea-64f5-45e7-bc84-734ded1a8ae8-kube-api-access-czg2j\") pod \"service-ca-operator-6bc5ff68f5-998d7\" (UID: \"274782ea-64f5-45e7-bc84-734ded1a8ae8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.631752 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.631725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfjm\" (UniqueName: \"kubernetes.io/projected/6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2-kube-api-access-rbfjm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-trtp5\" (UID: \"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.697207 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.697172 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp"] Jun 10 01:05:49.701339 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:05:49.701308 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e17c52_b1d8_4a71_a6ff_fd9940fcc3d0.slice/crio-dea2941be577b5cd10f0262fc1c1265450bc323830dacb5fc13bc7eca082a761 WatchSource:0}: Error finding container dea2941be577b5cd10f0262fc1c1265450bc323830dacb5fc13bc7eca082a761: Status 404 returned error can't find the container with id dea2941be577b5cd10f0262fc1c1265450bc323830dacb5fc13bc7eca082a761 Jun 10 01:05:49.711738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.711716 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5b8jw"] Jun 10 01:05:49.716127 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:05:49.714460 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e683a7c_85d9_4c67_b66f_1e5355f88a4b.slice/crio-4ad3dd6cb6837a721380701f12212375bd48631a56b6f7bc221320854efad07f WatchSource:0}: Error finding container 4ad3dd6cb6837a721380701f12212375bd48631a56b6f7bc221320854efad07f: Status 404 returned error can't find the container with id 4ad3dd6cb6837a721380701f12212375bd48631a56b6f7bc221320854efad07f Jun 10 01:05:49.747017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.746989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" Jun 10 01:05:49.752287 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.752269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" Jun 10 01:05:49.872400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.872369 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5"] Jun 10 01:05:49.875276 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:05:49.875248 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0902d8_d0ff_4387_8dfe_ae1d2db0c7c2.slice/crio-a2eb45fd716764c62e29e09bfe126961c9299a52d19dec072e8b090b667f335d WatchSource:0}: Error finding container a2eb45fd716764c62e29e09bfe126961c9299a52d19dec072e8b090b667f335d: Status 404 returned error can't find the container with id a2eb45fd716764c62e29e09bfe126961c9299a52d19dec072e8b090b667f335d Jun 10 01:05:49.887654 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:49.887623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7"] Jun 10 01:05:49.890658 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:05:49.890632 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274782ea_64f5_45e7_bc84_734ded1a8ae8.slice/crio-3f67f5422d2ff3dcaaaa7396a2d3fb0b6386b9a8a57a17fcd7bc83cdd1406b67 WatchSource:0}: Error finding container 3f67f5422d2ff3dcaaaa7396a2d3fb0b6386b9a8a57a17fcd7bc83cdd1406b67: Status 404 returned error can't find the container with id 3f67f5422d2ff3dcaaaa7396a2d3fb0b6386b9a8a57a17fcd7bc83cdd1406b67 Jun 10 01:05:50.027108 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.027070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.027139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.027187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027229 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027289 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls podName:7926da5e-90de-4049-bda0-cf59a19507b5 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.027274184 +0000 UTC m=+240.569104662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-kcc4q" (UID: "7926da5e-90de-4049-bda0-cf59a19507b5") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027288 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:05:50.027326 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027230 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:05:50.027574 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027359 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls podName:5e6f30dd-bccb-4769-8fc9-bb95491b466b nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.027324853 +0000 UTC m=+240.569155332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mdtd8" (UID: "5e6f30dd-bccb-4769-8fc9-bb95491b466b") : secret "samples-operator-tls" not found Jun 10 01:05:50.027574 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:50.027376 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.027367024 +0000 UTC m=+240.569197504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:05:50.541176 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.541104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5b8jw" event={"ID":"1e683a7c-85d9-4c67-b66f-1e5355f88a4b","Type":"ContainerStarted","Data":"4ad3dd6cb6837a721380701f12212375bd48631a56b6f7bc221320854efad07f"} Jun 10 01:05:50.543371 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.543310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" event={"ID":"52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0","Type":"ContainerStarted","Data":"dea2941be577b5cd10f0262fc1c1265450bc323830dacb5fc13bc7eca082a761"} Jun 10 01:05:50.545461 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.545291 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" event={"ID":"274782ea-64f5-45e7-bc84-734ded1a8ae8","Type":"ContainerStarted","Data":"3f67f5422d2ff3dcaaaa7396a2d3fb0b6386b9a8a57a17fcd7bc83cdd1406b67"} Jun 10 01:05:50.546810 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:50.546753 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" event={"ID":"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2","Type":"ContainerStarted","Data":"a2eb45fd716764c62e29e09bfe126961c9299a52d19dec072e8b090b667f335d"} Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.036274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.036367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.036411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036521 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036533 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036587 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.036566775 +0000 UTC m=+242.578397264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036605 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls podName:5e6f30dd-bccb-4769-8fc9-bb95491b466b nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.036596106 +0000 UTC m=+242.578426591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mdtd8" (UID: "5e6f30dd-bccb-4769-8fc9-bb95491b466b") : secret "samples-operator-tls" not found Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036612 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:51.036666 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:51.036640 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls podName:7926da5e-90de-4049-bda0-cf59a19507b5 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.03663134 +0000 UTC m=+242.578461822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-kcc4q" (UID: "7926da5e-90de-4049-bda0-cf59a19507b5") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:51.552076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.552024 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" event={"ID":"52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0","Type":"ContainerStarted","Data":"a503b5474b1970c52b5cc6f34ee8bd57decbc739864b2b14e05e5b3357a0fd40"} Jun 10 01:05:51.567300 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.567245 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mwvxp" podStartSLOduration=1.173321697 podStartE2EDuration="2.567229791s" totalImagesPullingTime="1.393908094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:51.566037641 +0000 UTC m=+241.107868145" watchObservedRunningTime="2026-06-10 01:05:51.567229791 +0000 UTC m=+241.109060292" Jun 10 01:05:51.651381 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.651342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.706203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:51.706169 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:53.053312 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.053273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.053336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.053418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053441 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053493 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053522 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053548 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls podName:7926da5e-90de-4049-bda0-cf59a19507b5 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.053526334 +0000 UTC m=+246.595356817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-kcc4q" (UID: "7926da5e-90de-4049-bda0-cf59a19507b5") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053569 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls podName:5e6f30dd-bccb-4769-8fc9-bb95491b466b nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.053559161 +0000 UTC m=+246.595389645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mdtd8" (UID: "5e6f30dd-bccb-4769-8fc9-bb95491b466b") : secret "samples-operator-tls" not found Jun 10 01:05:53.053746 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:53.053585 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.05357586 +0000 UTC m=+246.595406347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:05:53.559980 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.559946 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" event={"ID":"274782ea-64f5-45e7-bc84-734ded1a8ae8","Type":"ContainerStarted","Data":"dafaefd2d3428caddf385520c0f6de0ff1456a8fffdcfb0fb4a2c0e1428a65a7"} Jun 10 01:05:53.561600 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.561568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" event={"ID":"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2","Type":"ContainerStarted","Data":"602d366f5a1507ad0ce83ebccab358f06d7414949449e22a482abe4fb4a0ce40"} Jun 10 01:05:53.563034 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.563008 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5b8jw" event={"ID":"1e683a7c-85d9-4c67-b66f-1e5355f88a4b","Type":"ContainerStarted","Data":"d0cfb7e6013920e649f7cfdc5fcf8a76b90e75eb8ed727553731e1001aa4dc36"} Jun 10 01:05:53.574997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.574951 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" podStartSLOduration=1.54481482 podStartE2EDuration="4.574938239s" totalImagesPullingTime="3.030123419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:53.574341801 +0000 UTC m=+243.116172321" watchObservedRunningTime="2026-06-10 01:05:53.574938239 +0000 UTC m=+243.116768742" Jun 10 01:05:53.590036 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.589994 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-5b8jw" podStartSLOduration=1.391050658 podStartE2EDuration="4.589980916s" totalImagesPullingTime="3.198930258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:53.589375471 +0000 UTC m=+243.131205974" watchObservedRunningTime="2026-06-10 01:05:53.589980916 +0000 UTC m=+243.131811530" Jun 10 01:05:53.604436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:53.604385 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" podStartSLOduration=1.559807548 podStartE2EDuration="4.604368574s" totalImagesPullingTime="3.044561026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:53.603319188 +0000 UTC m=+243.145149689" watchObservedRunningTime="2026-06-10 01:05:53.604368574 +0000 UTC m=+243.146199076" Jun 10 01:05:54.107579 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.107540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:54.311068 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.311031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:54.411444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.411361 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:54.487609 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.487583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:54.755586 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.755504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:54.809190 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:54.809159 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:55.028252 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:55.028165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:55.130202 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:55.130170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:56.203362 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.203333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wh67m_95cec5d3-399b-480f-be47-6b4e9260e5d0/dns-node-resolver/0.log" Jun 10 01:05:56.570793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.570701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:56.660595 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.660565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:56.663496 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.663454 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4hrg7"] Jun 10 01:05:56.665705 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.665690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.668079 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.668049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gc68c\"" Jun 10 01:05:56.668399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.668383 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 01:05:56.668959 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.668940 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 01:05:56.669033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.668942 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 01:05:56.669033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.668970 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 01:05:56.673388 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.673365 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4hrg7"] Jun 10 01:05:56.727249 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.727220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:56.785764 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.785730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-key\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.785928 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.785792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-cabundle\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.785928 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.785815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96g4n\" (UniqueName: \"kubernetes.io/projected/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-kube-api-access-96g4n\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.886703 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.886667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-key\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.886878 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.886723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-cabundle\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.886878 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.886741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96g4n\" (UniqueName: \"kubernetes.io/projected/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-kube-api-access-96g4n\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.887438 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.887408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-cabundle\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.889193 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.889168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-signing-key\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.894572 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.894544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96g4n\" (UniqueName: \"kubernetes.io/projected/78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa-kube-api-access-96g4n\") pod \"service-ca-7d74d578b8-4hrg7\" (UID: \"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa\") " pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:56.974518 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:56.974486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" Jun 10 01:05:57.089001 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.088969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:05:57.089148 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.089026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:05:57.089148 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.089055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:05:57.089148 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089125 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:05:57.089274 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089164 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:05:57.089274 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089173 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:57.089274 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089196 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.089177457 +0000 UTC m=+254.631007937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:05:57.089274 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089217 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls podName:7926da5e-90de-4049-bda0-cf59a19507b5 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.089205052 +0000 UTC m=+254.631035535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-kcc4q" (UID: "7926da5e-90de-4049-bda0-cf59a19507b5") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:05:57.089274 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:05:57.089230 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls podName:5e6f30dd-bccb-4769-8fc9-bb95491b466b nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.089224463 +0000 UTC m=+254.631054942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mdtd8" (UID: "5e6f30dd-bccb-4769-8fc9-bb95491b466b") : secret "samples-operator-tls" not found Jun 10 01:05:57.096891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.096762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4hrg7"] Jun 10 01:05:57.099347 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:05:57.099317 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d96a1c_bc8a_4a3e_a52a_74f3ea86a1aa.slice/crio-77beddf0d948a7e06e5f33f205dd615be1767bae62aa5882cc14b55bd700f762 WatchSource:0}: Error finding container 77beddf0d948a7e06e5f33f205dd615be1767bae62aa5882cc14b55bd700f762: Status 404 returned error can't find the container with id 77beddf0d948a7e06e5f33f205dd615be1767bae62aa5882cc14b55bd700f762 Jun 10 01:05:57.205903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.205875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4qrl_1bd7b302-ffc2-4798-8454-5f8287ef2bb1/node-ca/0.log" Jun 10 01:05:57.509863 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.509781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:57.576854 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.576821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" event={"ID":"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa","Type":"ContainerStarted","Data":"2c7c576251ce0f056d736b9329347bd442e08bf51191d951ade7109a284e9be7"} Jun 10 01:05:57.577006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.576871 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" event={"ID":"78d96a1c-bc8a-4a3e-a52a-74f3ea86a1aa","Type":"ContainerStarted","Data":"77beddf0d948a7e06e5f33f205dd615be1767bae62aa5882cc14b55bd700f762"} Jun 10 01:05:57.593639 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.593590 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-4hrg7" podStartSLOduration=1.593575505 podStartE2EDuration="1.593575505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:57.592926351 +0000 UTC m=+247.134756859" watchObservedRunningTime="2026-06-10 01:05:57.593575505 +0000 UTC m=+247.135406005" Jun 10 01:05:57.804447 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:57.804372 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jzcvj_e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7/serve-healthcheck-canary/0.log" Jun 10 01:05:58.595867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:58.595816 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:58.918018 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:58.917983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.018386 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.018351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.155622 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.155586 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.223641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.223553 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.324434 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.324401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.694914 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.694872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.904852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:05:59.904817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:00.549945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:00.549915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:01.107232 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:01.107201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:01.306824 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:01.306795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:01.502450 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:01.502328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:01.901903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:01.901872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.427964 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:02.427931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.528483 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:02.528443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.584997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:02.584969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.739306 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:02.739210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:06:02.739457 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:02.739334 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:06:02.739457 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:02.739395 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs podName:d492c48d-0ac1-49c3-9127-caf36e96c576 nodeName:}" failed. No retries permitted until 2026-06-10 01:08:04.739376539 +0000 UTC m=+374.281207019 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs") pod "network-metrics-daemon-d7lj7" (UID: "d492c48d-0ac1-49c3-9127-caf36e96c576") : secret "metrics-daemon-secret" not found Jun 10 01:06:03.102993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:03.102957 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:03.306488 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:03.306441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:03.702137 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:03.702100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:03.902497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:03.902456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:04.000577 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:04.000485 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:04.103084 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:04.103052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:05.157219 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.157171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:06:05.157743 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.157251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:06:05.157743 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.157297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:06:05.157743 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:05.157326 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:06:05.157743 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:05.157398 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert podName:4d02afb5-e3fe-4b4e-b964-bde6a01198d3 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.157376221 +0000 UTC m=+270.699206703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-hg6ck" (UID: "4d02afb5-e3fe-4b4e-b964-bde6a01198d3") : secret "networking-console-plugin-cert" not found Jun 10 01:06:05.158185 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.158161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:05.160269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.160245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f30dd-bccb-4769-8fc9-bb95491b466b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mdtd8\" (UID: \"5e6f30dd-bccb-4769-8fc9-bb95491b466b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:06:05.160362 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.160335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7926da5e-90de-4049-bda0-cf59a19507b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-kcc4q\" (UID: \"7926da5e-90de-4049-bda0-cf59a19507b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:06:05.249196 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.249164 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x44mz\"" Jun 10 01:06:05.256060 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.256042 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4z7kg\"" Jun 10 01:06:05.257047 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.257030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" Jun 10 01:06:05.265070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.265053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" Jun 10 01:06:05.302238 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.302204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:05.396770 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.396740 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q"] Jun 10 01:06:05.399948 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:05.399917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7926da5e_90de_4049_bda0_cf59a19507b5.slice/crio-77ac6926c3dba333e92a2e205d5ef910708144cb740dcc0a2bc4283774c65e91 WatchSource:0}: Error finding container 77ac6926c3dba333e92a2e205d5ef910708144cb740dcc0a2bc4283774c65e91: Status 404 returned error can't find the container with id 77ac6926c3dba333e92a2e205d5ef910708144cb740dcc0a2bc4283774c65e91 Jun 10 01:06:05.422056 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.421571 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8"] Jun 10 01:06:05.510803 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.510767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:05.603806 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.603765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" event={"ID":"5e6f30dd-bccb-4769-8fc9-bb95491b466b","Type":"ContainerStarted","Data":"215debc5a9edc4dd0e6870fcb49b438c1a872c12c4150c3a29b2ebcae6b077a7"} Jun 10 01:06:05.604907 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.604877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" event={"ID":"7926da5e-90de-4049-bda0-cf59a19507b5","Type":"ContainerStarted","Data":"77ac6926c3dba333e92a2e205d5ef910708144cb740dcc0a2bc4283774c65e91"} Jun 10 01:06:05.714155 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.714063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:05.897183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:05.897145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:06.110033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:06.110003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:06.903183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:06.903142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.095610 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.095575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.299314 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.299241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.611415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.611380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.614595 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.614569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" event={"ID":"7926da5e-90de-4049-bda0-cf59a19507b5","Type":"ContainerStarted","Data":"d84d82daf8c18f3df703c9ed45331257d084ffb42cc7bf539e7abb72bd1e9c85"} Jun 10 01:06:07.629604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.629548 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-kcc4q" podStartSLOduration=16.723623804 podStartE2EDuration="18.629528386s" totalImagesPullingTime="1.905904582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:07.628272428 +0000 UTC m=+257.170102962" watchObservedRunningTime="2026-06-10 01:06:07.629528386 +0000 UTC m=+257.171358886" Jun 10 01:06:07.712939 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.712899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.812521 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.812484 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.912637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:07.912548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:08.499327 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:08.499297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:08.619183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:08.619151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" event={"ID":"5e6f30dd-bccb-4769-8fc9-bb95491b466b","Type":"ContainerStarted","Data":"36ec12488c70724aff4b7a3315839fbc1ac98c06cc75b23cd781c62aa8e07943"} Jun 10 01:06:08.619334 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:08.619207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" event={"ID":"5e6f30dd-bccb-4769-8fc9-bb95491b466b","Type":"ContainerStarted","Data":"6798c351d31236353c9728d3841819ba21827e7d8360b41ac65b8a2eb98606ef"} Jun 10 01:06:08.635549 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:08.635501 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mdtd8" podStartSLOduration=17.071046211 podStartE2EDuration="19.635484975s" totalImagesPullingTime="2.564438764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:08.634739896 +0000 UTC m=+258.176570400" watchObservedRunningTime="2026-06-10 01:06:08.635484975 +0000 UTC m=+258.177315473" Jun 10 01:06:09.102485 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:09.102447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:09.304419 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:09.304387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:09.497786 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:09.497707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:09.701334 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:09.701297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:14.653351 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.653313 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l246x"] Jun 10 01:06:14.656066 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.656034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.659276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.659250 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pvxg\"" Jun 10 01:06:14.659276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.659267 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 01:06:14.659276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.659250 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 01:06:14.670091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.670059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l246x"] Jun 10 01:06:14.711145 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.711104 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct"] Jun 10 01:06:14.713111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.713082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:14.716976 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.716951 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9qvpg\"" Jun 10 01:06:14.717256 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.717238 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 01:06:14.725842 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.725814 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct"] Jun 10 01:06:14.813131 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.813099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:14.840375 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38651e13-d5b2-4090-b995-0af2889f6c44-crio-socket\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.840375 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38651e13-d5b2-4090-b995-0af2889f6c44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.840655 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38651e13-d5b2-4090-b995-0af2889f6c44-data-volume\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.840655 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38651e13-d5b2-4090-b995-0af2889f6c44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.840655 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hm4\" (UniqueName: \"kubernetes.io/projected/38651e13-d5b2-4090-b995-0af2889f6c44-kube-api-access-z5hm4\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.840655 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.840589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ca0a86b-d608-41c4-9cb1-0026595435af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-d8xct\" (UID: \"2ca0a86b-d608-41c4-9cb1-0026595435af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:14.910150 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.910066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:14.940945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.940912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ca0a86b-d608-41c4-9cb1-0026595435af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-d8xct\" (UID: \"2ca0a86b-d608-41c4-9cb1-0026595435af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:14.941111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.940994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38651e13-d5b2-4090-b995-0af2889f6c44-crio-socket\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38651e13-d5b2-4090-b995-0af2889f6c44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941043 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38651e13-d5b2-4090-b995-0af2889f6c44-data-volume\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38651e13-d5b2-4090-b995-0af2889f6c44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hm4\" (UniqueName: \"kubernetes.io/projected/38651e13-d5b2-4090-b995-0af2889f6c44-kube-api-access-z5hm4\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941347 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38651e13-d5b2-4090-b995-0af2889f6c44-crio-socket\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941550 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38651e13-d5b2-4090-b995-0af2889f6c44-data-volume\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.941711 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.941689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38651e13-d5b2-4090-b995-0af2889f6c44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.943383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.943353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38651e13-d5b2-4090-b995-0af2889f6c44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.943505 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.943417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2ca0a86b-d608-41c4-9cb1-0026595435af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-d8xct\" (UID: \"2ca0a86b-d608-41c4-9cb1-0026595435af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:14.951144 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.951122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hm4\" (UniqueName: \"kubernetes.io/projected/38651e13-d5b2-4090-b995-0af2889f6c44-kube-api-access-z5hm4\") pod \"insights-runtime-extractor-l246x\" (UID: \"38651e13-d5b2-4090-b995-0af2889f6c44\") " pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:14.965074 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:14.965039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l246x" Jun 10 01:06:15.022646 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.022375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:15.106526 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.106493 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l246x"] Jun 10 01:06:15.111258 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:15.111227 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38651e13_d5b2_4090_b995_0af2889f6c44.slice/crio-67b7780b6d9728b377b057f6713dc715ea3f69f0509ba2fe587559192e3de8ff WatchSource:0}: Error finding container 67b7780b6d9728b377b057f6713dc715ea3f69f0509ba2fe587559192e3de8ff: Status 404 returned error can't find the container with id 67b7780b6d9728b377b057f6713dc715ea3f69f0509ba2fe587559192e3de8ff Jun 10 01:06:15.194604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.194358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct"] Jun 10 01:06:15.196440 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:15.196416 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca0a86b_d608_41c4_9cb1_0026595435af.slice/crio-f0b31af3abe751d128b8f7004b6f9a9c34cad8b7c332c65bea0e5e18639a477a WatchSource:0}: Error finding container f0b31af3abe751d128b8f7004b6f9a9c34cad8b7c332c65bea0e5e18639a477a: Status 404 returned error can't find the container with id f0b31af3abe751d128b8f7004b6f9a9c34cad8b7c332c65bea0e5e18639a477a Jun 10 01:06:15.643051 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.643011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l246x" event={"ID":"38651e13-d5b2-4090-b995-0af2889f6c44","Type":"ContainerStarted","Data":"9408158bf6ba5d84737d75838d5c328ae827e6c9f142a5e7b1fded3db613418f"} Jun 10 01:06:15.643234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.643085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l246x" event={"ID":"38651e13-d5b2-4090-b995-0af2889f6c44","Type":"ContainerStarted","Data":"67b7780b6d9728b377b057f6713dc715ea3f69f0509ba2fe587559192e3de8ff"} Jun 10 01:06:15.644343 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:15.644314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" event={"ID":"2ca0a86b-d608-41c4-9cb1-0026595435af","Type":"ContainerStarted","Data":"f0b31af3abe751d128b8f7004b6f9a9c34cad8b7c332c65bea0e5e18639a477a"} Jun 10 01:06:16.651541 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.651495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l246x" event={"ID":"38651e13-d5b2-4090-b995-0af2889f6c44","Type":"ContainerStarted","Data":"b59d6ae5156309478dc736188587381febb13e0c4a0c57990a8e17468ba45d1f"} Jun 10 01:06:16.652789 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.652767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" event={"ID":"2ca0a86b-d608-41c4-9cb1-0026595435af","Type":"ContainerStarted","Data":"d617d17db9614ad01eb297b0b66d4cf0c9a6db86735dafa2e62c4f04bd75e84b"} Jun 10 01:06:16.653057 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.653039 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:16.657659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.657639 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" Jun 10 01:06:16.666959 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.666912 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-d8xct" podStartSLOduration=1.65775445 podStartE2EDuration="2.666898208s" totalImagesPullingTime="1.009143758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:16.665727773 +0000 UTC m=+266.207558274" watchObservedRunningTime="2026-06-10 01:06:16.666898208 +0000 UTC m=+266.208728708" Jun 10 01:06:16.821666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.821633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:16.864460 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.864434 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq"] Jun 10 01:06:16.867894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.867868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:16.870342 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.870296 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 01:06:16.870482 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.870431 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 01:06:16.870889 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.870611 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 01:06:16.870889 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.870692 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rrmld\"" Jun 10 01:06:16.876281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.876220 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq"] Jun 10 01:06:16.893834 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:16.893787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:17.061183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.061107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.061183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.061158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.061183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.061177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qm8\" (UniqueName: \"kubernetes.io/projected/0481f85a-8423-41dc-96a7-518f8ef63424-kube-api-access-67qm8\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.061421 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.061239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0481f85a-8423-41dc-96a7-518f8ef63424-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.162573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.162537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.162573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.162577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qm8\" (UniqueName: \"kubernetes.io/projected/0481f85a-8423-41dc-96a7-518f8ef63424-kube-api-access-67qm8\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.162818 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.162594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0481f85a-8423-41dc-96a7-518f8ef63424-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.162818 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:17.162713 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 01:06:17.162818 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:17.162786 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls podName:0481f85a-8423-41dc-96a7-518f8ef63424 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:17.662767213 +0000 UTC m=+267.204597698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-tfrhq" (UID: "0481f85a-8423-41dc-96a7-518f8ef63424") : secret "prometheus-operator-tls" not found Jun 10 01:06:17.162970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.162893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.163188 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.163169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0481f85a-8423-41dc-96a7-518f8ef63424-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.165274 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.165256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.170318 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.170293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qm8\" (UniqueName: \"kubernetes.io/projected/0481f85a-8423-41dc-96a7-518f8ef63424-kube-api-access-67qm8\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.595076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.595044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:17.657616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.657585 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l246x" event={"ID":"38651e13-d5b2-4090-b995-0af2889f6c44","Type":"ContainerStarted","Data":"d2a3cd1880f2f4b55bb230e0739c025adc471786e9ced8178ec260aab36a0fa5"} Jun 10 01:06:17.666941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.666907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.669357 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.669325 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0481f85a-8423-41dc-96a7-518f8ef63424-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-tfrhq\" (UID: \"0481f85a-8423-41dc-96a7-518f8ef63424\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.675748 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.675706 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l246x" podStartSLOduration=1.711511016 podStartE2EDuration="3.675691141s" totalImagesPullingTime="1.964180125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:17.674394257 +0000 UTC m=+267.216224782" watchObservedRunningTime="2026-06-10 01:06:17.675691141 +0000 UTC m=+267.217521642" Jun 10 01:06:17.779633 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.779593 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" Jun 10 01:06:17.905309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:17.905134 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq"] Jun 10 01:06:17.907728 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:17.907696 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0481f85a_8423_41dc_96a7_518f8ef63424.slice/crio-f7b86c4fcc687f6c42c12d935b991f6134964b51e9d9114fce14940a760a0e6f WatchSource:0}: Error finding container f7b86c4fcc687f6c42c12d935b991f6134964b51e9d9114fce14940a760a0e6f: Status 404 returned error can't find the container with id f7b86c4fcc687f6c42c12d935b991f6134964b51e9d9114fce14940a760a0e6f Jun 10 01:06:18.662058 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:18.662022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" event={"ID":"0481f85a-8423-41dc-96a7-518f8ef63424","Type":"ContainerStarted","Data":"f7b86c4fcc687f6c42c12d935b991f6134964b51e9d9114fce14940a760a0e6f"} Jun 10 01:06:19.350874 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.350846 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:19.667534 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.667438 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" event={"ID":"0481f85a-8423-41dc-96a7-518f8ef63424","Type":"ContainerStarted","Data":"5edb31a16b236c6d4d304ffdcc8cd4425aeca52d19c0dbd52b784d2f466d44d4"} Jun 10 01:06:19.667886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.667538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" event={"ID":"0481f85a-8423-41dc-96a7-518f8ef63424","Type":"ContainerStarted","Data":"87d17a06a81e67a27e7e09f368c23989a5d6d53d08e3f1988e15ddbe82ba0729"} Jun 10 01:06:19.671276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.671248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:19.683690 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.683641 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-tfrhq" podStartSLOduration=2.517430814 podStartE2EDuration="3.683626419s" totalImagesPullingTime="1.166195605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:19.682520315 +0000 UTC m=+269.224350818" watchObservedRunningTime="2026-06-10 01:06:19.683626419 +0000 UTC m=+269.225456920" Jun 10 01:06:19.726458 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:19.726427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:20.970201 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:20.970148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.183756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.183704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.190719 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.190685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:06:21.193299 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.193275 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d02afb5-e3fe-4b4e-b964-bde6a01198d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-hg6ck\" (UID: \"4d02afb5-e3fe-4b4e-b964-bde6a01198d3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:06:21.205268 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.205237 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx"] Jun 10 01:06:21.209208 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.209187 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.211651 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.211498 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 01:06:21.211651 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.211539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t7hgc\"" Jun 10 01:06:21.212100 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.211941 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 01:06:21.216268 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.216247 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x"] Jun 10 01:06:21.219680 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.219432 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx"] Jun 10 01:06:21.220525 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.219813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.226508 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.224104 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j8h8r"] Jun 10 01:06:21.226917 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.226900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 01:06:21.227172 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.227135 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4749w\"" Jun 10 01:06:21.227497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.227450 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 01:06:21.227717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.227620 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 01:06:21.230091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.230069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.230302 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.230288 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x"] Jun 10 01:06:21.232484 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.232453 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 01:06:21.232826 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.232812 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 01:06:21.234399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.233920 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zxxpm\"" Jun 10 01:06:21.234399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.234317 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 01:06:21.280308 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.280274 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.291576 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.291762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.291762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.291762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56ef8eea-7591-47a3-be49-bea9c153277d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.291762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.291762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-root\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4qm\" (UniqueName: \"kubernetes.io/projected/56ef8eea-7591-47a3-be49-bea9c153277d-kube-api-access-mg4qm\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrwjv\" (UniqueName: \"kubernetes.io/projected/91164216-6589-4996-91d3-792cd7f2e3fc-kube-api-access-mrwjv\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-textfile\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kpsf\" (UniqueName: \"kubernetes.io/projected/d813335b-31e7-47c2-878e-0a751ab20b43-kube-api-access-7kpsf\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-wtmp\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.291983 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-metrics-client-ca\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.292011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.292055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.292390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.292082 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-sys\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.292098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.292390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.292115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d813335b-31e7-47c2-878e-0a751ab20b43-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.329970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.329938 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.392527 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56ef8eea-7591-47a3-be49-bea9c153277d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-root\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4qm\" (UniqueName: \"kubernetes.io/projected/56ef8eea-7591-47a3-be49-bea9c153277d-kube-api-access-mg4qm\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.392703 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrwjv\" (UniqueName: \"kubernetes.io/projected/91164216-6589-4996-91d3-792cd7f2e3fc-kube-api-access-mrwjv\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.392782 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls podName:91164216-6589-4996-91d3-792cd7f2e3fc nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.89276179 +0000 UTC m=+271.434592283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls") pod "node-exporter-j8h8r" (UID: "91164216-6589-4996-91d3-792cd7f2e3fc") : secret "node-exporter-tls" not found Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-textfile\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpsf\" (UniqueName: \"kubernetes.io/projected/d813335b-31e7-47c2-878e-0a751ab20b43-kube-api-access-7kpsf\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-wtmp\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-metrics-client-ca\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.392984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.392980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393082 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-sys\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-root\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d813335b-31e7-47c2-878e-0a751ab20b43-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.393381 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.393426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.393456 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.393433 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls podName:d813335b-31e7-47c2-878e-0a751ab20b43 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.893407614 +0000 UTC m=+271.435238101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-v6v6x" (UID: "d813335b-31e7-47c2-878e-0a751ab20b43") : secret "kube-state-metrics-tls" not found Jun 10 01:06:21.394193 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d813335b-31e7-47c2-878e-0a751ab20b43-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.394255 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394186 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.394329 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-textfile\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.394384 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-wtmp\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.394434 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.394413 2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 01:06:21.394505 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:21.394484 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls podName:56ef8eea-7591-47a3-be49-bea9c153277d nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.894451844 +0000 UTC m=+271.436282324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-zk9dx" (UID: "56ef8eea-7591-47a3-be49-bea9c153277d") : secret "openshift-state-metrics-tls" not found Jun 10 01:06:21.394570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91164216-6589-4996-91d3-792cd7f2e3fc-sys\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.394777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.394846 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.394786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91164216-6589-4996-91d3-792cd7f2e3fc-metrics-client-ca\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.395312 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.395293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56ef8eea-7591-47a3-be49-bea9c153277d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.397785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.397404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.397785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.397747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.397785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.397771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.405123 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.405079 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrwjv\" (UniqueName: \"kubernetes.io/projected/91164216-6589-4996-91d3-792cd7f2e3fc-kube-api-access-mrwjv\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.405259 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.405209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kpsf\" (UniqueName: \"kubernetes.io/projected/d813335b-31e7-47c2-878e-0a751ab20b43-kube-api-access-7kpsf\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.406259 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.406237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4qm\" (UniqueName: \"kubernetes.io/projected/56ef8eea-7591-47a3-be49-bea9c153277d-kube-api-access-mg4qm\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.438449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.438421 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v9l5j\"" Jun 10 01:06:21.446169 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.446138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" Jun 10 01:06:21.501934 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.501890 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.587644 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.587598 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck"] Jun 10 01:06:21.590109 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.590081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.590669 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:21.590643 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d02afb5_e3fe_4b4e_b964_bde6a01198d3.slice/crio-21e7823288f91322bff97b4c4779050f522f8c6e7131103fb96610f276a6e6bd WatchSource:0}: Error finding container 21e7823288f91322bff97b4c4779050f522f8c6e7131103fb96610f276a6e6bd: Status 404 returned error can't find the container with id 21e7823288f91322bff97b4c4779050f522f8c6e7131103fb96610f276a6e6bd Jun 10 01:06:21.648364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.648331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.675426 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.675400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" event={"ID":"4d02afb5-e3fe-4b4e-b964-bde6a01198d3","Type":"ContainerStarted","Data":"21e7823288f91322bff97b4c4779050f522f8c6e7131103fb96610f276a6e6bd"} Jun 10 01:06:21.748217 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.748186 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.849427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.849348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:21.897919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.897883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:21.898119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.897958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.898119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.898049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.900394 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.900372 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56ef8eea-7591-47a3-be49-bea9c153277d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zk9dx\" (UID: \"56ef8eea-7591-47a3-be49-bea9c153277d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:21.900512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.900420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91164216-6589-4996-91d3-792cd7f2e3fc-node-exporter-tls\") pod \"node-exporter-j8h8r\" (UID: \"91164216-6589-4996-91d3-792cd7f2e3fc\") " pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:21.900512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:21.900493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d813335b-31e7-47c2-878e-0a751ab20b43-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v6v6x\" (UID: \"d813335b-31e7-47c2-878e-0a751ab20b43\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:22.124304 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.124270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" Jun 10 01:06:22.135790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.135760 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" Jun 10 01:06:22.144427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.144401 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j8h8r" Jun 10 01:06:22.158996 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:22.158967 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91164216_6589_4996_91d3_792cd7f2e3fc.slice/crio-d5c760b4a18c33572f0181fdff5b3536ac8549d4aeefaf09922be0d590a65719 WatchSource:0}: Error finding container d5c760b4a18c33572f0181fdff5b3536ac8549d4aeefaf09922be0d590a65719: Status 404 returned error can't find the container with id d5c760b4a18c33572f0181fdff5b3536ac8549d4aeefaf09922be0d590a65719 Jun 10 01:06:22.200548 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.194014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:22.286329 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.286291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:22.288275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.287861 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:06:22.292723 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.292617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.295127 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.294924 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 01:06:22.295243 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.295163 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 01:06:22.296216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.295255 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wnh2v\"" Jun 10 01:06:22.296216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.295297 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 01:06:22.296216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.295520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 01:06:22.296216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.296159 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 01:06:22.296430 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.296358 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 01:06:22.296975 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.296618 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 01:06:22.296975 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.296797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 01:06:22.297103 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.297000 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302757 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7cgf\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.302919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.302806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.309993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.309021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:06:22.316010 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.315984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx"] Jun 10 01:06:22.318108 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:22.318082 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ef8eea_7591_47a3_be49_bea9c153277d.slice/crio-00372637f113b0a753e21e24d528c3f178e79a3be671b8b16e8b9ba3f83bce98 WatchSource:0}: Error finding container 00372637f113b0a753e21e24d528c3f178e79a3be671b8b16e8b9ba3f83bce98: Status 404 returned error can't find the container with id 00372637f113b0a753e21e24d528c3f178e79a3be671b8b16e8b9ba3f83bce98 Jun 10 01:06:22.336755 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.336724 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x"] Jun 10 01:06:22.348070 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:22.347905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd813335b_31e7_47c2_878e_0a751ab20b43.slice/crio-04ec2185ff3a42294a41f5e69b8fba17c16130cdbbbfc93edc2def6bd90267e9 WatchSource:0}: Error finding container 04ec2185ff3a42294a41f5e69b8fba17c16130cdbbbfc93edc2def6bd90267e9: Status 404 returned error can't find the container with id 04ec2185ff3a42294a41f5e69b8fba17c16130cdbbbfc93edc2def6bd90267e9 Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7cgf\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.406512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.407118 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.407118 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.407118 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.406609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.409043 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:22.407404 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle podName:625bf7f2-dd23-43d8-9503-0d22b733c197 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:22.90738101 +0000 UTC m=+272.449211501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197") : configmap references non-existent config key: ca-bundle.crt Jun 10 01:06:22.409043 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.407537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.409043 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:22.408772 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 01:06:22.409043 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:22.408828 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls podName:625bf7f2-dd23-43d8-9503-0d22b733c197 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:22.908810774 +0000 UTC m=+272.450641265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197") : secret "alertmanager-main-tls" not found Jun 10 01:06:22.409043 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.408992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.410326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.410277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.413221 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.413183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.414292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.413913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.414292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.414256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.414867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.414459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.414867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.414777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.414867 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.414813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.416502 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.416437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.417996 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.417803 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7cgf\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.632264 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.632155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:22.682291 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.682254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" event={"ID":"d813335b-31e7-47c2-878e-0a751ab20b43","Type":"ContainerStarted","Data":"04ec2185ff3a42294a41f5e69b8fba17c16130cdbbbfc93edc2def6bd90267e9"} Jun 10 01:06:22.684891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.684844 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8h8r" event={"ID":"91164216-6589-4996-91d3-792cd7f2e3fc","Type":"ContainerStarted","Data":"d5c760b4a18c33572f0181fdff5b3536ac8549d4aeefaf09922be0d590a65719"} Jun 10 01:06:22.687269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.687242 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" event={"ID":"56ef8eea-7591-47a3-be49-bea9c153277d","Type":"ContainerStarted","Data":"cdff94eedfff3f0eabfab00a7dc022a57ada74877cc26c482680dc22a96cfd5c"} Jun 10 01:06:22.687399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.687300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" event={"ID":"56ef8eea-7591-47a3-be49-bea9c153277d","Type":"ContainerStarted","Data":"3eea6db9aafdded2791011d6d69ab5b5e4f7a669fb143ad857a9155590a324d8"} Jun 10 01:06:22.687399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.687321 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" event={"ID":"56ef8eea-7591-47a3-be49-bea9c153277d","Type":"ContainerStarted","Data":"00372637f113b0a753e21e24d528c3f178e79a3be671b8b16e8b9ba3f83bce98"} Jun 10 01:06:22.913380 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.913298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.913592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.913418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.914246 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.914220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:22.915923 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:22.915904 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:23.214046 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.213974 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:06:23.414320 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.414215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:06:23.417741 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:23.417704 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625bf7f2_dd23_43d8_9503_0d22b733c197.slice/crio-1874dcddf3b6f061b1de76fbb72b2a0c4913a4c1c0a3b18d4e54c3d9c157d7bd WatchSource:0}: Error finding container 1874dcddf3b6f061b1de76fbb72b2a0c4913a4c1c0a3b18d4e54c3d9c157d7bd: Status 404 returned error can't find the container with id 1874dcddf3b6f061b1de76fbb72b2a0c4913a4c1c0a3b18d4e54c3d9c157d7bd Jun 10 01:06:23.699458 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.699417 2573 generic.go:356] "Generic (PLEG): container finished" podID="91164216-6589-4996-91d3-792cd7f2e3fc" containerID="6c7e01f66a959c2a2ee9b6c77223018d21a8213a3a808fc8a6846f5efa6e0482" exitCode=0 Jun 10 01:06:23.699659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.699503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8h8r" event={"ID":"91164216-6589-4996-91d3-792cd7f2e3fc","Type":"ContainerDied","Data":"6c7e01f66a959c2a2ee9b6c77223018d21a8213a3a808fc8a6846f5efa6e0482"} Jun 10 01:06:23.701422 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.701393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" event={"ID":"4d02afb5-e3fe-4b4e-b964-bde6a01198d3","Type":"ContainerStarted","Data":"de6f0b7f5a6d5afbbc31391c56f0d84ee58196ed318f9dcc7f25dbf683c4c382"} Jun 10 01:06:23.702616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.702587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"1874dcddf3b6f061b1de76fbb72b2a0c4913a4c1c0a3b18d4e54c3d9c157d7bd"} Jun 10 01:06:23.731236 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.731174 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-hg6ck" podStartSLOduration=33.091145269 podStartE2EDuration="34.731158074s" totalImagesPullingTime="1.640012805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:23.729556539 +0000 UTC m=+273.271387041" watchObservedRunningTime="2026-06-10 01:06:23.731158074 +0000 UTC m=+273.272988575" Jun 10 01:06:23.816732 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.816698 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:23.916498 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:23.916450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:24.142031 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.141978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:24.193436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.193403 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56f75f6c47-clbvt"] Jun 10 01:06:24.196939 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.196916 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.199181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199157 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 01:06:24.199305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199184 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-454dj9p3asm4o\"" Jun 10 01:06:24.199305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 01:06:24.199305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199217 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 01:06:24.199552 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199536 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 01:06:24.199656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 01:06:24.199882 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.199856 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cqrlj\"" Jun 10 01:06:24.207831 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.207808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56f75f6c47-clbvt"] Jun 10 01:06:24.215549 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.215530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:24.224597 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-grpc-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224901 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4z8\" (UniqueName: \"kubernetes.io/projected/73beae1c-8780-4e85-9876-0fd8fb34755f-kube-api-access-4s4z8\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224901 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224994 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224903 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73beae1c-8780-4e85-9876-0fd8fb34755f-metrics-client-ca\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.224994 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.224948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.325923 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.325896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326041 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.325956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326041 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.325976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326041 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-grpc-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326041 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326257 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4z8\" (UniqueName: \"kubernetes.io/projected/73beae1c-8780-4e85-9876-0fd8fb34755f-kube-api-access-4s4z8\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326257 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326257 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73beae1c-8780-4e85-9876-0fd8fb34755f-metrics-client-ca\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.326990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.326969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73beae1c-8780-4e85-9876-0fd8fb34755f-metrics-client-ca\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.329630 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.329451 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.330040 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.329672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.330040 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.329682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-grpc-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.330247 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.330227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.331591 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.331562 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.331742 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.331721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73beae1c-8780-4e85-9876-0fd8fb34755f-secret-thanos-querier-tls\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.335982 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.335944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4z8\" (UniqueName: \"kubernetes.io/projected/73beae1c-8780-4e85-9876-0fd8fb34755f-kube-api-access-4s4z8\") pod \"thanos-querier-56f75f6c47-clbvt\" (UID: \"73beae1c-8780-4e85-9876-0fd8fb34755f\") " pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.416996 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.416932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:24.512597 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.512563 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:24.657631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.657541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:24.685491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.685438 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56f75f6c47-clbvt"] Jun 10 01:06:24.688491 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:24.688449 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73beae1c_8780_4e85_9876_0fd8fb34755f.slice/crio-9add08bf48060f02f1798700c6b17ef1cdf551c094e2b74b9150f66a6048241f WatchSource:0}: Error finding container 9add08bf48060f02f1798700c6b17ef1cdf551c094e2b74b9150f66a6048241f: Status 404 returned error can't find the container with id 9add08bf48060f02f1798700c6b17ef1cdf551c094e2b74b9150f66a6048241f Jun 10 01:06:24.713794 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.713762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8h8r" event={"ID":"91164216-6589-4996-91d3-792cd7f2e3fc","Type":"ContainerStarted","Data":"fa9c887d96c1edb1cce85da4b636a8bc55b19d03b2655450d963613fc1481b6c"} Jun 10 01:06:24.713928 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.713829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8h8r" event={"ID":"91164216-6589-4996-91d3-792cd7f2e3fc","Type":"ContainerStarted","Data":"890ffcba86fcf32fa0f02a7aa3e347e072bdd37f8302611cf2050c658dd11ac3"} Jun 10 01:06:24.715761 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.715682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"9add08bf48060f02f1798700c6b17ef1cdf551c094e2b74b9150f66a6048241f"} Jun 10 01:06:24.718364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.718306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" event={"ID":"d813335b-31e7-47c2-878e-0a751ab20b43","Type":"ContainerStarted","Data":"3c9ee7c360dcc45647aa61b17776c8f8f22bc7fdf31be89aced97f1a8628911d"} Jun 10 01:06:24.718494 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.718367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" event={"ID":"d813335b-31e7-47c2-878e-0a751ab20b43","Type":"ContainerStarted","Data":"6d663aa2d68a9dc570bff1f8e7d9bb26282e2ad87f797a0f0e6e7b3046d4d07b"} Jun 10 01:06:24.718494 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.718401 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" event={"ID":"d813335b-31e7-47c2-878e-0a751ab20b43","Type":"ContainerStarted","Data":"e4e0759e2e05b0ab522244740f74c2532faca6d674cc1019d3347f5bdacc2fc3"} Jun 10 01:06:24.720695 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.720672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" event={"ID":"56ef8eea-7591-47a3-be49-bea9c153277d","Type":"ContainerStarted","Data":"c485bf4bca4dde75c70a1cb151bf96cba5b927a652ced0dde8d7c004948020af"} Jun 10 01:06:24.733085 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.732923 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j8h8r" podStartSLOduration=2.5761400290000003 podStartE2EDuration="3.732901019s" totalImagesPullingTime="1.071693011s" totalInitContainerRuntime="85.067979ms" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:24.731867097 +0000 UTC m=+274.273697599" watchObservedRunningTime="2026-06-10 01:06:24.732901019 +0000 UTC m=+274.274731521" Jun 10 01:06:24.748730 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.748673 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v6v6x" podStartSLOduration=1.8566983989999999 podStartE2EDuration="3.748653605s" totalImagesPullingTime="1.891955206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:24.747677655 +0000 UTC m=+274.289508150" watchObservedRunningTime="2026-06-10 01:06:24.748653605 +0000 UTC m=+274.290484106" Jun 10 01:06:24.764162 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:24.764110 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zk9dx" podStartSLOduration=2.005070553 podStartE2EDuration="3.764094885s" totalImagesPullingTime="1.759024332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:24.762547992 +0000 UTC m=+274.304378485" watchObservedRunningTime="2026-06-10 01:06:24.764094885 +0000 UTC m=+274.305925386" Jun 10 01:06:25.627291 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.627257 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-695779d7fb-j4thh"] Jun 10 01:06:25.631164 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.631127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634661 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634677 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634714 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634724 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8m7f5\"" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634731 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 01:06:25.634899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.634661 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6auqc6edu20ds\"" Jun 10 01:06:25.641125 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.640832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-695779d7fb-j4thh"] Jun 10 01:06:25.730155 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.730123 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0" exitCode=0 Jun 10 01:06:25.730348 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.730274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0"} Jun 10 01:06:25.743067 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-client-certs\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-client-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743541 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743618 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gmt\" (UniqueName: \"kubernetes.io/projected/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-kube-api-access-n2gmt\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-metrics-server-audit-profiles\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743750 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-audit-log\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.743849 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.743831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-tls\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845412 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-client-certs\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845608 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-client-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845737 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845804 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gmt\" (UniqueName: \"kubernetes.io/projected/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-kube-api-access-n2gmt\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845862 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-metrics-server-audit-profiles\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845913 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-audit-log\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.845975 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.845925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-tls\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.846500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.846452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-audit-log\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.846858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.846816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.847087 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.847054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-metrics-server-audit-profiles\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.848540 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.848507 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-client-ca-bundle\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.848968 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.848943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-tls\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.849057 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.849032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-secret-metrics-server-client-certs\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.854382 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.854358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gmt\" (UniqueName: \"kubernetes.io/projected/f82dbdf7-b1ab-4afd-93d3-b3294dad39e6-kube-api-access-n2gmt\") pod \"metrics-server-695779d7fb-j4thh\" (UID: \"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6\") " pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.944644 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.944535 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:25.989580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:25.989546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:26.102007 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:26.101875 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-695779d7fb-j4thh"] Jun 10 01:06:26.189594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:26.189545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:26.561402 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:26.561371 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82dbdf7_b1ab_4afd_93d3_b3294dad39e6.slice/crio-8c2d8bd9eac8663d487c6826b019cbdad146cb4cf4d212b7c07e785d40650414 WatchSource:0}: Error finding container 8c2d8bd9eac8663d487c6826b019cbdad146cb4cf4d212b7c07e785d40650414: Status 404 returned error can't find the container with id 8c2d8bd9eac8663d487c6826b019cbdad146cb4cf4d212b7c07e785d40650414 Jun 10 01:06:26.737002 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:26.736974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" event={"ID":"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6","Type":"ContainerStarted","Data":"8c2d8bd9eac8663d487c6826b019cbdad146cb4cf4d212b7c07e785d40650414"} Jun 10 01:06:26.738861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:26.738836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"bf1441ceec7d1e1174d0054ecb05d1391524f4699df45f71b96be485033c880a"} Jun 10 01:06:26.738947 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:26.738907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"a4fdc08d0ad38dff3384b3bebceb002916250d009b0bace837d0e47002b5d808"} Jun 10 01:06:27.468950 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:27.468655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:27.749400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:27.749317 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"be06d95f65674d77e52cadae10ce95d9ecc60ad71d7b9da8bbd0a4978f42a868"} Jun 10 01:06:28.757938 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.757900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" event={"ID":"f82dbdf7-b1ab-4afd-93d3-b3294dad39e6","Type":"ContainerStarted","Data":"5968707fbc7202456cbe69849b8687fe76f33f0b78814988b2a531c378765ef8"} Jun 10 01:06:28.760741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.760705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf"} Jun 10 01:06:28.760854 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.760789 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce"} Jun 10 01:06:28.760854 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.760830 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe"} Jun 10 01:06:28.763297 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.763277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"460e6740b551c26be69efe7ff5b4e3eaa6e12fcf31f4f8a5941ef7089bf55f38"} Jun 10 01:06:28.763397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.763329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"9806951cf85739626b4373f556b4eee9372ba2673fa54dae411523704a74b7e1"} Jun 10 01:06:28.763397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.763367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" event={"ID":"73beae1c-8780-4e85-9876-0fd8fb34755f","Type":"ContainerStarted","Data":"d108b36834753ece84369c50a78d7622f2f6e79f4a6a2ebe6a5fe7a90ff0cb65"} Jun 10 01:06:28.763538 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.763415 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:28.777363 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.777312 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" podStartSLOduration=1.8627047810000001 podStartE2EDuration="3.777290012s" totalImagesPullingTime="1.914585231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:28.774823353 +0000 UTC m=+278.316653868" watchObservedRunningTime="2026-06-10 01:06:28.777290012 +0000 UTC m=+278.319120513" Jun 10 01:06:28.795413 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:28.794927 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" podStartSLOduration=1.194875224 podStartE2EDuration="4.794902985s" totalImagesPullingTime="3.600027761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:28.793093808 +0000 UTC m=+278.334924309" watchObservedRunningTime="2026-06-10 01:06:28.794902985 +0000 UTC m=+278.336733486" Jun 10 01:06:29.770274 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:29.770236 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3"} Jun 10 01:06:29.770813 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:29.770319 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8"} Jun 10 01:06:29.770813 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:29.770360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerStarted","Data":"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4"} Jun 10 01:06:29.796232 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:29.796167 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.387199702 podStartE2EDuration="7.7961513s" totalImagesPullingTime="4.393558474s" totalInitContainerRuntime="15.393124ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:29.794042419 +0000 UTC m=+279.335872921" watchObservedRunningTime="2026-06-10 01:06:29.7961513 +0000 UTC m=+279.337981835" Jun 10 01:06:31.346584 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:31.346534 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j2mbz" podUID="77209cfa-414b-45ed-bbd8-0834b02c503f" Jun 10 01:06:31.346584 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:31.346535 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" Jun 10 01:06:31.781154 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:31.781124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:31.781154 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:31.781146 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:34.777800 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:34.777774 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56f75f6c47-clbvt" Jun 10 01:06:35.337869 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.337836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:35.338066 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.337937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:35.340242 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.340213 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77209cfa-414b-45ed-bbd8-0834b02c503f-metrics-tls\") pod \"dns-default-j2mbz\" (UID: \"77209cfa-414b-45ed-bbd8-0834b02c503f\") " pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:35.340379 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.340360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"image-registry-678b848b5d-48h6v\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:35.385592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.385187 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:06:35.385592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.385418 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvz7s\"" Jun 10 01:06:35.393069 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.393006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:35.393240 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.393030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:35.554553 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.554527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2mbz"] Jun 10 01:06:35.557565 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:35.557529 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77209cfa_414b_45ed_bbd8_0834b02c503f.slice/crio-c4e31371c974bfc374b1ea4c0206f25744396376c9f0feba8a5c7ba58dc53ffb WatchSource:0}: Error finding container c4e31371c974bfc374b1ea4c0206f25744396376c9f0feba8a5c7ba58dc53ffb: Status 404 returned error can't find the container with id c4e31371c974bfc374b1ea4c0206f25744396376c9f0feba8a5c7ba58dc53ffb Jun 10 01:06:35.579368 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.578798 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:06:35.582083 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:35.582055 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc616df29_8e20_425a_b943_5bf4d25ca117.slice/crio-2b2fafd34824ece61cae95d6c71f1c580acf1ef918af83ee59a6b0cb898c904f WatchSource:0}: Error finding container 2b2fafd34824ece61cae95d6c71f1c580acf1ef918af83ee59a6b0cb898c904f: Status 404 returned error can't find the container with id 2b2fafd34824ece61cae95d6c71f1c580acf1ef918af83ee59a6b0cb898c904f Jun 10 01:06:35.805689 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.805654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" event={"ID":"c616df29-8e20-425a-b943-5bf4d25ca117","Type":"ContainerStarted","Data":"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd"} Jun 10 01:06:35.806178 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.805743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" event={"ID":"c616df29-8e20-425a-b943-5bf4d25ca117","Type":"ContainerStarted","Data":"2b2fafd34824ece61cae95d6c71f1c580acf1ef918af83ee59a6b0cb898c904f"} Jun 10 01:06:35.806178 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.805776 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:35.806909 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.806887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2mbz" event={"ID":"77209cfa-414b-45ed-bbd8-0834b02c503f","Type":"ContainerStarted","Data":"c4e31371c974bfc374b1ea4c0206f25744396376c9f0feba8a5c7ba58dc53ffb"} Jun 10 01:06:35.823522 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:35.823447 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" podStartSLOduration=284.823431969 podStartE2EDuration="4m44.823431969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:35.822176115 +0000 UTC m=+285.364006640" watchObservedRunningTime="2026-06-10 01:06:35.823431969 +0000 UTC m=+285.365262492" Jun 10 01:06:36.107834 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:36.107794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:36.157220 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:36.157183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:37.817953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:37.817870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2mbz" event={"ID":"77209cfa-414b-45ed-bbd8-0834b02c503f","Type":"ContainerStarted","Data":"ff0bb80d36cb7795bd2a070179cce6e5971491b2e38f9fb9bdea1f441bede6c0"} Jun 10 01:06:37.817953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:37.817921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2mbz" event={"ID":"77209cfa-414b-45ed-bbd8-0834b02c503f","Type":"ContainerStarted","Data":"d499a39e0838e821aa5d22a5ffe1b92d61f0800768db6cc566a90f5563376606"} Jun 10 01:06:37.818338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:37.817962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:37.834223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:37.834167 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j2mbz" podStartSLOduration=250.899270954 podStartE2EDuration="4m12.83415255s" totalImagesPullingTime="1.934881596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:37.83231314 +0000 UTC m=+287.374143657" watchObservedRunningTime="2026-06-10 01:06:37.83415255 +0000 UTC m=+287.375983105" Jun 10 01:06:42.453280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:42.453245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:43.407427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:43.407391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:43.516380 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:43.516327 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:43.616892 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:43.616856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:43.917661 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:43.917628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:44.019798 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:44.019758 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:44.121966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:44.121937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:44.325638 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:44.325561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:44.455275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:44.455239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:44.853996 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:06:44.853956 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d7lj7" podUID="d492c48d-0ac1-49c3-9127-caf36e96c576" Jun 10 01:06:45.750312 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:45.750271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:45.806966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:45.806905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:45.945560 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:45.945520 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:45.945945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:45.945613 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:06:47.824631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:47.824595 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j2mbz" Jun 10 01:06:50.819593 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:50.819561 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:06:50.820042 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:50.819883 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:06:50.827970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:50.827949 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 01:06:51.431579 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:51.431540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:51.481392 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:51.481361 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:53.152161 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.152117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:53.158276 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.158248 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:06:53.161693 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.161669 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.164901 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164875 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164877 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164931 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164961 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.165014 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164962 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gdkb\"" Jun 10 01:06:53.165035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.165016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 01:06:53.165298 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.164877 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 01:06:53.170351 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.170259 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:06:53.204127 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.204098 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:53.301683 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.301861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.301861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.301861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9ts\" (UniqueName: \"kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.301970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.301970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.301910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403336 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403336 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403336 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9ts\" (UniqueName: \"kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.403598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.403493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.404140 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.404112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.404140 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.404134 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.404309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.404112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.405958 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.405937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.406044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.405993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.415364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.415340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9ts\" (UniqueName: \"kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts\") pod \"console-58797b7bc4-wfw5x\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.473432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.473387 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:06:53.606896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.606869 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:06:53.609511 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:53.609482 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27713aa4_edfd_407b_b815_92078dc75eb9.slice/crio-c1585696ba58fca58e5c38c9ca75e0bf434d5551b8a3dc08965beb232239a974 WatchSource:0}: Error finding container c1585696ba58fca58e5c38c9ca75e0bf434d5551b8a3dc08965beb232239a974: Status 404 returned error can't find the container with id c1585696ba58fca58e5c38c9ca75e0bf434d5551b8a3dc08965beb232239a974 Jun 10 01:06:53.611707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.611692 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:06:53.891156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:53.891116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58797b7bc4-wfw5x" event={"ID":"27713aa4-edfd-407b-b815-92078dc75eb9","Type":"ContainerStarted","Data":"c1585696ba58fca58e5c38c9ca75e0bf434d5551b8a3dc08965beb232239a974"} Jun 10 01:06:55.398148 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.398098 2573 patch_prober.go:28] interesting pod/image-registry-678b848b5d-48h6v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:55.398623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.398188 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:55.751729 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.751623 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:06:55.754378 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.754353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.761696 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.761671 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 01:06:55.765484 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.765384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:55.765803 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.765782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:06:55.860512 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.860457 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:55.926609 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2bz\" (UniqueName: \"kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:55.926997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:55.926889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.027880 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.027799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.027880 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.027860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.028135 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.027909 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2bz\" (UniqueName: \"kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.028135 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.027982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.028135 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.028007 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.028135 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.028100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.028359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.028134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.029110 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.028823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.029110 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.029049 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.029110 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.029059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.029413 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.029325 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.030817 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.030795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.031048 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.031026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.035965 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.035925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2bz\" (UniqueName: \"kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz\") pod \"console-67b84446c8-k7hsv\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.068094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.068057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:06:56.816760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.816730 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:06:56.969440 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:56.969376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:57.004727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.004703 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:06:57.008031 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:06:57.008004 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b128833_94f1_474f_9a09_327df292c743.slice/crio-1f8e13a6463ef9cedcdeabc9b0bb4e297a0d994b1c543dbf28446e4d5e4f6df6 WatchSource:0}: Error finding container 1f8e13a6463ef9cedcdeabc9b0bb4e297a0d994b1c543dbf28446e4d5e4f6df6: Status 404 returned error can't find the container with id 1f8e13a6463ef9cedcdeabc9b0bb4e297a0d994b1c543dbf28446e4d5e4f6df6 Jun 10 01:06:57.068400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.068347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:57.128966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.128933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:57.183056 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.183026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:57.852922 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.852882 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:06:57.911573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.911538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84446c8-k7hsv" event={"ID":"2b128833-94f1-474f-9a09-327df292c743","Type":"ContainerStarted","Data":"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4"} Jun 10 01:06:57.911766 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.911619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84446c8-k7hsv" event={"ID":"2b128833-94f1-474f-9a09-327df292c743","Type":"ContainerStarted","Data":"1f8e13a6463ef9cedcdeabc9b0bb4e297a0d994b1c543dbf28446e4d5e4f6df6"} Jun 10 01:06:57.918412 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.918380 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58797b7bc4-wfw5x" event={"ID":"27713aa4-edfd-407b-b815-92078dc75eb9","Type":"ContainerStarted","Data":"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b"} Jun 10 01:06:57.929633 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.929581 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b84446c8-k7hsv" podStartSLOduration=2.92956554 podStartE2EDuration="2.92956554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:57.92761346 +0000 UTC m=+307.469443971" watchObservedRunningTime="2026-06-10 01:06:57.92956554 +0000 UTC m=+307.471396041" Jun 10 01:06:57.945648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:57.945607 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58797b7bc4-wfw5x" podStartSLOduration=1.6553376800000001 podStartE2EDuration="4.945592941s" totalImagesPullingTime="3.290255261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:57.943739234 +0000 UTC m=+307.485569736" watchObservedRunningTime="2026-06-10 01:06:57.945592941 +0000 UTC m=+307.487423442" Jun 10 01:06:58.923944 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.923910 2573 generic.go:356] "Generic (PLEG): container finished" podID="274782ea-64f5-45e7-bc84-734ded1a8ae8" containerID="dafaefd2d3428caddf385520c0f6de0ff1456a8fffdcfb0fb4a2c0e1428a65a7" exitCode=0 Jun 10 01:06:58.924406 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.923989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" event={"ID":"274782ea-64f5-45e7-bc84-734ded1a8ae8","Type":"ContainerDied","Data":"dafaefd2d3428caddf385520c0f6de0ff1456a8fffdcfb0fb4a2c0e1428a65a7"} Jun 10 01:06:58.924485 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.924426 2573 scope.go:117] "RemoveContainer" containerID="dafaefd2d3428caddf385520c0f6de0ff1456a8fffdcfb0fb4a2c0e1428a65a7" Jun 10 01:06:58.925733 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.925710 2573 generic.go:356] "Generic (PLEG): container finished" podID="6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2" containerID="602d366f5a1507ad0ce83ebccab358f06d7414949449e22a482abe4fb4a0ce40" exitCode=0 Jun 10 01:06:58.925858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.925794 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" event={"ID":"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2","Type":"ContainerDied","Data":"602d366f5a1507ad0ce83ebccab358f06d7414949449e22a482abe4fb4a0ce40"} Jun 10 01:06:58.926374 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:58.926357 2573 scope.go:117] "RemoveContainer" containerID="602d366f5a1507ad0ce83ebccab358f06d7414949449e22a482abe4fb4a0ce40" Jun 10 01:06:59.560916 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:59.560871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:59.661987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:59.661948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:59.932762 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:59.932732 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-trtp5" event={"ID":"6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2","Type":"ContainerStarted","Data":"f06f249544dea85d697c57deeb716bacf53d468204ef85e06a82f69d5952b74f"} Jun 10 01:06:59.934364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:06:59.934340 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-998d7" event={"ID":"274782ea-64f5-45e7-bc84-734ded1a8ae8","Type":"ContainerStarted","Data":"25cbcaa5351c9fdb69daef0d94a01d07bb01bd97033e9d974b17e144f95c6c84"} Jun 10 01:07:00.550656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:00.550620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:00.648656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:00.648621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:02.839456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:02.839418 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:02.891586 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:02.891551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:03.474534 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:03.474496 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:03.474800 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:03.474565 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:03.479344 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:03.479317 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:03.956124 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:03.956093 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:04.750407 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:04.750369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:05.130281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.130245 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:07:05.202691 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.202660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:05.350061 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.350032 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:05.448807 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.448710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:05.950424 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.950396 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:07:05.954367 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:05.954342 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-695779d7fb-j4thh" Jun 10 01:07:06.068283 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.068250 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:07:06.068460 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.068305 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:07:06.072971 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.072947 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:07:06.557035 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.557001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:06.645495 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.645449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:06.970225 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:06.970195 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:07:07.014967 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:07.014932 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:07:13.996749 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:13.996718 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e683a7c-85d9-4c67-b66f-1e5355f88a4b" containerID="d0cfb7e6013920e649f7cfdc5fcf8a76b90e75eb8ed727553731e1001aa4dc36" exitCode=0 Jun 10 01:07:13.997201 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:13.996791 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5b8jw" event={"ID":"1e683a7c-85d9-4c67-b66f-1e5355f88a4b","Type":"ContainerDied","Data":"d0cfb7e6013920e649f7cfdc5fcf8a76b90e75eb8ed727553731e1001aa4dc36"} Jun 10 01:07:13.997201 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:13.997120 2573 scope.go:117] "RemoveContainer" containerID="d0cfb7e6013920e649f7cfdc5fcf8a76b90e75eb8ed727553731e1001aa4dc36" Jun 10 01:07:14.958326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:14.958273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:15.004850 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:15.004818 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5b8jw" event={"ID":"1e683a7c-85d9-4c67-b66f-1e5355f88a4b","Type":"ContainerStarted","Data":"b0e33a9cd9db4d793c7e195fc1b1b86a49c3493a9c090531910680a9ba541552"} Jun 10 01:07:15.012909 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:15.012874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:15.984106 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:15.984070 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/init-config-reloader/0.log" Jun 10 01:07:16.184665 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:16.184634 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/alertmanager/0.log" Jun 10 01:07:16.383736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:16.383710 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/config-reloader/0.log" Jun 10 01:07:16.584644 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:16.584611 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/kube-rbac-proxy-web/0.log" Jun 10 01:07:16.784568 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:16.784497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/kube-rbac-proxy/0.log" Jun 10 01:07:16.983341 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:16.983315 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/kube-rbac-proxy-metric/0.log" Jun 10 01:07:17.183000 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:17.182976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_625bf7f2-dd23-43d8-9503-0d22b733c197/prom-label-proxy/0.log" Jun 10 01:07:17.384988 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:17.384959 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-kcc4q_7926da5e-90de-4049-bda0-cf59a19507b5/cluster-monitoring-operator/0.log" Jun 10 01:07:17.584038 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:17.583967 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-state-metrics/0.log" Jun 10 01:07:17.783880 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:17.783850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-rbac-proxy-main/0.log" Jun 10 01:07:17.983061 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:17.983030 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-rbac-proxy-self/0.log" Jun 10 01:07:18.184124 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:18.184094 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-695779d7fb-j4thh_f82dbdf7-b1ab-4afd-93d3-b3294dad39e6/metrics-server/0.log" Jun 10 01:07:19.183523 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:19.183492 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/init-textfile/0.log" Jun 10 01:07:19.383740 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:19.383711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/node-exporter/0.log" Jun 10 01:07:19.583082 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:19.583008 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/kube-rbac-proxy/0.log" Jun 10 01:07:20.383435 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:20.383408 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/kube-rbac-proxy-main/0.log" Jun 10 01:07:20.583779 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:20.583743 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/kube-rbac-proxy-self/0.log" Jun 10 01:07:20.783712 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:20.783635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/openshift-state-metrics/0.log" Jun 10 01:07:21.547641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:21.547610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:21.602136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:21.602101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:21.993897 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:21.993864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:22.041641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.041609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:22.145921 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.145889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:22.196449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.196409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:22.384841 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.384810 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-tfrhq_0481f85a-8423-41dc-96a7-518f8ef63424/prometheus-operator/0.log" Jun 10 01:07:22.583953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.583927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-tfrhq_0481f85a-8423-41dc-96a7-518f8ef63424/kube-rbac-proxy/0.log" Jun 10 01:07:22.783509 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.783416 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-d8xct_2ca0a86b-d608-41c4-9cb1-0026595435af/prometheus-operator-admission-webhook/0.log" Jun 10 01:07:22.912572 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.912537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:22.983429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:22.983402 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/thanos-query/0.log" Jun 10 01:07:23.013082 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.013052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:23.060370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.060293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:23.183299 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.183276 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-web/0.log" Jun 10 01:07:23.383573 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.383546 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy/0.log" Jun 10 01:07:23.582953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.582925 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/prom-label-proxy/0.log" Jun 10 01:07:23.783603 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.783519 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-rules/0.log" Jun 10 01:07:23.984496 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:23.984453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-metrics/0.log" Jun 10 01:07:24.183435 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:24.183406 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-hg6ck_4d02afb5-e3fe-4b4e-b964-bde6a01198d3/networking-console-plugin/0.log" Jun 10 01:07:24.783279 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:24.783249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58797b7bc4-wfw5x_27713aa4-edfd-407b-b815-92078dc75eb9/console/0.log" Jun 10 01:07:24.984819 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:24.984791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67b84446c8-k7hsv_2b128833-94f1-474f-9a09-327df292c743/console/0.log" Jun 10 01:07:25.786187 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:25.786161 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jzcvj_e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7/serve-healthcheck-canary/0.log" Jun 10 01:07:30.152193 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:30.151956 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" containerName="registry" containerID="cri-o://78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd" gracePeriod=30 Jun 10 01:07:31.401686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.401652 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:07:31.558806 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558699 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ctzz\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.558806 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558748 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.558806 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558765 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.558806 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558794 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.559120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558928 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.559120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.558972 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.559120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.559019 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.559120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.559045 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca\") pod \"c616df29-8e20-425a-b943-5bf4d25ca117\" (UID: \"c616df29-8e20-425a-b943-5bf4d25ca117\") " Jun 10 01:07:31.559976 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.559851 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:31.562181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.562064 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz" (OuterVolumeSpecName: "kube-api-access-8ctzz") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "kube-api-access-8ctzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:31.562181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.562127 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:31.562392 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.562229 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:31.562392 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.562318 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:31.562529 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.562395 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563066 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-registry-tls\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563090 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-trusted-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563104 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ctzz\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-kube-api-access-8ctzz\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563118 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-installation-pull-secrets\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563136 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c616df29-8e20-425a-b943-5bf4d25ca117-registry-certificates\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563150 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c616df29-8e20-425a-b943-5bf4d25ca117-bound-sa-token\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.567158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.563623 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:31.569830 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.569803 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c616df29-8e20-425a-b943-5bf4d25ca117" (UID: "c616df29-8e20-425a-b943-5bf4d25ca117"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:07:31.663990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.663938 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c616df29-8e20-425a-b943-5bf4d25ca117-image-registry-private-configuration\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:31.663990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:31.663983 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c616df29-8e20-425a-b943-5bf4d25ca117-ca-trust-extracted\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.045213 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.045170 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58797b7bc4-wfw5x" podUID="27713aa4-edfd-407b-b815-92078dc75eb9" containerName="console" containerID="cri-o://232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b" gracePeriod=15 Jun 10 01:07:32.089218 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.089188 2573 generic.go:356] "Generic (PLEG): container finished" podID="c616df29-8e20-425a-b943-5bf4d25ca117" containerID="78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd" exitCode=0 Jun 10 01:07:32.089343 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.089255 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" Jun 10 01:07:32.089343 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.089275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" event={"ID":"c616df29-8e20-425a-b943-5bf4d25ca117","Type":"ContainerDied","Data":"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd"} Jun 10 01:07:32.089343 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.089335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b848b5d-48h6v" event={"ID":"c616df29-8e20-425a-b943-5bf4d25ca117","Type":"ContainerDied","Data":"2b2fafd34824ece61cae95d6c71f1c580acf1ef918af83ee59a6b0cb898c904f"} Jun 10 01:07:32.089446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.089362 2573 scope.go:117] "RemoveContainer" containerID="78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd" Jun 10 01:07:32.140767 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.140740 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:07:32.147241 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.147217 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-678b848b5d-48h6v"] Jun 10 01:07:32.155119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.155101 2573 scope.go:117] "RemoveContainer" containerID="78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd" Jun 10 01:07:32.155417 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:32.155395 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd\": container with ID starting with 78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd not found: ID does not exist" containerID="78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd" Jun 10 01:07:32.155509 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.155425 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd"} err="failed to get container status \"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd\": rpc error: code = NotFound desc = could not find container \"78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd\": container with ID starting with 78f342c93e527ef45516aa9a4dc46329b502723bb43c51c247892f4b4f9ebedd not found: ID does not exist" Jun 10 01:07:32.293364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.293339 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:32.471092 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471056 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp9ts\" (UniqueName: \"kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471103 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471137 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471156 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471194 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471252 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert\") pod \"27713aa4-edfd-407b-b815-92078dc75eb9\" (UID: \"27713aa4-edfd-407b-b815-92078dc75eb9\") " Jun 10 01:07:32.471861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471645 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca" (OuterVolumeSpecName: "service-ca") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:32.471861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471659 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config" (OuterVolumeSpecName: "console-config") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:32.471861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.471696 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:32.473436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.473412 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:32.473557 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.473446 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:32.473557 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.473495 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts" (OuterVolumeSpecName: "kube-api-access-jp9ts") pod "27713aa4-edfd-407b-b815-92078dc75eb9" (UID: "27713aa4-edfd-407b-b815-92078dc75eb9"). InnerVolumeSpecName "kube-api-access-jp9ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:32.572117 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572081 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-oauth-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.572117 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572112 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp9ts\" (UniqueName: \"kubernetes.io/projected/27713aa4-edfd-407b-b815-92078dc75eb9-kube-api-access-jp9ts\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.572117 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572122 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-console-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.572349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572132 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-oauth-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.572349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572142 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27713aa4-edfd-407b-b815-92078dc75eb9-console-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.572349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.572151 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27713aa4-edfd-407b-b815-92078dc75eb9-service-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:32.858894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:32.858863 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" path="/var/lib/kubelet/pods/c616df29-8e20-425a-b943-5bf4d25ca117/volumes" Jun 10 01:07:33.095710 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.095673 2573 generic.go:356] "Generic (PLEG): container finished" podID="27713aa4-edfd-407b-b815-92078dc75eb9" containerID="232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b" exitCode=0 Jun 10 01:07:33.095873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.095725 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58797b7bc4-wfw5x" Jun 10 01:07:33.095873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.095762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58797b7bc4-wfw5x" event={"ID":"27713aa4-edfd-407b-b815-92078dc75eb9","Type":"ContainerDied","Data":"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b"} Jun 10 01:07:33.095873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.095842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58797b7bc4-wfw5x" event={"ID":"27713aa4-edfd-407b-b815-92078dc75eb9","Type":"ContainerDied","Data":"c1585696ba58fca58e5c38c9ca75e0bf434d5551b8a3dc08965beb232239a974"} Jun 10 01:07:33.095873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.095867 2573 scope.go:117] "RemoveContainer" containerID="232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b" Jun 10 01:07:33.103987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.103969 2573 scope.go:117] "RemoveContainer" containerID="232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b" Jun 10 01:07:33.104230 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:33.104209 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b\": container with ID starting with 232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b not found: ID does not exist" containerID="232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b" Jun 10 01:07:33.104309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.104241 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b"} err="failed to get container status \"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b\": rpc error: code = NotFound desc = could not find container \"232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b\": container with ID starting with 232546c0f1887282464f4c86bab2d164bde2b20326ff060e4f12317e6d3eca5b not found: ID does not exist" Jun 10 01:07:33.111993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.111937 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:07:33.113930 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:33.113900 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58797b7bc4-wfw5x"] Jun 10 01:07:34.858354 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:34.858324 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27713aa4-edfd-407b-b815-92078dc75eb9" path="/var/lib/kubelet/pods/27713aa4-edfd-407b-b815-92078dc75eb9/volumes" Jun 10 01:07:36.550962 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:36.550931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:36.602690 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:36.602654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:40.386869 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:40.386830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:40.620037 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:40.619996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:41.456127 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456083 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:41.456648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456525 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="alertmanager" containerID="cri-o://387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" gracePeriod=120 Jun 10 01:07:41.456648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456552 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="prom-label-proxy" containerID="cri-o://eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" gracePeriod=120 Jun 10 01:07:41.456648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456584 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-metric" containerID="cri-o://18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" gracePeriod=120 Jun 10 01:07:41.456648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456607 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="config-reloader" containerID="cri-o://8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" gracePeriod=120 Jun 10 01:07:41.456648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456566 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy" containerID="cri-o://09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" gracePeriod=120 Jun 10 01:07:41.456877 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:41.456580 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-web" containerID="cri-o://b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" gracePeriod=120 Jun 10 01:07:42.144070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144029 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" exitCode=0 Jun 10 01:07:42.144070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144062 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" exitCode=0 Jun 10 01:07:42.144070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144072 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" exitCode=0 Jun 10 01:07:42.144070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144079 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" exitCode=0 Jun 10 01:07:42.144366 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144098 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3"} Jun 10 01:07:42.144366 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144165 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4"} Jun 10 01:07:42.144366 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce"} Jun 10 01:07:42.144366 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.144217 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe"} Jun 10 01:07:42.708359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.708333 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:42.769992 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.769916 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.769992 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.769949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.769992 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.769972 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770002 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770024 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770063 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7cgf\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770092 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770144 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770185 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770209 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770244 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770671 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770295 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.770671 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.770323 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config\") pod \"625bf7f2-dd23-43d8-9503-0d22b733c197\" (UID: \"625bf7f2-dd23-43d8-9503-0d22b733c197\") " Jun 10 01:07:42.772800 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.772763 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:42.773281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773053 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.773397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773309 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.773397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773316 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out" (OuterVolumeSpecName: "config-out") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:07:42.773751 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773615 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:07:42.773751 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773693 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:42.773938 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.773914 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:42.774717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.774681 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.774818 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.774759 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.775654 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.775627 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf" (OuterVolumeSpecName: "kube-api-access-f7cgf") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "kube-api-access-f7cgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:42.775748 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.775706 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume" (OuterVolumeSpecName: "config-volume") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.778859 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.778832 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.808416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.808368 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config" (OuterVolumeSpecName: "web-config") pod "625bf7f2-dd23-43d8-9503-0d22b733c197" (UID: "625bf7f2-dd23-43d8-9503-0d22b733c197"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:42.871993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.871960 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7cgf\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-kube-api-access-f7cgf\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.871993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.871992 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-metrics-client-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872015 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-main-tls\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872033 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-main-db\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872043 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872052 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/625bf7f2-dd23-43d8-9503-0d22b733c197-config-out\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872060 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-config-volume\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872068 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-cluster-tls-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872076 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/625bf7f2-dd23-43d8-9503-0d22b733c197-tls-assets\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872084 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872107 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872128 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/625bf7f2-dd23-43d8-9503-0d22b733c197-web-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:42.872168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:42.872145 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/625bf7f2-dd23-43d8-9503-0d22b733c197-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:07:43.003168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.003131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:43.117862 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.117830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:43.152027 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.151999 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" exitCode=0 Jun 10 01:07:43.152027 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152020 2573 generic.go:356] "Generic (PLEG): container finished" podID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerID="b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" exitCode=0 Jun 10 01:07:43.152446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152076 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.152446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8"} Jun 10 01:07:43.152446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152230 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf"} Jun 10 01:07:43.152446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"625bf7f2-dd23-43d8-9503-0d22b733c197","Type":"ContainerDied","Data":"1874dcddf3b6f061b1de76fbb72b2a0c4913a4c1c0a3b18d4e54c3d9c157d7bd"} Jun 10 01:07:43.152446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.152294 2573 scope.go:117] "RemoveContainer" containerID="eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" Jun 10 01:07:43.160234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.160212 2573 scope.go:117] "RemoveContainer" containerID="18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" Jun 10 01:07:43.167228 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.167210 2573 scope.go:117] "RemoveContainer" containerID="09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" Jun 10 01:07:43.170950 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.170925 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:43.175482 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.175437 2573 scope.go:117] "RemoveContainer" containerID="b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" Jun 10 01:07:43.176651 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.176613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:43.177534 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.177518 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:43.182695 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.182680 2573 scope.go:117] "RemoveContainer" containerID="8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" Jun 10 01:07:43.189911 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.189892 2573 scope.go:117] "RemoveContainer" containerID="387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" Jun 10 01:07:43.197064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.197047 2573 scope.go:117] "RemoveContainer" containerID="87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0" Jun 10 01:07:43.201829 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.201808 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:43.202139 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202126 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202143 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202153 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" containerName="registry" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202159 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" containerName="registry" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202168 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="alertmanager" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202173 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="alertmanager" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202179 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="config-reloader" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202184 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="config-reloader" Jun 10 01:07:43.202194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202194 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27713aa4-edfd-407b-b815-92078dc75eb9" containerName="console" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202200 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="27713aa4-edfd-407b-b815-92078dc75eb9" containerName="console" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202210 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-web" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202218 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-web" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202231 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="prom-label-proxy" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202236 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="prom-label-proxy" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202242 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="init-config-reloader" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202246 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="init-config-reloader" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202254 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-metric" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202260 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-metric" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202310 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="prom-label-proxy" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202319 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c616df29-8e20-425a-b943-5bf4d25ca117" containerName="registry" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202327 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202334 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="27713aa4-edfd-407b-b815-92078dc75eb9" containerName="console" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202339 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-metric" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202344 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="alertmanager" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202349 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="kube-rbac-proxy-web" Jun 10 01:07:43.202416 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.202355 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" containerName="config-reloader" Jun 10 01:07:43.204328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.204257 2573 scope.go:117] "RemoveContainer" containerID="eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" Jun 10 01:07:43.204740 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.204717 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3\": container with ID starting with eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3 not found: ID does not exist" containerID="eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" Jun 10 01:07:43.204814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.204747 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3"} err="failed to get container status \"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3\": rpc error: code = NotFound desc = could not find container \"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3\": container with ID starting with eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3 not found: ID does not exist" Jun 10 01:07:43.204814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.204769 2573 scope.go:117] "RemoveContainer" containerID="18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" Jun 10 01:07:43.205037 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.205018 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8\": container with ID starting with 18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8 not found: ID does not exist" containerID="18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" Jun 10 01:07:43.205095 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205047 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8"} err="failed to get container status \"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8\": rpc error: code = NotFound desc = could not find container \"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8\": container with ID starting with 18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8 not found: ID does not exist" Jun 10 01:07:43.205095 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205069 2573 scope.go:117] "RemoveContainer" containerID="09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" Jun 10 01:07:43.205318 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.205302 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4\": container with ID starting with 09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4 not found: ID does not exist" containerID="09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" Jun 10 01:07:43.205361 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205322 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4"} err="failed to get container status \"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4\": rpc error: code = NotFound desc = could not find container \"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4\": container with ID starting with 09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4 not found: ID does not exist" Jun 10 01:07:43.205361 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205337 2573 scope.go:117] "RemoveContainer" containerID="b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" Jun 10 01:07:43.205541 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.205519 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf\": container with ID starting with b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf not found: ID does not exist" containerID="b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" Jun 10 01:07:43.205598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205548 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf"} err="failed to get container status \"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf\": rpc error: code = NotFound desc = could not find container \"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf\": container with ID starting with b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf not found: ID does not exist" Jun 10 01:07:43.205598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205563 2573 scope.go:117] "RemoveContainer" containerID="8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" Jun 10 01:07:43.205764 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.205750 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce\": container with ID starting with 8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce not found: ID does not exist" containerID="8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" Jun 10 01:07:43.205805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205767 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce"} err="failed to get container status \"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce\": rpc error: code = NotFound desc = could not find container \"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce\": container with ID starting with 8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce not found: ID does not exist" Jun 10 01:07:43.205805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.205779 2573 scope.go:117] "RemoveContainer" containerID="387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" Jun 10 01:07:43.206061 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.206042 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe\": container with ID starting with 387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe not found: ID does not exist" containerID="387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" Jun 10 01:07:43.206153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206066 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe"} err="failed to get container status \"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe\": rpc error: code = NotFound desc = could not find container \"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe\": container with ID starting with 387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe not found: ID does not exist" Jun 10 01:07:43.206153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206084 2573 scope.go:117] "RemoveContainer" containerID="87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0" Jun 10 01:07:43.206375 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:07:43.206341 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0\": container with ID starting with 87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0 not found: ID does not exist" containerID="87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0" Jun 10 01:07:43.206415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206381 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0"} err="failed to get container status \"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0\": rpc error: code = NotFound desc = could not find container \"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0\": container with ID starting with 87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0 not found: ID does not exist" Jun 10 01:07:43.206415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206396 2573 scope.go:117] "RemoveContainer" containerID="eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3" Jun 10 01:07:43.206666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206645 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3"} err="failed to get container status \"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3\": rpc error: code = NotFound desc = could not find container \"eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3\": container with ID starting with eadf7dcd11b232327fd27c8b176e6571090f927f034816f7b77dd05ecf28a9b3 not found: ID does not exist" Jun 10 01:07:43.206666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206665 2573 scope.go:117] "RemoveContainer" containerID="18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8" Jun 10 01:07:43.206926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206902 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8"} err="failed to get container status \"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8\": rpc error: code = NotFound desc = could not find container \"18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8\": container with ID starting with 18c3a586f2bf7ceab2d08b195398fb02a4b8863c61b65d624bbd9eaf23c810f8 not found: ID does not exist" Jun 10 01:07:43.207001 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.206926 2573 scope.go:117] "RemoveContainer" containerID="09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4" Jun 10 01:07:43.207580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207159 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4"} err="failed to get container status \"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4\": rpc error: code = NotFound desc = could not find container \"09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4\": container with ID starting with 09ec54f90c6e40553a1a75dfa2625f0ee30dfd2af60c40716b69f87f6471cbf4 not found: ID does not exist" Jun 10 01:07:43.207580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207185 2573 scope.go:117] "RemoveContainer" containerID="b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf" Jun 10 01:07:43.207580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207393 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf"} err="failed to get container status \"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf\": rpc error: code = NotFound desc = could not find container \"b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf\": container with ID starting with b1fa7bc1f9edae78fc0791534ca327ddefc5cc1c3402a13d245d40178f7d3caf not found: ID does not exist" Jun 10 01:07:43.207580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207411 2573 scope.go:117] "RemoveContainer" containerID="8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce" Jun 10 01:07:43.207807 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207654 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce"} err="failed to get container status \"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce\": rpc error: code = NotFound desc = could not find container \"8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce\": container with ID starting with 8b92248bbc37e9c0e400054891d10825c9d67bc933975bea5e0f1252487940ce not found: ID does not exist" Jun 10 01:07:43.207807 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.207673 2573 scope.go:117] "RemoveContainer" containerID="387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe" Jun 10 01:07:43.208809 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.208288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.208991 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.208951 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe"} err="failed to get container status \"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe\": rpc error: code = NotFound desc = could not find container \"387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe\": container with ID starting with 387d7bdc09b833aff18baec48f3a15c2db6232412ea88c7554a8e4cc92de3fbe not found: ID does not exist" Jun 10 01:07:43.208991 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.208987 2573 scope.go:117] "RemoveContainer" containerID="87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0" Jun 10 01:07:43.209539 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.209511 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0"} err="failed to get container status \"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0\": rpc error: code = NotFound desc = could not find container \"87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0\": container with ID starting with 87ef06b77a8c0c8f9f6dda0a4e788c59fe5db57e3e65d2dee790f55fbad6edb0 not found: ID does not exist" Jun 10 01:07:43.211004 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.210986 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 01:07:43.211086 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.210986 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 01:07:43.211282 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211266 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 01:07:43.211282 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211277 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 01:07:43.211394 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211304 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 01:07:43.211514 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211495 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 01:07:43.211579 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wnh2v\"" Jun 10 01:07:43.211627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211501 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 01:07:43.211627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.211592 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 01:07:43.216368 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.216350 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 01:07:43.220049 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.220022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:43.275623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275644 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-web-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.275836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.276059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-config-out\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.276059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.276059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.276059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.276059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.275962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxgt\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-kube-api-access-6lxgt\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377628 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377628 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377628 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxgt\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-kube-api-access-6lxgt\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-web-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-config-out\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.377902 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.377908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.378392 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.378231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.378781 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.378455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.378909 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.378822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c7e95-c751-4826-bb79-ac19ead8bc63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.380877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.380937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381197 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381074 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381258 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381311 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381311 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381559 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.381559 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.381553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c7e95-c751-4826-bb79-ac19ead8bc63-web-config\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.382720 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.382697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c7e95-c751-4826-bb79-ac19ead8bc63-config-out\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.384626 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.384601 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxgt\" (UniqueName: \"kubernetes.io/projected/825c7e95-c751-4826-bb79-ac19ead8bc63-kube-api-access-6lxgt\") pod \"alertmanager-main-0\" (UID: \"825c7e95-c751-4826-bb79-ac19ead8bc63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.518659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.518613 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:07:43.665122 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:43.665023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:07:43.668422 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:07:43.668392 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825c7e95_c751_4826_bb79_ac19ead8bc63.slice/crio-522b25803580379f3db648b5793921097cf4206e83fda96e893515d6e720c687 WatchSource:0}: Error finding container 522b25803580379f3db648b5793921097cf4206e83fda96e893515d6e720c687: Status 404 returned error can't find the container with id 522b25803580379f3db648b5793921097cf4206e83fda96e893515d6e720c687 Jun 10 01:07:44.162375 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:44.162342 2573 generic.go:356] "Generic (PLEG): container finished" podID="825c7e95-c751-4826-bb79-ac19ead8bc63" containerID="3e4253c2bd64f03113a3e0cb0d604c4d4c83e24f31994e48ecd9e483f1ff4219" exitCode=0 Jun 10 01:07:44.162857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:44.162434 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerDied","Data":"3e4253c2bd64f03113a3e0cb0d604c4d4c83e24f31994e48ecd9e483f1ff4219"} Jun 10 01:07:44.162857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:44.162581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"522b25803580379f3db648b5793921097cf4206e83fda96e893515d6e720c687"} Jun 10 01:07:44.859369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:44.859333 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625bf7f2-dd23-43d8-9503-0d22b733c197" path="/var/lib/kubelet/pods/625bf7f2-dd23-43d8-9503-0d22b733c197/volumes" Jun 10 01:07:45.171497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"f131c3a34326bd92bff3bb3e8bbe8a643b2dd646fdd8434094ad1559f9c96de8"} Jun 10 01:07:45.171497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"e93481d1cc2b0138268d7c1b06dcb83ec267154a782b21f911207155f64dfc5c"} Jun 10 01:07:45.171497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171489 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"5d31bf8920d4cb7d5258ecac7565795df8ca6d9d4f56dde37815fe6769842f19"} Jun 10 01:07:45.171966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"00e277ef3a595f7bb1fb2187cd5698f0a5013508aca534418fdd4b573ef1500f"} Jun 10 01:07:45.171966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171536 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"bc12fcd000449048b34329a5aa1ae983cdaf743e588771cf19ec9df227850a69"} Jun 10 01:07:45.171966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.171559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c7e95-c751-4826-bb79-ac19ead8bc63","Type":"ContainerStarted","Data":"3a7013410e87ea2ac8102d3ac3ca1b37bbd2f4d9fe630d2e97e9dc25a67aa9ae"} Jun 10 01:07:45.196044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.195991 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.181636664 podStartE2EDuration="2.1959726s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.335936ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:45.194141066 +0000 UTC m=+354.735971568" watchObservedRunningTime="2026-06-10 01:07:45.1959726 +0000 UTC m=+354.737803103" Jun 10 01:07:45.481018 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.480915 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7ddd5798c8-7skgq"] Jun 10 01:07:45.485941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.485914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.488209 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488179 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 01:07:45.488209 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488194 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jkg7q\"" Jun 10 01:07:45.488209 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488199 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 01:07:45.488449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 01:07:45.488547 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488531 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 01:07:45.488642 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.488551 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 01:07:45.493631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.493449 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 01:07:45.496190 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.496163 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7ddd5798c8-7skgq"] Jun 10 01:07:45.602449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-federate-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-kube-api-access-l7c6n\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602755 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602801 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-metrics-client-ca\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.602874 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.602847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-serving-certs-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-federate-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-kube-api-access-l7c6n\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-metrics-client-ca\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.703938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-serving-certs-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.704941 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.704794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-serving-certs-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.705155 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.705130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-metrics-client-ca\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.705789 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.705761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.707096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.707068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-telemeter-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.707292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.707268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.707356 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.707310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-secret-telemeter-client\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.707356 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.707268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-federate-client-tls\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.715633 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.715601 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea-kube-api-access-l7c6n\") pod \"telemeter-client-7ddd5798c8-7skgq\" (UID: \"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea\") " pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.798883 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.798795 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" Jun 10 01:07:45.954126 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:45.954093 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7ddd5798c8-7skgq"] Jun 10 01:07:45.957821 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:07:45.957791 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d279fec_2fa7_4eb6_9aa6_f402d0d3c0ea.slice/crio-2f7208e4380c478becd5648d43ba853ac4f55baca07f7d226a7131951cd4ce43 WatchSource:0}: Error finding container 2f7208e4380c478becd5648d43ba853ac4f55baca07f7d226a7131951cd4ce43: Status 404 returned error can't find the container with id 2f7208e4380c478becd5648d43ba853ac4f55baca07f7d226a7131951cd4ce43 Jun 10 01:07:46.177720 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:46.177681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" event={"ID":"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea","Type":"ContainerStarted","Data":"2f7208e4380c478becd5648d43ba853ac4f55baca07f7d226a7131951cd4ce43"} Jun 10 01:07:48.191410 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.191306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" event={"ID":"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea","Type":"ContainerStarted","Data":"7f15699f8100ee50688f624eaaf68bf1e21ab6e89ae2ab8d6f30ba61e02f3a08"} Jun 10 01:07:48.191410 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.191379 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" event={"ID":"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea","Type":"ContainerStarted","Data":"c6ef560920951737bed824d7e8de315e379be40bb9aea83b7d9abaa34241824d"} Jun 10 01:07:48.191410 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.191408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" event={"ID":"2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea","Type":"ContainerStarted","Data":"3fc70e8ed204e57e2db8e6985d38337d8ff5d2c637c33ae747d48736e9f6bd5a"} Jun 10 01:07:48.211852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.211804 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7ddd5798c8-7skgq" podStartSLOduration=1.294016789 podStartE2EDuration="3.211787386s" totalImagesPullingTime="1.917770597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:48.211053275 +0000 UTC m=+357.752883800" watchObservedRunningTime="2026-06-10 01:07:48.211787386 +0000 UTC m=+357.753617914" Jun 10 01:07:48.912727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.912691 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:07:48.916194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.916170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:48.927199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.927156 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:07:48.969168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:48.969117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:49.039526 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgz89\" (UniqueName: \"kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039526 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039772 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039772 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039772 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039931 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.039931 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.039844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.069599 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.069564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:49.140619 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgz89\" (UniqueName: \"kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.140619 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.140879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.140879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.140879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.140879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.141103 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.140889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.141583 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.141555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.141694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.141555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.141694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.141590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.141809 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.141750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.143337 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.143306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.143423 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.143352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.147510 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.147489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgz89\" (UniqueName: \"kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89\") pod \"console-79955fc88f-7nwq4\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.169098 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.169045 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:49.228415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.228377 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:49.356334 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.356181 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:07:49.358690 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:07:49.358663 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9489429f_ec50_4ba1_bcdb_74e19d6cff10.slice/crio-839ab7bd0ea6e31657ee76f53b674ec35465f6f6afe2ec70d9aaa7da39af7eec WatchSource:0}: Error finding container 839ab7bd0ea6e31657ee76f53b674ec35465f6f6afe2ec70d9aaa7da39af7eec: Status 404 returned error can't find the container with id 839ab7bd0ea6e31657ee76f53b674ec35465f6f6afe2ec70d9aaa7da39af7eec Jun 10 01:07:49.712662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.712625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:49.763324 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:49.763292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:50.201441 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:50.201408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955fc88f-7nwq4" event={"ID":"9489429f-ec50-4ba1-bcdb-74e19d6cff10","Type":"ContainerStarted","Data":"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12"} Jun 10 01:07:50.201649 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:50.201456 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955fc88f-7nwq4" event={"ID":"9489429f-ec50-4ba1-bcdb-74e19d6cff10","Type":"ContainerStarted","Data":"839ab7bd0ea6e31657ee76f53b674ec35465f6f6afe2ec70d9aaa7da39af7eec"} Jun 10 01:07:50.218172 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:50.218125 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79955fc88f-7nwq4" podStartSLOduration=2.218108822 podStartE2EDuration="2.218108822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:50.216900687 +0000 UTC m=+359.758731186" watchObservedRunningTime="2026-06-10 01:07:50.218108822 +0000 UTC m=+359.759939343" Jun 10 01:07:51.547759 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:51.547725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:51.603194 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:51.603161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:59.229007 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.228972 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:59.229527 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.229050 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:59.233912 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.233891 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:59.245870 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.245844 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:07:59.297970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.297939 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:07:59.386350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.386314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:59.436596 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.436561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:59.488098 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.488012 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:59.538221 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:07:59.538183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:04.784084 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:04.784048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:08:04.786317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:04.786296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d492c48d-0ac1-49c3-9127-caf36e96c576-metrics-certs\") pod \"network-metrics-daemon-d7lj7\" (UID: \"d492c48d-0ac1-49c3-9127-caf36e96c576\") " pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:08:05.057157 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:05.057066 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:08:05.064790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:05.064765 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7lj7" Jun 10 01:08:05.192826 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:05.192799 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7lj7"] Jun 10 01:08:05.194604 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:08:05.194574 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd492c48d_0ac1_49c3_9127_caf36e96c576.slice/crio-0c0ca2055f160a6084e87d309accbf517f48ee14602d797207eb643f5d002bb1 WatchSource:0}: Error finding container 0c0ca2055f160a6084e87d309accbf517f48ee14602d797207eb643f5d002bb1: Status 404 returned error can't find the container with id 0c0ca2055f160a6084e87d309accbf517f48ee14602d797207eb643f5d002bb1 Jun 10 01:08:05.270409 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:05.270370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7lj7" event={"ID":"d492c48d-0ac1-49c3-9127-caf36e96c576","Type":"ContainerStarted","Data":"0c0ca2055f160a6084e87d309accbf517f48ee14602d797207eb643f5d002bb1"} Jun 10 01:08:06.278681 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.278643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7lj7" event={"ID":"d492c48d-0ac1-49c3-9127-caf36e96c576","Type":"ContainerStarted","Data":"e941d070d7ddc5e889c7b9f76a705bbf03c5e95964bf8401909582cda94ac0ef"} Jun 10 01:08:06.279072 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.278701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7lj7" event={"ID":"d492c48d-0ac1-49c3-9127-caf36e96c576","Type":"ContainerStarted","Data":"18b6541935d00ddfba66c7df729e29509e064f51da43bae525ef5171714ae04b"} Jun 10 01:08:06.294587 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.294488 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d7lj7" podStartSLOduration=375.457868077 podStartE2EDuration="6m16.294451634s" totalImagesPullingTime="836.583557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:06.293673278 +0000 UTC m=+375.835503778" watchObservedRunningTime="2026-06-10 01:08:06.294451634 +0000 UTC m=+375.836282136" Jun 10 01:08:06.385551 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.385511 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:06.448912 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.448875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:06.553186 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.553105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:06.619280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:06.619250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:07.007855 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:07.007821 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:07.069046 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:07.069010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:24.319991 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.319949 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67b84446c8-k7hsv" podUID="2b128833-94f1-474f-9a09-327df292c743" containerName="console" containerID="cri-o://5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4" gracePeriod=15 Jun 10 01:08:24.565177 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.565149 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:08:24.658017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.657981 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658018 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658037 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658074 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658094 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658136 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl2bz\" (UniqueName: \"kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658158 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config\") pod \"2b128833-94f1-474f-9a09-327df292c743\" (UID: \"2b128833-94f1-474f-9a09-327df292c743\") " Jun 10 01:08:24.658629 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658596 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:08:24.658742 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658711 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:08:24.658805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658718 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config" (OuterVolumeSpecName: "console-config") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:08:24.658860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.658815 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:08:24.660269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.660228 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:08:24.660417 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.660334 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz" (OuterVolumeSpecName: "kube-api-access-hl2bz") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "kube-api-access-hl2bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:08:24.660417 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.660380 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b128833-94f1-474f-9a09-327df292c743" (UID: "2b128833-94f1-474f-9a09-327df292c743"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:08:24.759074 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759033 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759074 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759069 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-oauth-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759074 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759079 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl2bz\" (UniqueName: \"kubernetes.io/projected/2b128833-94f1-474f-9a09-327df292c743-kube-api-access-hl2bz\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759089 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-console-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759098 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b128833-94f1-474f-9a09-327df292c743-console-oauth-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759107 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-service-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:24.759319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:24.759119 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b128833-94f1-474f-9a09-327df292c743-trusted-ca-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:08:25.367288 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.367248 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b128833-94f1-474f-9a09-327df292c743" containerID="5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4" exitCode=0 Jun 10 01:08:25.367732 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.367300 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84446c8-k7hsv" Jun 10 01:08:25.367732 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.367314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84446c8-k7hsv" event={"ID":"2b128833-94f1-474f-9a09-327df292c743","Type":"ContainerDied","Data":"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4"} Jun 10 01:08:25.367732 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.367364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84446c8-k7hsv" event={"ID":"2b128833-94f1-474f-9a09-327df292c743","Type":"ContainerDied","Data":"1f8e13a6463ef9cedcdeabc9b0bb4e297a0d994b1c543dbf28446e4d5e4f6df6"} Jun 10 01:08:25.367732 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.367392 2573 scope.go:117] "RemoveContainer" containerID="5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4" Jun 10 01:08:25.375551 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.375530 2573 scope.go:117] "RemoveContainer" containerID="5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4" Jun 10 01:08:25.375795 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:08:25.375778 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4\": container with ID starting with 5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4 not found: ID does not exist" containerID="5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4" Jun 10 01:08:25.375843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.375804 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4"} err="failed to get container status \"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4\": rpc error: code = NotFound desc = could not find container \"5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4\": container with ID starting with 5d4b7c54f9e8549239e285df80d910e86450528379e5b2a947bf725f0736abe4 not found: ID does not exist" Jun 10 01:08:25.383199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.383172 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:08:25.386356 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:25.386332 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b84446c8-k7hsv"] Jun 10 01:08:26.859120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:26.859083 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b128833-94f1-474f-9a09-327df292c743" path="/var/lib/kubelet/pods/2b128833-94f1-474f-9a09-327df292c743/volumes" Jun 10 01:08:45.169583 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:45.169551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:45.224729 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:45.224686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:55.627663 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:55.627627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:55.695777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:08:55.695745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:07.509562 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:07.509487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:07.610358 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:07.610324 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:21.558865 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:21.558831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:21.659943 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:21.659905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:21.864905 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:21.864855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:25.140653 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.140618 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:09:25.141030 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.140978 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b128833-94f1-474f-9a09-327df292c743" containerName="console" Jun 10 01:09:25.141030 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.140990 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b128833-94f1-474f-9a09-327df292c743" containerName="console" Jun 10 01:09:25.141108 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.141044 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b128833-94f1-474f-9a09-327df292c743" containerName="console" Jun 10 01:09:25.144339 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.144317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.158676 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.158649 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:09:25.183895 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.183860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.183912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.183957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.183989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.184007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.184036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.184076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.184051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88ws\" (UniqueName: \"kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.199955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.199925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:25.285233 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88ws\" (UniqueName: \"kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.285444 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.285386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.286076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.286046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.286189 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.286131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.286189 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.286083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.286281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.286257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.287852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.287825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.287852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.287853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.293962 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.293938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88ws\" (UniqueName: \"kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws\") pod \"console-b6544d4b5-fqd2j\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.316677 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.316636 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:25.382777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.382736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:25.454537 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.454392 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:25.614625 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.614600 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:09:25.617373 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:09:25.617341 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bf7f65_7a33_4c06_83a5_52fc07b8f8c7.slice/crio-f1e27e29711cc29baf5f9791fc0c4314a6431ef8f86ebdf667e4cac2d1cbc15e WatchSource:0}: Error finding container f1e27e29711cc29baf5f9791fc0c4314a6431ef8f86ebdf667e4cac2d1cbc15e: Status 404 returned error can't find the container with id f1e27e29711cc29baf5f9791fc0c4314a6431ef8f86ebdf667e4cac2d1cbc15e Jun 10 01:09:25.648172 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.648127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6544d4b5-fqd2j" event={"ID":"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7","Type":"ContainerStarted","Data":"f1e27e29711cc29baf5f9791fc0c4314a6431ef8f86ebdf667e4cac2d1cbc15e"} Jun 10 01:09:25.940714 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:25.940670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:26.073289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:26.073258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:26.654260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:26.654210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6544d4b5-fqd2j" event={"ID":"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7","Type":"ContainerStarted","Data":"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6"} Jun 10 01:09:26.677389 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:26.677341 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6544d4b5-fqd2j" podStartSLOduration=1.677323935 podStartE2EDuration="1.677323935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:26.67700147 +0000 UTC m=+456.218831981" watchObservedRunningTime="2026-06-10 01:09:26.677323935 +0000 UTC m=+456.219154468" Jun 10 01:09:35.454939 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.454895 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:35.455352 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.454966 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:35.459855 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.459829 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:35.700758 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.700725 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:09:35.807369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.807289 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:09:35.947630 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:35.947597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:36.047736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:36.047684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:36.113433 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:36.113399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:57.362083 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:09:57.362044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:00.363597 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.363565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:00.458179 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.458137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:00.826693 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.826604 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79955fc88f-7nwq4" podUID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" containerName="console" containerID="cri-o://e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12" gracePeriod=15 Jun 10 01:10:00.916640 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.916607 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g"] Jun 10 01:10:00.920170 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.920137 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:00.922585 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.922562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:10:00.922713 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.922572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:10:00.922930 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.922912 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:10:00.928109 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:00.927873 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g"] Jun 10 01:10:01.006145 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.006114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.006295 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.006190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lzs\" (UniqueName: \"kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.006295 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.006218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.081024 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.080961 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:10:01.106669 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106637 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.106814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106684 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.106814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106708 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.106814 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106744 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.106966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106833 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.107023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106962 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgz89\" (UniqueName: \"kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.107023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.106981 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca" (OuterVolumeSpecName: "service-ca") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:10:01.107023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107009 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config\") pod \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\" (UID: \"9489429f-ec50-4ba1-bcdb-74e19d6cff10\") " Jun 10 01:10:01.107173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107146 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:10:01.107173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107158 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:10:01.107173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.107330 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107248 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config" (OuterVolumeSpecName: "console-config") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:10:01.107330 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lzs\" (UniqueName: \"kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.107330 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.107490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107440 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.107490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107457 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-service-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.107592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107503 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-oauth-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.107592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107517 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9489429f-ec50-4ba1-bcdb-74e19d6cff10-trusted-ca-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.107592 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.107739 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.107686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.109800 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.109778 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:10:01.109894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.109795 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:10:01.109894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.109797 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89" (OuterVolumeSpecName: "kube-api-access-qgz89") pod "9489429f-ec50-4ba1-bcdb-74e19d6cff10" (UID: "9489429f-ec50-4ba1-bcdb-74e19d6cff10"). InnerVolumeSpecName "kube-api-access-qgz89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:01.116555 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.116532 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lzs\" (UniqueName: \"kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.208736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.208697 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgz89\" (UniqueName: \"kubernetes.io/projected/9489429f-ec50-4ba1-bcdb-74e19d6cff10-kube-api-access-qgz89\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.208736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.208730 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-oauth-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.208736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.208741 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9489429f-ec50-4ba1-bcdb-74e19d6cff10-console-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:01.231449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.231421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:01.365769 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.365739 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g"] Jun 10 01:10:01.367848 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:01.367817 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178df946_3879_4142_9ccd_7952a04c1b9d.slice/crio-5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7 WatchSource:0}: Error finding container 5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7: Status 404 returned error can't find the container with id 5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7 Jun 10 01:10:01.814389 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.814297 2573 generic.go:356] "Generic (PLEG): container finished" podID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" containerID="e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12" exitCode=0 Jun 10 01:10:01.814389 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.814346 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79955fc88f-7nwq4" Jun 10 01:10:01.814631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.814401 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955fc88f-7nwq4" event={"ID":"9489429f-ec50-4ba1-bcdb-74e19d6cff10","Type":"ContainerDied","Data":"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12"} Jun 10 01:10:01.814631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.814452 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79955fc88f-7nwq4" event={"ID":"9489429f-ec50-4ba1-bcdb-74e19d6cff10","Type":"ContainerDied","Data":"839ab7bd0ea6e31657ee76f53b674ec35465f6f6afe2ec70d9aaa7da39af7eec"} Jun 10 01:10:01.815541 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.814498 2573 scope.go:117] "RemoveContainer" containerID="e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12" Jun 10 01:10:01.815653 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.815625 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerStarted","Data":"5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7"} Jun 10 01:10:01.824341 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.824325 2573 scope.go:117] "RemoveContainer" containerID="e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12" Jun 10 01:10:01.824637 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:10:01.824618 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12\": container with ID starting with e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12 not found: ID does not exist" containerID="e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12" Jun 10 01:10:01.824689 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.824645 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12"} err="failed to get container status \"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12\": rpc error: code = NotFound desc = could not find container \"e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12\": container with ID starting with e79addf3d8041bff090ea072a48a52e0b361647c7689c5abb8136ab8cb82ff12 not found: ID does not exist" Jun 10 01:10:01.837523 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.837494 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:10:01.839974 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:01.839949 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79955fc88f-7nwq4"] Jun 10 01:10:02.860744 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:02.860706 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" path="/var/lib/kubelet/pods/9489429f-ec50-4ba1-bcdb-74e19d6cff10/volumes" Jun 10 01:10:06.974322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:06.974283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:08.855952 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:08.855917 2573 generic.go:356] "Generic (PLEG): container finished" podID="178df946-3879-4142-9ccd-7952a04c1b9d" containerID="470a2c298765c156915b0b5faf09b8998be12435ffb1ca4eb09c4926e08555b8" exitCode=0 Jun 10 01:10:08.858675 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:08.858647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerDied","Data":"470a2c298765c156915b0b5faf09b8998be12435ffb1ca4eb09c4926e08555b8"} Jun 10 01:10:13.883324 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:13.883286 2573 generic.go:356] "Generic (PLEG): container finished" podID="178df946-3879-4142-9ccd-7952a04c1b9d" containerID="bf850939622c1630ec67712a500ce7db92d9c54bfe3dcca584fd80ea6468893f" exitCode=0 Jun 10 01:10:13.883746 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:13.883337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerDied","Data":"bf850939622c1630ec67712a500ce7db92d9c54bfe3dcca584fd80ea6468893f"} Jun 10 01:10:20.923439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:20.923404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerStarted","Data":"0e4f8ac4a5407cd93e8cea8666812db65a49a68b6227f3e5eb2bdcc1c15783a2"} Jun 10 01:10:20.939858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:20.939807 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" podStartSLOduration=2.611449054 podStartE2EDuration="20.939785221s" totalImagesPullingTime="18.328336167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:20.939100137 +0000 UTC m=+510.480930679" watchObservedRunningTime="2026-06-10 01:10:20.939785221 +0000 UTC m=+510.481615719" Jun 10 01:10:21.930378 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:21.930342 2573 generic.go:356] "Generic (PLEG): container finished" podID="178df946-3879-4142-9ccd-7952a04c1b9d" containerID="0e4f8ac4a5407cd93e8cea8666812db65a49a68b6227f3e5eb2bdcc1c15783a2" exitCode=0 Jun 10 01:10:21.930793 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:21.930403 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerDied","Data":"0e4f8ac4a5407cd93e8cea8666812db65a49a68b6227f3e5eb2bdcc1c15783a2"} Jun 10 01:10:23.105894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.105856 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:23.204582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.204493 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle\") pod \"178df946-3879-4142-9ccd-7952a04c1b9d\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " Jun 10 01:10:23.204582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.204536 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55lzs\" (UniqueName: \"kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs\") pod \"178df946-3879-4142-9ccd-7952a04c1b9d\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " Jun 10 01:10:23.204582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.204555 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util\") pod \"178df946-3879-4142-9ccd-7952a04c1b9d\" (UID: \"178df946-3879-4142-9ccd-7952a04c1b9d\") " Jun 10 01:10:23.205167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.205138 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle" (OuterVolumeSpecName: "bundle") pod "178df946-3879-4142-9ccd-7952a04c1b9d" (UID: "178df946-3879-4142-9ccd-7952a04c1b9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:23.206731 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.206702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs" (OuterVolumeSpecName: "kube-api-access-55lzs") pod "178df946-3879-4142-9ccd-7952a04c1b9d" (UID: "178df946-3879-4142-9ccd-7952a04c1b9d"). InnerVolumeSpecName "kube-api-access-55lzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:23.209355 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.209327 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util" (OuterVolumeSpecName: "util") pod "178df946-3879-4142-9ccd-7952a04c1b9d" (UID: "178df946-3879-4142-9ccd-7952a04c1b9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:23.305348 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.305308 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:23.305348 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.305342 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55lzs\" (UniqueName: \"kubernetes.io/projected/178df946-3879-4142-9ccd-7952a04c1b9d-kube-api-access-55lzs\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:23.305348 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.305353 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178df946-3879-4142-9ccd-7952a04c1b9d-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:23.941918 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.941885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" event={"ID":"178df946-3879-4142-9ccd-7952a04c1b9d","Type":"ContainerDied","Data":"5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7"} Jun 10 01:10:23.942060 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.941923 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5jl5g" Jun 10 01:10:23.942060 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:23.941933 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5abba48563f0ede1f662e545af5e6a44d099b12158a583dd9fe8f9d819d173b7" Jun 10 01:10:26.924899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:26.924862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:27.700075 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:27.700041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:28.844431 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844396 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq"] Jun 10 01:10:28.844848 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844833 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="util" Jun 10 01:10:28.844848 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844849 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="util" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844868 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="extract" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844873 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="extract" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844883 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" containerName="console" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844888 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" containerName="console" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844895 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="pull" Jun 10 01:10:28.844927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844903 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="pull" Jun 10 01:10:28.845101 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.844995 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9489429f-ec50-4ba1-bcdb-74e19d6cff10" containerName="console" Jun 10 01:10:28.845101 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.845008 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="178df946-3879-4142-9ccd-7952a04c1b9d" containerName="extract" Jun 10 01:10:28.847371 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.847352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:28.850370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.850341 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:10:28.850594 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.850570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-57ssn\"" Jun 10 01:10:28.850768 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.850498 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 01:10:28.863020 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.862992 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq"] Jun 10 01:10:28.958694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.958650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmzj\" (UniqueName: \"kubernetes.io/projected/7c8f533d-1627-448f-a84d-fdb5ba1972b5-kube-api-access-flmzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:28.958875 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:28.958718 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c8f533d-1627-448f-a84d-fdb5ba1972b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.059351 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.059314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmzj\" (UniqueName: \"kubernetes.io/projected/7c8f533d-1627-448f-a84d-fdb5ba1972b5-kube-api-access-flmzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.059561 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.059385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c8f533d-1627-448f-a84d-fdb5ba1972b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.059756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.059735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c8f533d-1627-448f-a84d-fdb5ba1972b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.068096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.068077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmzj\" (UniqueName: \"kubernetes.io/projected/7c8f533d-1627-448f-a84d-fdb5ba1972b5-kube-api-access-flmzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k5zzq\" (UID: \"7c8f533d-1627-448f-a84d-fdb5ba1972b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.164783 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.164747 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" Jun 10 01:10:29.303236 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.303211 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq"] Jun 10 01:10:29.305995 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:29.305965 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8f533d_1627_448f_a84d_fdb5ba1972b5.slice/crio-9a70f0835fa2df651e2d4ffdfe56df764c75a632eab6416c86d0a3dca99f6c93 WatchSource:0}: Error finding container 9a70f0835fa2df651e2d4ffdfe56df764c75a632eab6416c86d0a3dca99f6c93: Status 404 returned error can't find the container with id 9a70f0835fa2df651e2d4ffdfe56df764c75a632eab6416c86d0a3dca99f6c93 Jun 10 01:10:29.970076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:29.970038 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" event={"ID":"7c8f533d-1627-448f-a84d-fdb5ba1972b5","Type":"ContainerStarted","Data":"9a70f0835fa2df651e2d4ffdfe56df764c75a632eab6416c86d0a3dca99f6c93"} Jun 10 01:10:30.506281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:30.506245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:30.618167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:30.618125 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:32.680937 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:32.680905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:32.782717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:32.782683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:32.986095 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:32.985995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" event={"ID":"7c8f533d-1627-448f-a84d-fdb5ba1972b5","Type":"ContainerStarted","Data":"7ae0dfe00dc27563a8a4d7464f75a4ac11d432c22787d9a98f6ba1ee6f8a2b58"} Jun 10 01:10:33.005894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.005830 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k5zzq" podStartSLOduration=2.393667771 podStartE2EDuration="5.005815816s" totalImagesPullingTime="2.612148045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:33.004881852 +0000 UTC m=+522.546712350" watchObservedRunningTime="2026-06-10 01:10:33.005815816 +0000 UTC m=+522.547646317" Jun 10 01:10:33.397339 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.397306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:33.523199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.523163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:33.576380 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.576346 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2"] Jun 10 01:10:33.579881 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.579865 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.582195 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.582168 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:10:33.582326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.582310 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:10:33.583070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.583054 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:10:33.590918 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.590895 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2"] Jun 10 01:10:33.704044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.703948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.704044 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.703992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bcr\" (UniqueName: \"kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.704499 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.704066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.805623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.805578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.805623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.805626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bcr\" (UniqueName: \"kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.805852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.805676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.805999 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.805976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.806085 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.806064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.813239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.813211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bcr\" (UniqueName: \"kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:33.889515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:33.889452 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:34.021326 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:34.021301 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2"] Jun 10 01:10:34.023041 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:34.023013 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8cd158_eb97_4655_bd6d_d03643a11245.slice/crio-2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1 WatchSource:0}: Error finding container 2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1: Status 404 returned error can't find the container with id 2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1 Jun 10 01:10:34.997505 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:34.997431 2573 generic.go:356] "Generic (PLEG): container finished" podID="df8cd158-eb97-4655-bd6d-d03643a11245" containerID="e0fbbb4bc252a006c64e72fa09a332e2174e463fd1fc60469b69a9aec7d62d66" exitCode=0 Jun 10 01:10:34.997880 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:34.997501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" event={"ID":"df8cd158-eb97-4655-bd6d-d03643a11245","Type":"ContainerDied","Data":"e0fbbb4bc252a006c64e72fa09a332e2174e463fd1fc60469b69a9aec7d62d66"} Jun 10 01:10:34.997880 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:34.997559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" event={"ID":"df8cd158-eb97-4655-bd6d-d03643a11245","Type":"ContainerStarted","Data":"2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1"} Jun 10 01:10:35.368894 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.368860 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xsst"] Jun 10 01:10:35.372372 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.372350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.374517 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.374486 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 01:10:35.374661 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.374533 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v6sgb\"" Jun 10 01:10:35.374661 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.374533 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 01:10:35.381404 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.381383 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xsst"] Jun 10 01:10:35.522506 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.522434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmz7t\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-kube-api-access-kmz7t\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.522704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.522541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.623958 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.623856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmz7t\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-kube-api-access-kmz7t\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.623958 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.623901 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.632003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.631971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.632427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.632406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmz7t\" (UniqueName: \"kubernetes.io/projected/cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9-kube-api-access-kmz7t\") pod \"cert-manager-webhook-7dc76cbb94-7xsst\" (UID: \"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.695716 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.695673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:35.824676 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.824620 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xsst"] Jun 10 01:10:35.826982 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:35.826955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb612a1c_2eb7_43c4_b941_ae6d7cafbeb9.slice/crio-a9e0d360d8cba7775bfc95d888da9d365b930e5bfc8f3a0d4e9f59b231b6ec0b WatchSource:0}: Error finding container a9e0d360d8cba7775bfc95d888da9d365b930e5bfc8f3a0d4e9f59b231b6ec0b: Status 404 returned error can't find the container with id a9e0d360d8cba7775bfc95d888da9d365b930e5bfc8f3a0d4e9f59b231b6ec0b Jun 10 01:10:35.990960 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:35.990879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:36.003738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:36.003706 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" event={"ID":"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9","Type":"ContainerStarted","Data":"a9e0d360d8cba7775bfc95d888da9d365b930e5bfc8f3a0d4e9f59b231b6ec0b"} Jun 10 01:10:36.579430 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:36.579402 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:37.291938 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:37.291903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:37.393838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:37.393803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:38.017773 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:38.017741 2573 generic.go:356] "Generic (PLEG): container finished" podID="df8cd158-eb97-4655-bd6d-d03643a11245" containerID="46368e4ae773eb85e2f6456874742724c49937df5a60bffbae271ec80be30c85" exitCode=0 Jun 10 01:10:38.017953 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:38.017901 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" event={"ID":"df8cd158-eb97-4655-bd6d-d03643a11245","Type":"ContainerDied","Data":"46368e4ae773eb85e2f6456874742724c49937df5a60bffbae271ec80be30c85"} Jun 10 01:10:39.027074 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:39.027039 2573 generic.go:356] "Generic (PLEG): container finished" podID="df8cd158-eb97-4655-bd6d-d03643a11245" containerID="775f9b35acacda83853d7d4f58f29ebac7e582c5c633ed299f5f2cd203749aaa" exitCode=0 Jun 10 01:10:39.027551 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:39.027133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" event={"ID":"df8cd158-eb97-4655-bd6d-d03643a11245","Type":"ContainerDied","Data":"775f9b35acacda83853d7d4f58f29ebac7e582c5c633ed299f5f2cd203749aaa"} Jun 10 01:10:40.034203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.034104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" event={"ID":"cb612a1c-2eb7-43c4-b941-ae6d7cafbeb9","Type":"ContainerStarted","Data":"cfef136d34a97c2a6cfa966ebc4fd6fb08f12951bebb964e79a0905a4e92cd3d"} Jun 10 01:10:40.034586 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.034299 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:40.050921 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.050866 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" podStartSLOduration=1.186073339 podStartE2EDuration="5.050849443s" totalImagesPullingTime="3.864776104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:40.048771629 +0000 UTC m=+529.590602130" watchObservedRunningTime="2026-06-10 01:10:40.050849443 +0000 UTC m=+529.592679944" Jun 10 01:10:40.161836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.161809 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:40.265282 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.265241 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2bcr\" (UniqueName: \"kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr\") pod \"df8cd158-eb97-4655-bd6d-d03643a11245\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " Jun 10 01:10:40.265437 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.265299 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util\") pod \"df8cd158-eb97-4655-bd6d-d03643a11245\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " Jun 10 01:10:40.265437 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.265358 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle\") pod \"df8cd158-eb97-4655-bd6d-d03643a11245\" (UID: \"df8cd158-eb97-4655-bd6d-d03643a11245\") " Jun 10 01:10:40.265841 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.265806 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle" (OuterVolumeSpecName: "bundle") pod "df8cd158-eb97-4655-bd6d-d03643a11245" (UID: "df8cd158-eb97-4655-bd6d-d03643a11245"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:40.267493 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.267433 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr" (OuterVolumeSpecName: "kube-api-access-d2bcr") pod "df8cd158-eb97-4655-bd6d-d03643a11245" (UID: "df8cd158-eb97-4655-bd6d-d03643a11245"). InnerVolumeSpecName "kube-api-access-d2bcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:40.269756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.269731 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util" (OuterVolumeSpecName: "util") pod "df8cd158-eb97-4655-bd6d-d03643a11245" (UID: "df8cd158-eb97-4655-bd6d-d03643a11245"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:40.366607 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.366571 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2bcr\" (UniqueName: \"kubernetes.io/projected/df8cd158-eb97-4655-bd6d-d03643a11245-kube-api-access-d2bcr\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:40.366607 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.366605 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:40.366797 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:40.366616 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df8cd158-eb97-4655-bd6d-d03643a11245-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:41.040748 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:41.040717 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" Jun 10 01:10:41.041134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:41.040748 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94lp2" event={"ID":"df8cd158-eb97-4655-bd6d-d03643a11245","Type":"ContainerDied","Data":"2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1"} Jun 10 01:10:41.041134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:41.040794 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7f101346654166c746b37595619e847722be37ee9f6b477155c40273f0e0a1" Jun 10 01:10:41.501598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:41.501545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:41.601702 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:41.601660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:44.383133 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:44.383096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:45.449881 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.449846 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-bvr5c"] Jun 10 01:10:45.450256 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450222 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="pull" Jun 10 01:10:45.450256 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450234 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="pull" Jun 10 01:10:45.450332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450260 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="util" Jun 10 01:10:45.450332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450267 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="util" Jun 10 01:10:45.450332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450281 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="extract" Jun 10 01:10:45.450332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450286 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="extract" Jun 10 01:10:45.450453 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.450343 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8cd158-eb97-4655-bd6d-d03643a11245" containerName="extract" Jun 10 01:10:45.454231 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.454211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.456693 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.456290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gj9sm\"" Jun 10 01:10:45.462805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.462757 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-bvr5c"] Jun 10 01:10:45.617006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.616969 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8khk\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-kube-api-access-r8khk\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.617205 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.617140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-bound-sa-token\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.715704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.715603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:45.717787 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.717764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-bound-sa-token\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.717887 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.717821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8khk\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-kube-api-access-r8khk\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.727019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.726987 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8khk\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-kube-api-access-r8khk\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.727119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.727098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba9fdea-041c-4af7-9f55-404d1a9e5486-bound-sa-token\") pod \"cert-manager-59c77684cc-bvr5c\" (UID: \"cba9fdea-041c-4af7-9f55-404d1a9e5486\") " pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.765350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.765313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-bvr5c" Jun 10 01:10:45.810746 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.810713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:45.895180 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:45.895147 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-bvr5c"] Jun 10 01:10:45.898141 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:45.898113 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcba9fdea_041c_4af7_9f55_404d1a9e5486.slice/crio-afce498833b4737b79dcaf6bf7f0cb822aed38db26635423e687ce23f247d3e5 WatchSource:0}: Error finding container afce498833b4737b79dcaf6bf7f0cb822aed38db26635423e687ce23f247d3e5: Status 404 returned error can't find the container with id afce498833b4737b79dcaf6bf7f0cb822aed38db26635423e687ce23f247d3e5 Jun 10 01:10:46.043199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:46.043171 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xsst" Jun 10 01:10:46.066009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:46.065974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-bvr5c" event={"ID":"cba9fdea-041c-4af7-9f55-404d1a9e5486","Type":"ContainerStarted","Data":"92cdb838a5c6cd515defa517c88181e1cfbb37cf0839b3fb2b506f9bda108b52"} Jun 10 01:10:46.066009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:46.066017 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-bvr5c" event={"ID":"cba9fdea-041c-4af7-9f55-404d1a9e5486","Type":"ContainerStarted","Data":"afce498833b4737b79dcaf6bf7f0cb822aed38db26635423e687ce23f247d3e5"} Jun 10 01:10:46.080697 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:46.080647 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-bvr5c" podStartSLOduration=1.080630496 podStartE2EDuration="1.080630496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:46.07957647 +0000 UTC m=+535.621406975" watchObservedRunningTime="2026-06-10 01:10:46.080630496 +0000 UTC m=+535.622460996" Jun 10 01:10:52.154677 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:52.154642 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:52.266242 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:52.266183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:53.770461 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.770426 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp"] Jun 10 01:10:53.776604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.776583 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.780122 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.780082 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:10:53.780228 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.780158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:10:53.780327 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.780311 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:10:53.781495 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.781452 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp"] Jun 10 01:10:53.792206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.792131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.792206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.792191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8bn\" (UniqueName: \"kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.792393 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.792252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.892946 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.892908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.893137 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.892957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8bn\" (UniqueName: \"kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.893137 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.893000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.893299 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.893278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.893361 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.893311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:53.901123 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:53.901092 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8bn\" (UniqueName: \"kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:54.013675 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:54.013643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:54.086860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:54.086771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:54.219790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:54.219754 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp"] Jun 10 01:10:54.222760 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:10:54.222733 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d56b8d1_e7b0_4819_bc89_d48c05d8f51a.slice/crio-83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706 WatchSource:0}: Error finding container 83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706: Status 404 returned error can't find the container with id 83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706 Jun 10 01:10:55.114610 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:55.114576 2573 generic.go:356] "Generic (PLEG): container finished" podID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerID="f0143b20a456ceb153069fc88710fa6c27a1c288bdc787d2907239405506ddd6" exitCode=0 Jun 10 01:10:55.114971 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:55.114622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" event={"ID":"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a","Type":"ContainerDied","Data":"f0143b20a456ceb153069fc88710fa6c27a1c288bdc787d2907239405506ddd6"} Jun 10 01:10:55.114971 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:55.114674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" event={"ID":"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a","Type":"ContainerStarted","Data":"83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706"} Jun 10 01:10:56.121912 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:56.121876 2573 generic.go:356] "Generic (PLEG): container finished" podID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerID="480dc6a2a98aa50da4e99b9a9bcd14aa79eab4bb4adb92528776e231848aec43" exitCode=0 Jun 10 01:10:56.122405 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:56.121919 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" event={"ID":"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a","Type":"ContainerDied","Data":"480dc6a2a98aa50da4e99b9a9bcd14aa79eab4bb4adb92528776e231848aec43"} Jun 10 01:10:57.129547 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:57.129510 2573 generic.go:356] "Generic (PLEG): container finished" podID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerID="dd22e97e3b0d4b74eb6d0f49a09c5766f341d5e25a8bba497376aa14a0ba941e" exitCode=0 Jun 10 01:10:57.129946 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:57.129573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" event={"ID":"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a","Type":"ContainerDied","Data":"dd22e97e3b0d4b74eb6d0f49a09c5766f341d5e25a8bba497376aa14a0ba941e"} Jun 10 01:10:58.269051 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.269026 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:58.337687 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.337650 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj8bn\" (UniqueName: \"kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn\") pod \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " Jun 10 01:10:58.337687 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.337692 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util\") pod \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " Jun 10 01:10:58.337897 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.337764 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle\") pod \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\" (UID: \"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a\") " Jun 10 01:10:58.338452 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.338416 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle" (OuterVolumeSpecName: "bundle") pod "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" (UID: "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:58.339825 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.339803 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn" (OuterVolumeSpecName: "kube-api-access-nj8bn") pod "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" (UID: "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a"). InnerVolumeSpecName "kube-api-access-nj8bn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:58.343487 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.343446 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util" (OuterVolumeSpecName: "util") pod "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" (UID: "9d56b8d1-e7b0-4819-bc89-d48c05d8f51a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:58.438966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.438874 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:58.438966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.438908 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj8bn\" (UniqueName: \"kubernetes.io/projected/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-kube-api-access-nj8bn\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:58.438966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:58.438918 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d56b8d1-e7b0-4819-bc89-d48c05d8f51a-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:10:59.141517 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:59.141416 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" Jun 10 01:10:59.141517 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:59.141413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpjcqp" event={"ID":"9d56b8d1-e7b0-4819-bc89-d48c05d8f51a","Type":"ContainerDied","Data":"83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706"} Jun 10 01:10:59.141706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:10:59.141526 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83482e2c8485e6576eec3e79fcbcaaad8715a9c4c924a95f8ea8521c5581f706" Jun 10 01:11:08.372541 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:08.372501 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:08.474996 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:08.474960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.026742 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.026707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.339730 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.339608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.444223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.444191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.553501 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553448 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx"] Jun 10 01:11:09.553899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553882 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="util" Jun 10 01:11:09.553981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553901 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="util" Jun 10 01:11:09.553981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553944 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="pull" Jun 10 01:11:09.553981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553954 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="pull" Jun 10 01:11:09.553981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553964 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="extract" Jun 10 01:11:09.553981 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.553971 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="extract" Jun 10 01:11:09.554254 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.554064 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d56b8d1-e7b0-4819-bc89-d48c05d8f51a" containerName="extract" Jun 10 01:11:09.556363 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.556340 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.562636 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.562614 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 01:11:09.562836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.562774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 01:11:09.563037 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.563017 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kdln6\"" Jun 10 01:11:09.563122 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.563061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 01:11:09.563122 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.563098 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 01:11:09.596891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.596796 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx"] Jun 10 01:11:09.638892 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.638855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.638892 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.638898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.639223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.638961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5k2\" (UniqueName: \"kubernetes.io/projected/caee5ef7-78ae-4d40-a814-26328768ac9d-kube-api-access-9t5k2\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.639223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.639003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.639223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.639102 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.695425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.695391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.739963 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.739929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.740136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.740011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.740136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.740036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.740136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.740071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5k2\" (UniqueName: \"kubernetes.io/projected/caee5ef7-78ae-4d40-a814-26328768ac9d-kube-api-access-9t5k2\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.740136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.740096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.740490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.740443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.742397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.742376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caee5ef7-78ae-4d40-a814-26328768ac9d-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.742557 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.742537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.742609 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.742586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/caee5ef7-78ae-4d40-a814-26328768ac9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.749759 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.749733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5k2\" (UniqueName: \"kubernetes.io/projected/caee5ef7-78ae-4d40-a814-26328768ac9d-kube-api-access-9t5k2\") pod \"opendatahub-operator-controller-manager-7f47d5f68-h5kxx\" (UID: \"caee5ef7-78ae-4d40-a814-26328768ac9d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.792623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.792588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:09.868176 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.868138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:09.898397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:09.896506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.001233 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.001201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.027926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.027892 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx"] Jun 10 01:11:10.031565 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:11:10.031539 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaee5ef7_78ae_4d40_a814_26328768ac9d.slice/crio-c7727fbfce457374adcd582fdcfd2045f60e0a8c8b50472e25458a4e355a890e WatchSource:0}: Error finding container c7727fbfce457374adcd582fdcfd2045f60e0a8c8b50472e25458a4e355a890e: Status 404 returned error can't find the container with id c7727fbfce457374adcd582fdcfd2045f60e0a8c8b50472e25458a4e355a890e Jun 10 01:11:10.099136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.099104 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.194673 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.194582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" event={"ID":"caee5ef7-78ae-4d40-a814-26328768ac9d","Type":"ContainerStarted","Data":"c7727fbfce457374adcd582fdcfd2045f60e0a8c8b50472e25458a4e355a890e"} Jun 10 01:11:10.195198 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.195176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.299861 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:10.299825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:13.214561 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:13.214529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" event={"ID":"caee5ef7-78ae-4d40-a814-26328768ac9d","Type":"ContainerStarted","Data":"b1f8bd7ecae4e7c8af16133c511a6d2d68949e050d1d999f0096fdaf9b29d581"} Jun 10 01:11:14.220633 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:14.220543 2573 generic.go:356] "Generic (PLEG): container finished" podID="caee5ef7-78ae-4d40-a814-26328768ac9d" containerID="b1f8bd7ecae4e7c8af16133c511a6d2d68949e050d1d999f0096fdaf9b29d581" exitCode=0 Jun 10 01:11:14.220986 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:14.220629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" event={"ID":"caee5ef7-78ae-4d40-a814-26328768ac9d","Type":"ContainerDied","Data":"b1f8bd7ecae4e7c8af16133c511a6d2d68949e050d1d999f0096fdaf9b29d581"} Jun 10 01:11:15.230017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:15.229972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" event={"ID":"caee5ef7-78ae-4d40-a814-26328768ac9d","Type":"ContainerStarted","Data":"39e3733e0c83923f59b8d7714c8183ad57c3e0a5067bb5d0d8329098a7a7aa66"} Jun 10 01:11:15.230530 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:15.230074 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:15.251007 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:15.250947 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" podStartSLOduration=2.094444864 podStartE2EDuration="6.25092848s" totalImagesPullingTime="3.119993919s" totalInitContainerRuntime="1.036489697s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:15.249381412 +0000 UTC m=+564.791211914" watchObservedRunningTime="2026-06-10 01:11:15.25092848 +0000 UTC m=+564.792758986" Jun 10 01:11:16.888107 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:16.888057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:20.511956 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:20.511905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:20.577685 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:20.577626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:20.942770 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:20.942715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:21.045669 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:21.045633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:23.382611 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:23.382563 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:23.446859 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:23.446825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:26.237436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:26.237401 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-h5kxx" Jun 10 01:11:27.308798 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.308761 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4"] Jun 10 01:11:27.319152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.319122 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.322677 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322642 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6vz5v\"" Jun 10 01:11:27.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322640 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 01:11:27.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322689 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:11:27.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 01:11:27.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322695 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 01:11:27.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322807 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4"] Jun 10 01:11:27.323059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.322997 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 01:11:27.413369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.413328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43887db4-118c-48b7-96bd-db304bc10699-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.413369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.413369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.413620 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.413403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.413620 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.413460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrgp\" (UniqueName: \"kubernetes.io/projected/43887db4-118c-48b7-96bd-db304bc10699-kube-api-access-swrgp\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.514396 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.514357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrgp\" (UniqueName: \"kubernetes.io/projected/43887db4-118c-48b7-96bd-db304bc10699-kube-api-access-swrgp\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.514627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.514440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43887db4-118c-48b7-96bd-db304bc10699-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.514627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.514462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.514627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.514526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.515170 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.515148 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43887db4-118c-48b7-96bd-db304bc10699-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.517069 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.517042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.517162 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.517097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43887db4-118c-48b7-96bd-db304bc10699-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.522028 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.522007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrgp\" (UniqueName: \"kubernetes.io/projected/43887db4-118c-48b7-96bd-db304bc10699-kube-api-access-swrgp\") pod \"lws-controller-manager-67d5b6d8d5-h7tw4\" (UID: \"43887db4-118c-48b7-96bd-db304bc10699\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.630239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.630199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:27.813006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:27.812979 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4"] Jun 10 01:11:27.814960 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:11:27.814929 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43887db4_118c_48b7_96bd_db304bc10699.slice/crio-e7d1b38a0b08a3fb4949443859df3214baf8838c97de9b08f4b8a9fb8544e74c WatchSource:0}: Error finding container e7d1b38a0b08a3fb4949443859df3214baf8838c97de9b08f4b8a9fb8544e74c: Status 404 returned error can't find the container with id e7d1b38a0b08a3fb4949443859df3214baf8838c97de9b08f4b8a9fb8544e74c Jun 10 01:11:28.306399 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.306357 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" event={"ID":"43887db4-118c-48b7-96bd-db304bc10699","Type":"ContainerStarted","Data":"e7d1b38a0b08a3fb4949443859df3214baf8838c97de9b08f4b8a9fb8544e74c"} Jun 10 01:11:28.429304 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.429258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:28.632238 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.632204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:28.788921 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.788886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:28.912290 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.912198 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:28.939119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:28.939069 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-5jgbz"] Jun 10 01:11:29.017936 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.017905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-5jgbz"] Jun 10 01:11:29.018122 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.018049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.020898 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.020872 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 01:11:29.020898 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.020890 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r9ztd\"" Jun 10 01:11:29.021725 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.021703 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 01:11:29.021856 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.021759 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 01:11:29.021856 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.021803 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 01:11:29.026571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.026379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwg5q\" (UniqueName: \"kubernetes.io/projected/7a1f299d-463b-46ec-9cc1-e6bbf006f561-kube-api-access-dwg5q\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.026571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.026420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tls-certs\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.026571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.026489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tmp\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.117216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.117145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:29.127090 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.127059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwg5q\" (UniqueName: \"kubernetes.io/projected/7a1f299d-463b-46ec-9cc1-e6bbf006f561-kube-api-access-dwg5q\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.127322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.127300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tls-certs\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.127483 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.127428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tmp\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.130055 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.130032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tmp\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.131307 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.131278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1f299d-463b-46ec-9cc1-e6bbf006f561-tls-certs\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.144271 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.144242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwg5q\" (UniqueName: \"kubernetes.io/projected/7a1f299d-463b-46ec-9cc1-e6bbf006f561-kube-api-access-dwg5q\") pod \"kube-auth-proxy-845757977d-5jgbz\" (UID: \"7a1f299d-463b-46ec-9cc1-e6bbf006f561\") " pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.329785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.329678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" Jun 10 01:11:29.441222 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.441183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:29.478299 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.478269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-5jgbz"] Jun 10 01:11:29.480291 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:11:29.480258 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1f299d_463b_46ec_9cc1_e6bbf006f561.slice/crio-715055aa7b3a831957e4d01d2b62c3cabc37bddc180b5e005ca6ed27f8cc974d WatchSource:0}: Error finding container 715055aa7b3a831957e4d01d2b62c3cabc37bddc180b5e005ca6ed27f8cc974d: Status 404 returned error can't find the container with id 715055aa7b3a831957e4d01d2b62c3cabc37bddc180b5e005ca6ed27f8cc974d Jun 10 01:11:29.556995 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.556954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:29.640140 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:29.640101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:30.116395 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.116359 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:30.236056 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.235954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:30.320837 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.320796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" event={"ID":"7a1f299d-463b-46ec-9cc1-e6bbf006f561","Type":"ContainerStarted","Data":"715055aa7b3a831957e4d01d2b62c3cabc37bddc180b5e005ca6ed27f8cc974d"} Jun 10 01:11:30.993667 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.993637 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt"] Jun 10 01:11:30.997333 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.997306 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:30.999986 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:30.999875 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:11:31.000756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.000735 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:11:31.000886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.000734 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:11:31.008344 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.008307 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt"] Jun 10 01:11:31.047392 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.047351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.047598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.047500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.047770 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.047645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx2ms\" (UniqueName: \"kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.148959 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.148916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx2ms\" (UniqueName: \"kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.149165 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.149012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.149165 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.149087 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.149719 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.149530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.149787 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.149763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.159277 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.159226 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx2ms\" (UniqueName: \"kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:31.310439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:31.310358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:32.533220 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:32.533189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt"] Jun 10 01:11:32.536549 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:11:32.536517 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266f3d71_0470_4d29_96e2_fe059d3be1d0.slice/crio-8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411 WatchSource:0}: Error finding container 8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411: Status 404 returned error can't find the container with id 8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411 Jun 10 01:11:33.339765 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:33.339722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" event={"ID":"7a1f299d-463b-46ec-9cc1-e6bbf006f561","Type":"ContainerStarted","Data":"50e50e57044ca329b69f97fb1b97fc9190583fdd2f9f0c08446718303e9f474c"} Jun 10 01:11:33.341484 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:33.341438 2573 generic.go:356] "Generic (PLEG): container finished" podID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerID="8386d22c45e29ec4978b1a28ff16c26a572d91cbee3da0ed129d2c9fa6fa7ae1" exitCode=0 Jun 10 01:11:33.341612 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:33.341524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" event={"ID":"266f3d71-0470-4d29-96e2-fe059d3be1d0","Type":"ContainerDied","Data":"8386d22c45e29ec4978b1a28ff16c26a572d91cbee3da0ed129d2c9fa6fa7ae1"} Jun 10 01:11:33.341612 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:33.341575 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" event={"ID":"266f3d71-0470-4d29-96e2-fe059d3be1d0","Type":"ContainerStarted","Data":"8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411"} Jun 10 01:11:33.357691 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:33.357629 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-845757977d-5jgbz" podStartSLOduration=2.374937438 podStartE2EDuration="5.35761198s" totalImagesPullingTime="2.982674542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:33.355564374 +0000 UTC m=+582.897394898" watchObservedRunningTime="2026-06-10 01:11:33.35761198 +0000 UTC m=+582.899442536" Jun 10 01:11:36.199836 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:36.199797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:36.363118 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:36.363079 2573 generic.go:356] "Generic (PLEG): container finished" podID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerID="e931e0a7597e67750591efc7c81e7c5540409a0f583a4ef7b81062bc03ef5d3c" exitCode=0 Jun 10 01:11:36.363299 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:36.363160 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" event={"ID":"266f3d71-0470-4d29-96e2-fe059d3be1d0","Type":"ContainerDied","Data":"e931e0a7597e67750591efc7c81e7c5540409a0f583a4ef7b81062bc03ef5d3c"} Jun 10 01:11:37.371182 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:37.371146 2573 generic.go:356] "Generic (PLEG): container finished" podID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerID="47c36152a5beecc901ce42ba47ca674e4074b56f932752e61a751fa92a991fd8" exitCode=0 Jun 10 01:11:37.371631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:37.371242 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" event={"ID":"266f3d71-0470-4d29-96e2-fe059d3be1d0","Type":"ContainerDied","Data":"47c36152a5beecc901ce42ba47ca674e4074b56f932752e61a751fa92a991fd8"} Jun 10 01:11:38.507417 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.507386 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:38.622582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.622549 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util\") pod \"266f3d71-0470-4d29-96e2-fe059d3be1d0\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " Jun 10 01:11:38.622582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.622590 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle\") pod \"266f3d71-0470-4d29-96e2-fe059d3be1d0\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " Jun 10 01:11:38.622881 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.622612 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx2ms\" (UniqueName: \"kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms\") pod \"266f3d71-0470-4d29-96e2-fe059d3be1d0\" (UID: \"266f3d71-0470-4d29-96e2-fe059d3be1d0\") " Jun 10 01:11:38.623549 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.623517 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle" (OuterVolumeSpecName: "bundle") pod "266f3d71-0470-4d29-96e2-fe059d3be1d0" (UID: "266f3d71-0470-4d29-96e2-fe059d3be1d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:38.624718 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.624691 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms" (OuterVolumeSpecName: "kube-api-access-lx2ms") pod "266f3d71-0470-4d29-96e2-fe059d3be1d0" (UID: "266f3d71-0470-4d29-96e2-fe059d3be1d0"). InnerVolumeSpecName "kube-api-access-lx2ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:38.627203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.627130 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util" (OuterVolumeSpecName: "util") pod "266f3d71-0470-4d29-96e2-fe059d3be1d0" (UID: "266f3d71-0470-4d29-96e2-fe059d3be1d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:38.724506 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.724424 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:38.724506 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.724458 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f3d71-0470-4d29-96e2-fe059d3be1d0-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:38.724717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:38.724525 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx2ms\" (UniqueName: \"kubernetes.io/projected/266f3d71-0470-4d29-96e2-fe059d3be1d0-kube-api-access-lx2ms\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:39.383429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:39.383392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" event={"ID":"266f3d71-0470-4d29-96e2-fe059d3be1d0","Type":"ContainerDied","Data":"8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411"} Jun 10 01:11:39.383429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:39.383421 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fxlmt" Jun 10 01:11:39.383668 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:39.383500 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f6518d6f9d0de426043c9e374b28543cf2602c817ed6e8b724264130c792411" Jun 10 01:11:39.625328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:39.625296 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:39.716881 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:39.716795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:40.046410 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:40.046323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:40.145859 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:40.145819 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:40.964169 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:40.964133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:41.042343 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:41.042305 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:41.396357 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:41.396322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" event={"ID":"43887db4-118c-48b7-96bd-db304bc10699","Type":"ContainerStarted","Data":"80ef337e5c01e98f0ffdd65dab125ef8130e35ddca29cab117daa57e212995b3"} Jun 10 01:11:41.396593 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:41.396390 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:41.417253 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:41.417201 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" podStartSLOduration=1.771757206 podStartE2EDuration="14.417185417s" totalImagesPullingTime="12.645428211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:41.416226841 +0000 UTC m=+590.958057342" watchObservedRunningTime="2026-06-10 01:11:41.417185417 +0000 UTC m=+590.959015918" Jun 10 01:11:43.429733 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:43.429690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:44.512508 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:44.512455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:46.100753 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:46.100717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:46.222027 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:46.221997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:47.436843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.436811 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm"] Jun 10 01:11:47.437215 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437186 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="util" Jun 10 01:11:47.437215 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437197 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="util" Jun 10 01:11:47.437215 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437214 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="pull" Jun 10 01:11:47.437317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437219 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="pull" Jun 10 01:11:47.437317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437232 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="extract" Jun 10 01:11:47.437317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437238 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="extract" Jun 10 01:11:47.437317 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.437312 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="266f3d71-0470-4d29-96e2-fe059d3be1d0" containerName="extract" Jun 10 01:11:47.440912 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.440894 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.444231 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.444209 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:11:47.444231 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.444206 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:11:47.444974 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.444957 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:11:47.460098 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.460072 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm"] Jun 10 01:11:47.521903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.521863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.522082 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.521942 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.522082 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.521965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmggj\" (UniqueName: \"kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.623359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.623320 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.623359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.623362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmggj\" (UniqueName: \"kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.623598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.623415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.623860 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.623845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.623903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.623845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.631818 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.631787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:47.635006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.634980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmggj\" (UniqueName: \"kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.750637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.750543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:47.758243 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.758211 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:47.901655 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.901630 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm"] Jun 10 01:11:47.903847 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:11:47.903814 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a8b7ab_f49d_4f13_bd8f_c49faf5fa2bb.slice/crio-da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43 WatchSource:0}: Error finding container da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43: Status 404 returned error can't find the container with id da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43 Jun 10 01:11:47.965978 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:47.965946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:48.157137 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:48.157103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:48.439869 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:48.439830 2573 generic.go:356] "Generic (PLEG): container finished" podID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerID="305e1ef6291d08bfbb568a2a23b7a143f811b3c81f0a966320f675321c58eec4" exitCode=0 Jun 10 01:11:48.440338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:48.439915 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" event={"ID":"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb","Type":"ContainerDied","Data":"305e1ef6291d08bfbb568a2a23b7a143f811b3c81f0a966320f675321c58eec4"} Jun 10 01:11:48.440338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:48.439969 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" event={"ID":"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb","Type":"ContainerStarted","Data":"da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43"} Jun 10 01:11:48.665711 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:48.665673 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:50.451756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:50.451717 2573 generic.go:356] "Generic (PLEG): container finished" podID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerID="a2ebf7ef988ee097878766dc5ca9592b51d5e92fafd7f96278e88845376ecf4e" exitCode=0 Jun 10 01:11:50.452162 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:50.451808 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" event={"ID":"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb","Type":"ContainerDied","Data":"a2ebf7ef988ee097878766dc5ca9592b51d5e92fafd7f96278e88845376ecf4e"} Jun 10 01:11:50.867178 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:50.867148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:11:50.868001 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:50.867973 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:11:51.460510 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:51.460382 2573 generic.go:356] "Generic (PLEG): container finished" podID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerID="40f4cb5dd2297c897dff89e11b7294b41ecaca4f672a9ad931a4a5f9c9aa7481" exitCode=0 Jun 10 01:11:51.460510 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:51.460494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" event={"ID":"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb","Type":"ContainerDied","Data":"40f4cb5dd2297c897dff89e11b7294b41ecaca4f672a9ad931a4a5f9c9aa7481"} Jun 10 01:11:52.404491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.404427 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-h7tw4" Jun 10 01:11:52.613707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.613680 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:52.779852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.779765 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmggj\" (UniqueName: \"kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj\") pod \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " Jun 10 01:11:52.779852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.779813 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util\") pod \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " Jun 10 01:11:52.779852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.779838 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle\") pod \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\" (UID: \"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb\") " Jun 10 01:11:52.781145 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.781108 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle" (OuterVolumeSpecName: "bundle") pod "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" (UID: "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:52.781956 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.781927 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj" (OuterVolumeSpecName: "kube-api-access-rmggj") pod "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" (UID: "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb"). InnerVolumeSpecName "kube-api-access-rmggj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:52.785727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.785702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util" (OuterVolumeSpecName: "util") pod "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" (UID: "e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:52.881039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.881001 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmggj\" (UniqueName: \"kubernetes.io/projected/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-kube-api-access-rmggj\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:52.881039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.881032 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:52.881039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:52.881042 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:11:53.475125 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:53.475094 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" Jun 10 01:11:53.475292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:53.475122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agb9fm" event={"ID":"e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb","Type":"ContainerDied","Data":"da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43"} Jun 10 01:11:53.475292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:53.475169 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da31debff3ae43f835b672866a176269d55fb1ebf7a131a7b3d41e831e890a43" Jun 10 01:11:58.893962 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:58.893929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:58.994385 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:11:58.994342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:04.749093 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:04.749003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:19.077029 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:19.076988 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:19.173874 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:19.173838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:19.593956 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:19.593922 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:20.183811 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:20.183778 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:20.284821 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:20.284787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:23.538683 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:23.538649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:23.639441 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:23.639407 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:23.829323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:23.829214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:24.049684 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:24.049656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:24.268903 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:24.268866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:28.251039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:28.250997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:29.862019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:29.861987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:29.913453 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:29.913419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:30.046531 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:30.046448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:30.147640 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:30.147565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:30.256613 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:30.256579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:30.968749 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:30.968720 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:31.175736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:31.175702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:32.023235 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:32.023200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:45.783204 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783167 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg"] Jun 10 01:12:45.783618 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783582 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="util" Jun 10 01:12:45.783618 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783594 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="util" Jun 10 01:12:45.783618 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783616 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="pull" Jun 10 01:12:45.783722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783622 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="pull" Jun 10 01:12:45.783722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783629 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="extract" Jun 10 01:12:45.783722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783636 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="extract" Jun 10 01:12:45.783722 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.783706 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a8b7ab-f49d-4f13-bd8f-c49faf5fa2bb" containerName="extract" Jun 10 01:12:45.786136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.786120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.788507 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.788459 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:12:45.788657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.788515 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:12:45.788657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.788518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wpg6d\"" Jun 10 01:12:45.795146 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.795123 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg"] Jun 10 01:12:45.871239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.871208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srd6x\" (UniqueName: \"kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.871239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.871246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.871436 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.871265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.971926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.971893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.971926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.971928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.972179 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.972019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srd6x\" (UniqueName: \"kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.972309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.972286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.972394 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.972374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:45.979429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:45.979408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srd6x\" (UniqueName: \"kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:46.096443 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.096356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:46.241167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.241143 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg"] Jun 10 01:12:46.242585 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:12:46.242557 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e WatchSource:0}: Error finding container 28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e: Status 404 returned error can't find the container with id 28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e Jun 10 01:12:46.384671 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.384636 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx"] Jun 10 01:12:46.387346 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.387326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.395535 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.395510 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx"] Jun 10 01:12:46.477644 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.477614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.477857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.477659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q789p\" (UniqueName: \"kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.477857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.477787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.578971 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.578930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.579160 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.579035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.579160 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.579067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q789p\" (UniqueName: \"kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.579338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.579312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.579414 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.579390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.587254 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.587227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q789p\" (UniqueName: \"kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.704787 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.704695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:46.758262 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.758227 2573 generic.go:356] "Generic (PLEG): container finished" podID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerID="0b7e02d9f396be1ef6fab7a83cbdec66becaddbb6a4bf12b77a396e78fdb398b" exitCode=0 Jun 10 01:12:46.758396 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.758292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" event={"ID":"5f1a5c76-1584-4983-b085-af58bf2fb332","Type":"ContainerDied","Data":"0b7e02d9f396be1ef6fab7a83cbdec66becaddbb6a4bf12b77a396e78fdb398b"} Jun 10 01:12:46.758396 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.758342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" event={"ID":"5f1a5c76-1584-4983-b085-af58bf2fb332","Type":"ContainerStarted","Data":"28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e"} Jun 10 01:12:46.759037 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.759014 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:12:46.835577 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.835546 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx"] Jun 10 01:12:46.837349 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:12:46.837321 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2706e7b8_28a0_4346_aab6_cd731ef0836a.slice/crio-3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7 WatchSource:0}: Error finding container 3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7: Status 404 returned error can't find the container with id 3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7 Jun 10 01:12:46.980521 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.980425 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc"] Jun 10 01:12:46.983744 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.983724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:46.991170 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:46.991143 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc"] Jun 10 01:12:47.084432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.084397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.084432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.084436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6p4q\" (UniqueName: \"kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.084713 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.084495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.185018 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.184975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.185018 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.185021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6p4q\" (UniqueName: \"kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.185281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.185077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.185510 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.185488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.185596 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.185549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.193059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.193029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6p4q\" (UniqueName: \"kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.316657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.316585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:47.419366 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.419337 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6"] Jun 10 01:12:47.422840 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.422786 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.430234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.430201 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6"] Jun 10 01:12:47.487286 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.487252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.487451 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.487401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzwf\" (UniqueName: \"kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.487547 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.487461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.496523 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.496501 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc"] Jun 10 01:12:47.521281 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:12:47.521253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0844ff80_b9c4_4ef0_ae24_7ee85f41828b.slice/crio-a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe WatchSource:0}: Error finding container a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe: Status 404 returned error can't find the container with id a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe Jun 10 01:12:47.588804 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.588768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzwf\" (UniqueName: \"kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.588945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.588813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.588945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.588875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.589245 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.589223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.589282 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.589248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.596757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.596730 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzwf\" (UniqueName: \"kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.746830 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.746790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:47.765083 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.765051 2573 generic.go:356] "Generic (PLEG): container finished" podID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerID="5f810042a7425f2f0b7f8f76691feb1ed2a08e2f34f77d6be68961dcbe63084c" exitCode=0 Jun 10 01:12:47.765204 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.765128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" event={"ID":"2706e7b8-28a0-4346-aab6-cd731ef0836a","Type":"ContainerDied","Data":"5f810042a7425f2f0b7f8f76691feb1ed2a08e2f34f77d6be68961dcbe63084c"} Jun 10 01:12:47.765204 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.765192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" event={"ID":"2706e7b8-28a0-4346-aab6-cd731ef0836a","Type":"ContainerStarted","Data":"3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7"} Jun 10 01:12:47.766927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.766901 2573 generic.go:356] "Generic (PLEG): container finished" podID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerID="8afcaea3bf2814b8d193eb356b8155f983f3543abfad6b37bfbf1296713ef188" exitCode=0 Jun 10 01:12:47.767048 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.766979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" event={"ID":"0844ff80-b9c4-4ef0-ae24-7ee85f41828b","Type":"ContainerDied","Data":"8afcaea3bf2814b8d193eb356b8155f983f3543abfad6b37bfbf1296713ef188"} Jun 10 01:12:47.767048 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.767025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" event={"ID":"0844ff80-b9c4-4ef0-ae24-7ee85f41828b","Type":"ContainerStarted","Data":"a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe"} Jun 10 01:12:47.769455 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.769434 2573 generic.go:356] "Generic (PLEG): container finished" podID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerID="1206ff54ec9b11c8a94b55258a8e99fd7cea4db73743ba112329d7d91cb27eeb" exitCode=0 Jun 10 01:12:47.769581 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.769501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" event={"ID":"5f1a5c76-1584-4983-b085-af58bf2fb332","Type":"ContainerDied","Data":"1206ff54ec9b11c8a94b55258a8e99fd7cea4db73743ba112329d7d91cb27eeb"} Jun 10 01:12:47.911119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:47.911084 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6"] Jun 10 01:12:47.914254 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:12:47.914228 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc28c4e_1250_4b19_8514_29532d9043a3.slice/crio-2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd WatchSource:0}: Error finding container 2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd: Status 404 returned error can't find the container with id 2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd Jun 10 01:12:48.777440 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.777404 2573 generic.go:356] "Generic (PLEG): container finished" podID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerID="057b7a59fd2dc8a7040524ad121fe93e5f00248b3a8fff24d2df0c060d1c9321" exitCode=0 Jun 10 01:12:48.777635 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.777511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" event={"ID":"2706e7b8-28a0-4346-aab6-cd731ef0836a","Type":"ContainerDied","Data":"057b7a59fd2dc8a7040524ad121fe93e5f00248b3a8fff24d2df0c060d1c9321"} Jun 10 01:12:48.779535 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.779514 2573 generic.go:356] "Generic (PLEG): container finished" podID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerID="b63415cdb352fede59cf3b8fe7773e99efc822d4a030d9c1a4fdfb8f7542d031" exitCode=0 Jun 10 01:12:48.779637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.779594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" event={"ID":"0844ff80-b9c4-4ef0-ae24-7ee85f41828b","Type":"ContainerDied","Data":"b63415cdb352fede59cf3b8fe7773e99efc822d4a030d9c1a4fdfb8f7542d031"} Jun 10 01:12:48.782100 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.782075 2573 generic.go:356] "Generic (PLEG): container finished" podID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerID="d8c9d94eea19bc945806c402e8d5a314ac15a0ebf3e6a9ed127f609753b3ae5f" exitCode=0 Jun 10 01:12:48.782213 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.782149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" event={"ID":"5f1a5c76-1584-4983-b085-af58bf2fb332","Type":"ContainerDied","Data":"d8c9d94eea19bc945806c402e8d5a314ac15a0ebf3e6a9ed127f609753b3ae5f"} Jun 10 01:12:48.783706 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.783689 2573 generic.go:356] "Generic (PLEG): container finished" podID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerID="07eb731b31183d693597df93a9a3682096394e6c6fba9a266083f4afb3bf25a7" exitCode=0 Jun 10 01:12:48.783790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.783757 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" event={"ID":"ebc28c4e-1250-4b19-8514-29532d9043a3","Type":"ContainerDied","Data":"07eb731b31183d693597df93a9a3682096394e6c6fba9a266083f4afb3bf25a7"} Jun 10 01:12:48.783790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:48.783787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" event={"ID":"ebc28c4e-1250-4b19-8514-29532d9043a3","Type":"ContainerStarted","Data":"2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd"} Jun 10 01:12:49.794006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.793915 2573 generic.go:356] "Generic (PLEG): container finished" podID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerID="6759240e8c4ad4ba518440116463a07c04c4b8e724e9dcef1786c5f269f9148a" exitCode=0 Jun 10 01:12:49.794412 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.794113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" event={"ID":"2706e7b8-28a0-4346-aab6-cd731ef0836a","Type":"ContainerDied","Data":"6759240e8c4ad4ba518440116463a07c04c4b8e724e9dcef1786c5f269f9148a"} Jun 10 01:12:49.796505 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.796455 2573 generic.go:356] "Generic (PLEG): container finished" podID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerID="7835f2d0b5d7a6105a0aa2d6fa6f6f505f90391b675f8e9f238149b3ea27c4e1" exitCode=0 Jun 10 01:12:49.796505 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.796497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" event={"ID":"0844ff80-b9c4-4ef0-ae24-7ee85f41828b","Type":"ContainerDied","Data":"7835f2d0b5d7a6105a0aa2d6fa6f6f505f90391b675f8e9f238149b3ea27c4e1"} Jun 10 01:12:49.798543 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.798518 2573 generic.go:356] "Generic (PLEG): container finished" podID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerID="18cc41fd36784a7f47aac13225b17abacb71238dda0088dadf4723cfe5c02dcb" exitCode=0 Jun 10 01:12:49.798622 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.798599 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" event={"ID":"ebc28c4e-1250-4b19-8514-29532d9043a3","Type":"ContainerDied","Data":"18cc41fd36784a7f47aac13225b17abacb71238dda0088dadf4723cfe5c02dcb"} Jun 10 01:12:49.931207 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:49.931184 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:50.013029 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.012997 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util\") pod \"5f1a5c76-1584-4983-b085-af58bf2fb332\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " Jun 10 01:12:50.013177 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.013043 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle\") pod \"5f1a5c76-1584-4983-b085-af58bf2fb332\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " Jun 10 01:12:50.013177 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.013150 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srd6x\" (UniqueName: \"kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x\") pod \"5f1a5c76-1584-4983-b085-af58bf2fb332\" (UID: \"5f1a5c76-1584-4983-b085-af58bf2fb332\") " Jun 10 01:12:50.013683 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.013654 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle" (OuterVolumeSpecName: "bundle") pod "5f1a5c76-1584-4983-b085-af58bf2fb332" (UID: "5f1a5c76-1584-4983-b085-af58bf2fb332"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:50.015498 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.015457 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x" (OuterVolumeSpecName: "kube-api-access-srd6x") pod "5f1a5c76-1584-4983-b085-af58bf2fb332" (UID: "5f1a5c76-1584-4983-b085-af58bf2fb332"). InnerVolumeSpecName "kube-api-access-srd6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:50.019166 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.019140 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util" (OuterVolumeSpecName: "util") pod "5f1a5c76-1584-4983-b085-af58bf2fb332" (UID: "5f1a5c76-1584-4983-b085-af58bf2fb332"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:50.114637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.114599 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:50.114637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.114627 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1a5c76-1584-4983-b085-af58bf2fb332-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:50.114637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.114636 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srd6x\" (UniqueName: \"kubernetes.io/projected/5f1a5c76-1584-4983-b085-af58bf2fb332-kube-api-access-srd6x\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:50.806657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.806626 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" Jun 10 01:12:50.806657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.806642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg" event={"ID":"5f1a5c76-1584-4983-b085-af58bf2fb332","Type":"ContainerDied","Data":"28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e"} Jun 10 01:12:50.807216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.806699 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e" Jun 10 01:12:50.808908 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.808873 2573 generic.go:356] "Generic (PLEG): container finished" podID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerID="3aeb3a61e2bd76488fa943a5a7c7babed5d8937abd19e3322758c43a2f5cd87e" exitCode=0 Jun 10 01:12:50.809043 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.808914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" event={"ID":"ebc28c4e-1250-4b19-8514-29532d9043a3","Type":"ContainerDied","Data":"3aeb3a61e2bd76488fa943a5a7c7babed5d8937abd19e3322758c43a2f5cd87e"} Jun 10 01:12:50.949757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.949731 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:50.977616 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:50.977586 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:51.025176 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025150 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util\") pod \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " Jun 10 01:12:51.025349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025210 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util\") pod \"2706e7b8-28a0-4346-aab6-cd731ef0836a\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " Jun 10 01:12:51.025349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025234 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6p4q\" (UniqueName: \"kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q\") pod \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " Jun 10 01:12:51.025489 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025350 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q789p\" (UniqueName: \"kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p\") pod \"2706e7b8-28a0-4346-aab6-cd731ef0836a\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " Jun 10 01:12:51.025489 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025406 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle\") pod \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\" (UID: \"0844ff80-b9c4-4ef0-ae24-7ee85f41828b\") " Jun 10 01:12:51.025489 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.025451 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle\") pod \"2706e7b8-28a0-4346-aab6-cd731ef0836a\" (UID: \"2706e7b8-28a0-4346-aab6-cd731ef0836a\") " Jun 10 01:12:51.026162 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.026126 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle" (OuterVolumeSpecName: "bundle") pod "0844ff80-b9c4-4ef0-ae24-7ee85f41828b" (UID: "0844ff80-b9c4-4ef0-ae24-7ee85f41828b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:51.026275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.026161 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle" (OuterVolumeSpecName: "bundle") pod "2706e7b8-28a0-4346-aab6-cd731ef0836a" (UID: "2706e7b8-28a0-4346-aab6-cd731ef0836a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:51.027828 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.027806 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q" (OuterVolumeSpecName: "kube-api-access-b6p4q") pod "0844ff80-b9c4-4ef0-ae24-7ee85f41828b" (UID: "0844ff80-b9c4-4ef0-ae24-7ee85f41828b"). InnerVolumeSpecName "kube-api-access-b6p4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:51.028338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.028312 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p" (OuterVolumeSpecName: "kube-api-access-q789p") pod "2706e7b8-28a0-4346-aab6-cd731ef0836a" (UID: "2706e7b8-28a0-4346-aab6-cd731ef0836a"). InnerVolumeSpecName "kube-api-access-q789p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:51.031352 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.031327 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util" (OuterVolumeSpecName: "util") pod "0844ff80-b9c4-4ef0-ae24-7ee85f41828b" (UID: "0844ff80-b9c4-4ef0-ae24-7ee85f41828b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:51.031757 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.031733 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util" (OuterVolumeSpecName: "util") pod "2706e7b8-28a0-4346-aab6-cd731ef0836a" (UID: "2706e7b8-28a0-4346-aab6-cd731ef0836a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:51.126771 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126728 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q789p\" (UniqueName: \"kubernetes.io/projected/2706e7b8-28a0-4346-aab6-cd731ef0836a-kube-api-access-q789p\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.126771 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126765 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.126771 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126777 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.127016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126785 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.127016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126793 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2706e7b8-28a0-4346-aab6-cd731ef0836a-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.127016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.126801 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6p4q\" (UniqueName: \"kubernetes.io/projected/0844ff80-b9c4-4ef0-ae24-7ee85f41828b-kube-api-access-b6p4q\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:51.816185 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.816152 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" Jun 10 01:12:51.816185 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.816177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx" event={"ID":"2706e7b8-28a0-4346-aab6-cd731ef0836a","Type":"ContainerDied","Data":"3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7"} Jun 10 01:12:51.816777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.816227 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c5a16d2bbc0d9c17fbbed1d8d2c2aedbb3834d734746e077e0ca78a7a2d9ac7" Jun 10 01:12:51.818056 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.818038 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" Jun 10 01:12:51.818192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.818073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc" event={"ID":"0844ff80-b9c4-4ef0-ae24-7ee85f41828b","Type":"ContainerDied","Data":"a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe"} Jun 10 01:12:51.818192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.818112 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4d2a76c47c15f57bfd23ec768d63fb2c2359d99593257135c8d0f716f7f49fe" Jun 10 01:12:51.949119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:51.949095 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:52.037250 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.037221 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle\") pod \"ebc28c4e-1250-4b19-8514-29532d9043a3\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " Jun 10 01:12:52.037456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.037329 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bzwf\" (UniqueName: \"kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf\") pod \"ebc28c4e-1250-4b19-8514-29532d9043a3\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " Jun 10 01:12:52.037456 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.037422 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util\") pod \"ebc28c4e-1250-4b19-8514-29532d9043a3\" (UID: \"ebc28c4e-1250-4b19-8514-29532d9043a3\") " Jun 10 01:12:52.037928 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.037901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle" (OuterVolumeSpecName: "bundle") pod "ebc28c4e-1250-4b19-8514-29532d9043a3" (UID: "ebc28c4e-1250-4b19-8514-29532d9043a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:52.039386 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.039357 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf" (OuterVolumeSpecName: "kube-api-access-9bzwf") pod "ebc28c4e-1250-4b19-8514-29532d9043a3" (UID: "ebc28c4e-1250-4b19-8514-29532d9043a3"). InnerVolumeSpecName "kube-api-access-9bzwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:52.043020 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.043001 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util" (OuterVolumeSpecName: "util") pod "ebc28c4e-1250-4b19-8514-29532d9043a3" (UID: "ebc28c4e-1250-4b19-8514-29532d9043a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:52.138566 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.138523 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:52.138566 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.138559 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bzwf\" (UniqueName: \"kubernetes.io/projected/ebc28c4e-1250-4b19-8514-29532d9043a3-kube-api-access-9bzwf\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:52.138566 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.138574 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc28c4e-1250-4b19-8514-29532d9043a3-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:12:52.496084 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:12:52.495998 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:12:52.825094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.825017 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" Jun 10 01:12:52.825094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.825049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6" event={"ID":"ebc28c4e-1250-4b19-8514-29532d9043a3","Type":"ContainerDied","Data":"2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd"} Jun 10 01:12:52.825094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:52.825093 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f423a6a6798829fc790f03c66baa2e63e277c3673928c5c8a7600b80296d8cd" Jun 10 01:12:54.507019 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.506983 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5479cc7db-fssq4"] Jun 10 01:12:54.507491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507449 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="util" Jun 10 01:12:54.507491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507484 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="util" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507496 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507507 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507518 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507526 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507554 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507562 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507573 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="extract" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507581 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="extract" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507601 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="pull" Jun 10 01:12:54.507605 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507606 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507612 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507621 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507626 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507631 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507636 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507642 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507647 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507655 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507660 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="util" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507669 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507674 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507739 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0844ff80-b9c4-4ef0-ae24-7ee85f41828b" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507748 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc28c4e-1250-4b19-8514-29532d9043a3" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507758 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2706e7b8-28a0-4346-aab6-cd731ef0836a" containerName="extract" Jun 10 01:12:54.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.507764 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1a5c76-1584-4983-b085-af58bf2fb332" containerName="extract" Jun 10 01:12:54.509797 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.509782 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.523895 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.523872 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479cc7db-fssq4"] Jun 10 01:12:54.559582 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-trusted-ca-bundle\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559775 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-service-ca\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559775 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-oauth-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559775 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5vs\" (UniqueName: \"kubernetes.io/projected/3ee74141-2322-4ee0-afdc-23e36e5a07a9-kube-api-access-7s5vs\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559775 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559958 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-oauth-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.559958 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.559861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.563758 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.563732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:54.660499 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-service-ca\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660499 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-oauth-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5vs\" (UniqueName: \"kubernetes.io/projected/3ee74141-2322-4ee0-afdc-23e36e5a07a9-kube-api-access-7s5vs\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-oauth-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.660760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.660675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-trusted-ca-bundle\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.661275 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.661244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-service-ca\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.661429 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.661402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.661502 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.661406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-oauth-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.661569 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.661553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ee74141-2322-4ee0-afdc-23e36e5a07a9-trusted-ca-bundle\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.663264 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.663231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-oauth-config\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.663359 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.663240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ee74141-2322-4ee0-afdc-23e36e5a07a9-console-serving-cert\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.664561 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.664535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:54.667800 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.667783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5vs\" (UniqueName: \"kubernetes.io/projected/3ee74141-2322-4ee0-afdc-23e36e5a07a9-kube-api-access-7s5vs\") pod \"console-5479cc7db-fssq4\" (UID: \"3ee74141-2322-4ee0-afdc-23e36e5a07a9\") " pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.819774 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.819681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:12:54.954091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:54.954062 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479cc7db-fssq4"] Jun 10 01:12:54.955325 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:12:54.955295 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee74141_2322_4ee0_afdc_23e36e5a07a9.slice/crio-9a9581178caa767dee2066d7ae6fa8587402429d7a2c0f98cd08f73b80d31c0f WatchSource:0}: Error finding container 9a9581178caa767dee2066d7ae6fa8587402429d7a2c0f98cd08f73b80d31c0f: Status 404 returned error can't find the container with id 9a9581178caa767dee2066d7ae6fa8587402429d7a2c0f98cd08f73b80d31c0f Jun 10 01:12:55.844178 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:55.844140 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479cc7db-fssq4" event={"ID":"3ee74141-2322-4ee0-afdc-23e36e5a07a9","Type":"ContainerStarted","Data":"2e534249720bc1035c3119029ac93225ff564aa9c21bcf72274b5f0fb8e0f844"} Jun 10 01:12:55.844626 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:55.844197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479cc7db-fssq4" event={"ID":"3ee74141-2322-4ee0-afdc-23e36e5a07a9","Type":"ContainerStarted","Data":"9a9581178caa767dee2066d7ae6fa8587402429d7a2c0f98cd08f73b80d31c0f"} Jun 10 01:12:55.862520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:55.862453 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5479cc7db-fssq4" podStartSLOduration=1.862435016 podStartE2EDuration="1.862435016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:55.85973652 +0000 UTC m=+665.401567033" watchObservedRunningTime="2026-06-10 01:12:55.862435016 +0000 UTC m=+665.404265551" Jun 10 01:12:58.794716 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:58.794678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:59.163584 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:12:59.163552 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:12:59.397846 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:12:59.397810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:02.506562 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:02.506529 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:03.790376 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:03.790339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:04.820041 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:04.820003 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:13:04.820490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:04.820089 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:13:04.824984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:04.824961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:13:04.902873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:04.902842 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5479cc7db-fssq4" Jun 10 01:13:04.949631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:04.949599 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:13:05.078790 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:05.078692 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:05.184676 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:05.184626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:05.280599 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:05.280565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:05.380606 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:05.380573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:06.052308 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:06.052268 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:06.174494 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:06.174440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:08.706203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:08.706171 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:08.841132 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:08.841097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:11.608154 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:11.608122 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:11.707926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:11.707893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:11.806304 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:11.806270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:12.265751 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:12.265715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:12.568137 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:12.568040 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:14.120553 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:14.120509 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:14.653112 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:14.653079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:15.402315 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:15.402276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:15.454645 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:15.454615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:15.806936 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:15.806844 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:15.907039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:15.907002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:17.218020 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.217984 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn"] Jun 10 01:13:17.220528 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.220512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.222970 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.222951 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:13:17.223073 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.223016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 01:13:17.223143 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.223067 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 01:13:17.223649 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.223633 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wpg6d\"" Jun 10 01:13:17.223721 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.223674 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:13:17.230578 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.230553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn"] Jun 10 01:13:17.246111 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.246076 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:17.276639 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.276604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.276774 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.276729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67h2\" (UniqueName: \"kubernetes.io/projected/abb04762-a51d-4141-ba64-1b1f44b9c2f6-kube-api-access-w67h2\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.276840 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.276787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/abb04762-a51d-4141-ba64-1b1f44b9c2f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.377531 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.377497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w67h2\" (UniqueName: \"kubernetes.io/projected/abb04762-a51d-4141-ba64-1b1f44b9c2f6-kube-api-access-w67h2\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.377705 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.377565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/abb04762-a51d-4141-ba64-1b1f44b9c2f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.377705 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.377611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.377783 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:17.377743 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 01:13:17.377821 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:17.377816 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert podName:abb04762-a51d-4141-ba64-1b1f44b9c2f6 nodeName:}" failed. No retries permitted until 2026-06-10 01:13:17.877801283 +0000 UTC m=+687.419631761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-8lccn" (UID: "abb04762-a51d-4141-ba64-1b1f44b9c2f6") : secret "plugin-serving-cert" not found Jun 10 01:13:17.378213 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.378194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/abb04762-a51d-4141-ba64-1b1f44b9c2f6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.391703 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.391667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67h2\" (UniqueName: \"kubernetes.io/projected/abb04762-a51d-4141-ba64-1b1f44b9c2f6-kube-api-access-w67h2\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.872094 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.872042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:17.881260 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.881232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:17.883654 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:17.883632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb04762-a51d-4141-ba64-1b1f44b9c2f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8lccn\" (UID: \"abb04762-a51d-4141-ba64-1b1f44b9c2f6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:18.132584 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:18.132457 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" Jun 10 01:13:18.265007 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:18.264977 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn"] Jun 10 01:13:18.266767 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:13:18.266742 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabb04762_a51d_4141_ba64_1b1f44b9c2f6.slice/crio-ce0530063d17d01261546a49c113291f344873dfe825c73301ef8251e49bd321 WatchSource:0}: Error finding container ce0530063d17d01261546a49c113291f344873dfe825c73301ef8251e49bd321: Status 404 returned error can't find the container with id ce0530063d17d01261546a49c113291f344873dfe825c73301ef8251e49bd321 Jun 10 01:13:18.979852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:18.979817 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" event={"ID":"abb04762-a51d-4141-ba64-1b1f44b9c2f6","Type":"ContainerStarted","Data":"ce0530063d17d01261546a49c113291f344873dfe825c73301ef8251e49bd321"} Jun 10 01:13:19.406158 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:19.406119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:19.458350 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:19.458312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:22.621617 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:22.621580 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:26.661342 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:26.661307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:26.762909 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:26.762863 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:27.539209 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.539160 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9"] Jun 10 01:13:27.546281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.546249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.549462 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.549430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kb6jf\"" Jun 10 01:13:27.555995 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.555963 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9"] Jun 10 01:13:27.578672 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.578626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8zt\" (UniqueName: \"kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.578877 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.578772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.679965 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.679922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8zt\" (UniqueName: \"kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.680459 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.680058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.680545 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.680499 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.688692 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.688659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8zt\" (UniqueName: \"kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt\") pod \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.809596 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.809514 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9"] Jun 10 01:13:27.809920 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.809904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:27.817256 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.817225 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9"] Jun 10 01:13:27.835489 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.835409 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:13:27.840801 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.840776 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.856624 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.856235 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:13:27.882119 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.882083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.882313 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.882155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwzc\" (UniqueName: \"kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.982975 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.982933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwzc\" (UniqueName: \"kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.983168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.983091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.983549 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.983523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:27.994767 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:27.994734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwzc\" (UniqueName: \"kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-j6qgz\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:28.158073 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:28.158030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:29.163232 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:29.163195 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:29.976146 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:29.976096 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b6544d4b5-fqd2j" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerName="console" containerID="cri-o://e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6" gracePeriod=15 Jun 10 01:13:30.838404 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:30.838360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:30.934779 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:30.934740 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:32.633935 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:32.633080 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:34.619063 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:34.619026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:34.670482 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:34.670436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:34.814692 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:34.814650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:34.866232 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:34.866183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:35.697791 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:35.697759 2573 patch_prober.go:28] interesting pod/console-b6544d4b5-fqd2j container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.30:8443/health\": dial tcp 10.132.0.30:8443: connect: connection refused" start-of-body= Jun 10 01:13:35.698216 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:35.697812 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-b6544d4b5-fqd2j" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.30:8443/health\": dial tcp 10.132.0.30:8443: connect: connection refused" Jun 10 01:13:37.322845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:37.322794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:37.421922 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:37.421882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:39.265106 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:39.265074 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:39.265556 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:39.265072 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:41.731927 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.731897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:13:41.732343 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:13:41.732295 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ec1ebf_cbf6_400d_9f36_4f53b66dfe44.slice/crio-a8e8facc4eacaa1de73d07a365afd95eb82ce7b011c7d88be41b177a6ca37ca7 WatchSource:0}: Error finding container a8e8facc4eacaa1de73d07a365afd95eb82ce7b011c7d88be41b177a6ca37ca7: Status 404 returned error can't find the container with id a8e8facc4eacaa1de73d07a365afd95eb82ce7b011c7d88be41b177a6ca37ca7 Jun 10 01:13:41.738733 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.738696 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:13:41.837223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837129 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837223 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837177 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m88ws\" (UniqueName: \"kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837236 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837258 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837289 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837312 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837381 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle\") pod \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\" (UID: \"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7\") " Jun 10 01:13:41.837811 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837770 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:13:41.837922 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837804 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:13:41.837972 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837897 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config" (OuterVolumeSpecName: "console-config") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:13:41.838026 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.837974 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:13:41.839410 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.839388 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:13:41.839516 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.839495 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws" (OuterVolumeSpecName: "kube-api-access-m88ws") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "kube-api-access-m88ws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:41.839584 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.839564 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" (UID: "18bf7f65-7a33-4c06-83a5-52fc07b8f8c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:13:41.938778 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938742 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.938778 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938772 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-service-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.938778 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938786 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-oauth-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.939023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938799 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-oauth-config\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.939023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938810 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-trusted-ca-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.939023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938822 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-console-serving-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.939023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:41.938833 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m88ws\" (UniqueName: \"kubernetes.io/projected/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7-kube-api-access-m88ws\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:42.139645 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.139574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" event={"ID":"abb04762-a51d-4141-ba64-1b1f44b9c2f6","Type":"ContainerStarted","Data":"bcb627666c0ffe7fc05f0d84383f7529372c368713535948dbd7d393703b604a"} Jun 10 01:13:42.141061 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.141035 2573 generic.go:356] "Generic (PLEG): container finished" podID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerID="e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6" exitCode=0 Jun 10 01:13:42.141181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.141086 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6544d4b5-fqd2j" Jun 10 01:13:42.141181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.141124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6544d4b5-fqd2j" event={"ID":"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7","Type":"ContainerDied","Data":"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6"} Jun 10 01:13:42.141181 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.141171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6544d4b5-fqd2j" event={"ID":"18bf7f65-7a33-4c06-83a5-52fc07b8f8c7","Type":"ContainerDied","Data":"f1e27e29711cc29baf5f9791fc0c4314a6431ef8f86ebdf667e4cac2d1cbc15e"} Jun 10 01:13:42.141324 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.141198 2573 scope.go:117] "RemoveContainer" containerID="e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6" Jun 10 01:13:42.142787 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.142762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" event={"ID":"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44","Type":"ContainerStarted","Data":"a8e8facc4eacaa1de73d07a365afd95eb82ce7b011c7d88be41b177a6ca37ca7"} Jun 10 01:13:42.151199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.151181 2573 scope.go:117] "RemoveContainer" containerID="e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6" Jun 10 01:13:42.151539 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:42.151517 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6\": container with ID starting with e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6 not found: ID does not exist" containerID="e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6" Jun 10 01:13:42.151604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.151549 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6"} err="failed to get container status \"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6\": rpc error: code = NotFound desc = could not find container \"e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6\": container with ID starting with e3c0db20e4871d58df8cead3d7cdb66e24420eda5f1abc7ecfb0ecf5e43457d6 not found: ID does not exist" Jun 10 01:13:42.158130 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.158086 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8lccn" podStartSLOduration=1.759418902 podStartE2EDuration="25.15807134s" totalImagesPullingTime="23.398652438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:42.156319502 +0000 UTC m=+711.698150001" watchObservedRunningTime="2026-06-10 01:13:42.15807134 +0000 UTC m=+711.699901841" Jun 10 01:13:42.172252 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.172214 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:13:42.178866 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.178822 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6544d4b5-fqd2j"] Jun 10 01:13:42.437007 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.436926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:42.537062 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.537031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:42.644330 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:42.644299 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:42.860155 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:42.860121 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" path="/var/lib/kubelet/pods/18bf7f65-7a33-4c06-83a5-52fc07b8f8c7/volumes" Jun 10 01:13:43.796678 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:43.796640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:43.895863 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:43.895830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:43.996454 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:43.996416 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:44.109872 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:44.109819 2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-2wdd9_kuadrant-system_bc412197-98ad-4c6e-94ca-af5f84ea4664_0(8b4bc33bcdaa48a239534ec855a92f1c337b98f2fa88d4fabe80d1819e6a54a4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-2wdd9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 10 01:13:44.110000 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:44.109905 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-2wdd9_kuadrant-system_bc412197-98ad-4c6e-94ca-af5f84ea4664_0(8b4bc33bcdaa48a239534ec855a92f1c337b98f2fa88d4fabe80d1819e6a54a4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-2wdd9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:44.117146 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:44.117104 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a5c76_1584_4983_b085_af58bf2fb332.slice/crio-28fe25296a65c5b40948c4584f9b479f08a0b56f977fea80d7f89753fff2723e\": RecentStats: unable to find data in memory cache]" Jun 10 01:13:44.155124 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.155075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:44.157117 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:44.157084 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" is forbidden: User \"system:node:ip-10-0-132-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-148.ec2.internal' and this object" podUID="bc412197-98ad-4c6e-94ca-af5f84ea4664" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:44.164064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.164043 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:44.165924 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:44.165901 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" is forbidden: User \"system:node:ip-10-0-132-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-148.ec2.internal' and this object" podUID="bc412197-98ad-4c6e-94ca-af5f84ea4664" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:44.264063 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.264027 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume\") pod \"bc412197-98ad-4c6e-94ca-af5f84ea4664\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " Jun 10 01:13:44.264264 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.264246 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w8zt\" (UniqueName: \"kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt\") pod \"bc412197-98ad-4c6e-94ca-af5f84ea4664\" (UID: \"bc412197-98ad-4c6e-94ca-af5f84ea4664\") " Jun 10 01:13:44.264424 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.264396 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc412197-98ad-4c6e-94ca-af5f84ea4664" (UID: "bc412197-98ad-4c6e-94ca-af5f84ea4664"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:13:44.264635 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.264612 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc412197-98ad-4c6e-94ca-af5f84ea4664-extensions-socket-volume\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:44.266621 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.266593 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt" (OuterVolumeSpecName: "kube-api-access-9w8zt") pod "bc412197-98ad-4c6e-94ca-af5f84ea4664" (UID: "bc412197-98ad-4c6e-94ca-af5f84ea4664"). InnerVolumeSpecName "kube-api-access-9w8zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:44.366053 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.366008 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w8zt\" (UniqueName: \"kubernetes.io/projected/bc412197-98ad-4c6e-94ca-af5f84ea4664-kube-api-access-9w8zt\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:13:44.860459 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:44.860421 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc412197-98ad-4c6e-94ca-af5f84ea4664" path="/var/lib/kubelet/pods/bc412197-98ad-4c6e-94ca-af5f84ea4664/volumes" Jun 10 01:13:45.160819 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:45.160739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:45.162828 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:45.162796 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" is forbidden: User \"system:node:ip-10-0-132-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-148.ec2.internal' and this object" podUID="bc412197-98ad-4c6e-94ca-af5f84ea4664" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:45.164792 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:13:45.164767 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2wdd9\" is forbidden: User \"system:node:ip-10-0-132-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-148.ec2.internal' and this object" podUID="bc412197-98ad-4c6e-94ca-af5f84ea4664" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2wdd9" Jun 10 01:13:48.181328 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:48.181290 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" event={"ID":"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44","Type":"ContainerStarted","Data":"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b"} Jun 10 01:13:48.181739 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:48.181376 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:13:48.201312 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:48.201260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" podStartSLOduration=15.118349811 podStartE2EDuration="21.201244434s" totalImagesPullingTime="6.082894623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:48.197841488 +0000 UTC m=+717.739671999" watchObservedRunningTime="2026-06-10 01:13:48.201244434 +0000 UTC m=+717.743074932" Jun 10 01:13:48.557080 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:48.556972 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:48.659824 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:48.659785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:52.559598 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:52.559542 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:52.612747 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:52.612710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:53.158720 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:53.158682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:53.212703 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:53.212671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:56.778984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:56.778958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:56.833076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:56.833033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:59.190056 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:13:59.190023 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:14:04.559349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:04.559317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:04.614982 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:04.614937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:08.170420 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:08.170384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:08.271558 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:08.271515 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:11.462717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.462686 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:14:11.463125 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.462902 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" podUID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" containerName="manager" containerID="cri-o://93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b" gracePeriod=10 Jun 10 01:14:11.724614 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.724549 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:14:11.828801 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.828770 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume\") pod \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " Jun 10 01:14:11.828993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.828935 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpwzc\" (UniqueName: \"kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc\") pod \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\" (UID: \"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44\") " Jun 10 01:14:11.829135 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.829109 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" (UID: "19ec1ebf-cbf6-400d-9f36-4f53b66dfe44"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:14:11.830876 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.830857 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc" (OuterVolumeSpecName: "kube-api-access-vpwzc") pod "19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" (UID: "19ec1ebf-cbf6-400d-9f36-4f53b66dfe44"). InnerVolumeSpecName "kube-api-access-vpwzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:11.929914 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.929879 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-extensions-socket-volume\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:11.929914 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:11.929911 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpwzc\" (UniqueName: \"kubernetes.io/projected/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44-kube-api-access-vpwzc\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:12.322840 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.322797 2573 generic.go:356] "Generic (PLEG): container finished" podID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" containerID="93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b" exitCode=0 Jun 10 01:14:12.323023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.322844 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" Jun 10 01:14:12.323023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.322883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" event={"ID":"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44","Type":"ContainerDied","Data":"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b"} Jun 10 01:14:12.323023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.322938 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz" event={"ID":"19ec1ebf-cbf6-400d-9f36-4f53b66dfe44","Type":"ContainerDied","Data":"a8e8facc4eacaa1de73d07a365afd95eb82ce7b011c7d88be41b177a6ca37ca7"} Jun 10 01:14:12.323023 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.322962 2573 scope.go:117] "RemoveContainer" containerID="93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b" Jun 10 01:14:12.333798 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.333773 2573 scope.go:117] "RemoveContainer" containerID="93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b" Jun 10 01:14:12.335506 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:14:12.335458 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b\": container with ID starting with 93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b not found: ID does not exist" containerID="93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b" Jun 10 01:14:12.335601 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.335520 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b"} err="failed to get container status \"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b\": rpc error: code = NotFound desc = could not find container \"93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b\": container with ID starting with 93c4f9b9a316318fde75f18d31e14487fafaab838e20d3600dae4a3d68c5307b not found: ID does not exist" Jun 10 01:14:12.350833 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.350808 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:14:12.356694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.356671 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j6qgz"] Jun 10 01:14:12.858990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:12.858955 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" path="/var/lib/kubelet/pods/19ec1ebf-cbf6-400d-9f36-4f53b66dfe44/volumes" Jun 10 01:14:15.528570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:15.528540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:15.624620 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:15.624585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:19.116828 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.116795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:19.435580 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.435491 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:19.436014 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.435989 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerName="console" Jun 10 01:14:19.436014 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436010 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerName="console" Jun 10 01:14:19.436203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436049 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" containerName="manager" Jun 10 01:14:19.436203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436058 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" containerName="manager" Jun 10 01:14:19.436203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436153 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ec1ebf-cbf6-400d-9f36-4f53b66dfe44" containerName="manager" Jun 10 01:14:19.436203 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436164 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bf7f65-7a33-4c06-83a5-52fc07b8f8c7" containerName="console" Jun 10 01:14:19.436680 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.436651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:19.443038 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.443005 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.445452 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.445430 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 01:14:19.446208 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.446190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:19.538960 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.538924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:19.539987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.539964 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:19.602166 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.602123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.602357 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.602291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrhc8\" (UniqueName: \"kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.638853 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.638820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:19.703759 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.703662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrhc8\" (UniqueName: \"kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.703759 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.703714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.704448 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.704422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.711265 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.711239 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrhc8\" (UniqueName: \"kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8\") pod \"limitador-limitador-64c94fd64f-zh84g\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.755033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.754988 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:19.896586 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:19.896555 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:19.898034 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:14:19.898007 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc663ab8d_9404_4047_b85f_b1d804cc3429.slice/crio-fc87e843509cad87e2f746107c2b3131ec21ab44fd2d86d3ed7921f6fa1e3027 WatchSource:0}: Error finding container fc87e843509cad87e2f746107c2b3131ec21ab44fd2d86d3ed7921f6fa1e3027: Status 404 returned error can't find the container with id fc87e843509cad87e2f746107c2b3131ec21ab44fd2d86d3ed7921f6fa1e3027 Jun 10 01:14:20.221006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.220971 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:20.226113 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.226092 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:20.228650 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.228630 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9vbnj\"" Jun 10 01:14:20.231243 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.231216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:20.248069 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.248044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:20.309827 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.309792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrj6q\" (UniqueName: \"kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q\") pod \"authorino-58cd955675-655hv\" (UID: \"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9\") " pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:20.309827 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.309799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:20.369785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.369749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" event={"ID":"c663ab8d-9404-4047-b85f-b1d804cc3429","Type":"ContainerStarted","Data":"fc87e843509cad87e2f746107c2b3131ec21ab44fd2d86d3ed7921f6fa1e3027"} Jun 10 01:14:20.410914 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.410883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrj6q\" (UniqueName: \"kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q\") pod \"authorino-58cd955675-655hv\" (UID: \"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9\") " pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:20.418370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.418340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrj6q\" (UniqueName: \"kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q\") pod \"authorino-58cd955675-655hv\" (UID: \"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9\") " pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:20.537667 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.537585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:20.714459 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:20.714426 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:20.737032 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:14:20.737000 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd292e1a4_eaa2_4049_a5da_c9c6871ab3d9.slice/crio-9a4df0f839bfcc3ccc3f3fe25018e514e4ea8c13a7acb57f7e456630a0b819c4 WatchSource:0}: Error finding container 9a4df0f839bfcc3ccc3f3fe25018e514e4ea8c13a7acb57f7e456630a0b819c4: Status 404 returned error can't find the container with id 9a4df0f839bfcc3ccc3f3fe25018e514e4ea8c13a7acb57f7e456630a0b819c4 Jun 10 01:14:21.378542 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:21.378499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-655hv" event={"ID":"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9","Type":"ContainerStarted","Data":"9a4df0f839bfcc3ccc3f3fe25018e514e4ea8c13a7acb57f7e456630a0b819c4"} Jun 10 01:14:23.395256 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:23.395152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" event={"ID":"c663ab8d-9404-4047-b85f-b1d804cc3429","Type":"ContainerStarted","Data":"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a"} Jun 10 01:14:23.395755 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:23.395424 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:23.410138 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:23.410078 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" podStartSLOduration=1.33685738 podStartE2EDuration="4.410056302s" totalImagesPullingTime="3.073198922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:23.408728293 +0000 UTC m=+752.950558796" watchObservedRunningTime="2026-06-10 01:14:23.410056302 +0000 UTC m=+752.951886816" Jun 10 01:14:25.409372 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:25.409335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-655hv" event={"ID":"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9","Type":"ContainerStarted","Data":"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72"} Jun 10 01:14:25.425420 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:25.425365 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-655hv" podStartSLOduration=0.8582968 podStartE2EDuration="5.42534776s" totalImagesPullingTime="4.56705096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:25.42342124 +0000 UTC m=+754.965251742" watchObservedRunningTime="2026-06-10 01:14:25.42534776 +0000 UTC m=+754.967178261" Jun 10 01:14:25.567109 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:25.567001 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:27.421136 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:27.421087 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-655hv" podUID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" containerName="authorino" containerID="cri-o://15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72" gracePeriod=30 Jun 10 01:14:27.669634 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:27.669609 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:27.786822 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:27.786730 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrj6q\" (UniqueName: \"kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q\") pod \"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9\" (UID: \"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9\") " Jun 10 01:14:27.788879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:27.788853 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q" (OuterVolumeSpecName: "kube-api-access-nrj6q") pod "d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" (UID: "d292e1a4-eaa2-4049-a5da-c9c6871ab3d9"). InnerVolumeSpecName "kube-api-access-nrj6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:27.887896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:27.887862 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrj6q\" (UniqueName: \"kubernetes.io/projected/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9-kube-api-access-nrj6q\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:28.429011 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.428975 2573 generic.go:356] "Generic (PLEG): container finished" podID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" containerID="15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72" exitCode=0 Jun 10 01:14:28.429415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.429020 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-655hv" Jun 10 01:14:28.429415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.429057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-655hv" event={"ID":"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9","Type":"ContainerDied","Data":"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72"} Jun 10 01:14:28.429415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.429100 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-655hv" event={"ID":"d292e1a4-eaa2-4049-a5da-c9c6871ab3d9","Type":"ContainerDied","Data":"9a4df0f839bfcc3ccc3f3fe25018e514e4ea8c13a7acb57f7e456630a0b819c4"} Jun 10 01:14:28.429415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.429117 2573 scope.go:117] "RemoveContainer" containerID="15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72" Jun 10 01:14:28.438923 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.438906 2573 scope.go:117] "RemoveContainer" containerID="15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72" Jun 10 01:14:28.439194 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:14:28.439177 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72\": container with ID starting with 15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72 not found: ID does not exist" containerID="15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72" Jun 10 01:14:28.439235 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.439204 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72"} err="failed to get container status \"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72\": rpc error: code = NotFound desc = could not find container \"15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72\": container with ID starting with 15a857a37cb365a381ee6e5a1fa6fdab712dec045a6899c91dfa34e524bb2f72 not found: ID does not exist" Jun 10 01:14:28.450896 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.450872 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:28.454501 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.454458 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-655hv"] Jun 10 01:14:28.858623 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:28.858591 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" path="/var/lib/kubelet/pods/d292e1a4-eaa2-4049-a5da-c9c6871ab3d9/volumes" Jun 10 01:14:34.402491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:34.402436 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:34.404708 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:34.404685 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:34.465006 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:34.464969 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" podUID="c663ab8d-9404-4047-b85f-b1d804cc3429" containerName="limitador" containerID="cri-o://01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a" gracePeriod=30 Jun 10 01:14:35.016674 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.016647 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:35.057370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.057295 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrhc8\" (UniqueName: \"kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8\") pod \"c663ab8d-9404-4047-b85f-b1d804cc3429\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " Jun 10 01:14:35.057572 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.057516 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file\") pod \"c663ab8d-9404-4047-b85f-b1d804cc3429\" (UID: \"c663ab8d-9404-4047-b85f-b1d804cc3429\") " Jun 10 01:14:35.057923 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.057892 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file" (OuterVolumeSpecName: "config-file") pod "c663ab8d-9404-4047-b85f-b1d804cc3429" (UID: "c663ab8d-9404-4047-b85f-b1d804cc3429"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:14:35.059364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.059344 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8" (OuterVolumeSpecName: "kube-api-access-zrhc8") pod "c663ab8d-9404-4047-b85f-b1d804cc3429" (UID: "c663ab8d-9404-4047-b85f-b1d804cc3429"). InnerVolumeSpecName "kube-api-access-zrhc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:35.158718 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.158688 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c663ab8d-9404-4047-b85f-b1d804cc3429-config-file\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:35.158718 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.158717 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrhc8\" (UniqueName: \"kubernetes.io/projected/c663ab8d-9404-4047-b85f-b1d804cc3429-kube-api-access-zrhc8\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:35.472184 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.472149 2573 generic.go:356] "Generic (PLEG): container finished" podID="c663ab8d-9404-4047-b85f-b1d804cc3429" containerID="01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a" exitCode=0 Jun 10 01:14:35.472608 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.472189 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" Jun 10 01:14:35.472608 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.472235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" event={"ID":"c663ab8d-9404-4047-b85f-b1d804cc3429","Type":"ContainerDied","Data":"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a"} Jun 10 01:14:35.472608 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.472293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zh84g" event={"ID":"c663ab8d-9404-4047-b85f-b1d804cc3429","Type":"ContainerDied","Data":"fc87e843509cad87e2f746107c2b3131ec21ab44fd2d86d3ed7921f6fa1e3027"} Jun 10 01:14:35.472608 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.472315 2573 scope.go:117] "RemoveContainer" containerID="01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a" Jun 10 01:14:35.481633 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.481618 2573 scope.go:117] "RemoveContainer" containerID="01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a" Jun 10 01:14:35.481887 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:14:35.481867 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a\": container with ID starting with 01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a not found: ID does not exist" containerID="01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a" Jun 10 01:14:35.481932 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.481894 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a"} err="failed to get container status \"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a\": rpc error: code = NotFound desc = could not find container \"01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a\": container with ID starting with 01442bfd5436d0688c2a645149e7437c20cbbd10d27b4f50c444c89d31d1d16a not found: ID does not exist" Jun 10 01:14:35.494499 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.494461 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:35.497742 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.497723 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zh84g"] Jun 10 01:14:35.556314 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.556270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:35.660156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.660128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:35.991973 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.991931 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c"] Jun 10 01:14:35.992643 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992622 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c663ab8d-9404-4047-b85f-b1d804cc3429" containerName="limitador" Jun 10 01:14:35.992704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992648 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c663ab8d-9404-4047-b85f-b1d804cc3429" containerName="limitador" Jun 10 01:14:35.992704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992678 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" containerName="authorino" Jun 10 01:14:35.992704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992687 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" containerName="authorino" Jun 10 01:14:35.992808 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992796 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c663ab8d-9404-4047-b85f-b1d804cc3429" containerName="limitador" Jun 10 01:14:35.992844 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.992815 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d292e1a4-eaa2-4049-a5da-c9c6871ab3d9" containerName="authorino" Jun 10 01:14:35.995876 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.995852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:35.998254 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.998226 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 01:14:35.998448 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.998428 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 01:14:35.998624 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.998363 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 10 01:14:35.998727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:35.998361 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-nwkfr\"" Jun 10 01:14:36.001892 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.001861 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c"] Jun 10 01:14:36.016383 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.016360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:36.067627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.067596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/b9583c0d-6225-405f-9b04-8b11fb2227d6-kube-api-access-84f2k\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.067785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.067651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9583c0d-6225-405f-9b04-8b11fb2227d6-data\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.168627 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.168588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/b9583c0d-6225-405f-9b04-8b11fb2227d6-kube-api-access-84f2k\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.168802 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.168650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9583c0d-6225-405f-9b04-8b11fb2227d6-data\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.169039 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.169020 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9583c0d-6225-405f-9b04-8b11fb2227d6-data\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.176704 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.176673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84f2k\" (UniqueName: \"kubernetes.io/projected/b9583c0d-6225-405f-9b04-8b11fb2227d6-kube-api-access-84f2k\") pod \"postgres-69fb4594cf-rc29c\" (UID: \"b9583c0d-6225-405f-9b04-8b11fb2227d6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.308929 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.308842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:36.447882 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.447852 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c"] Jun 10 01:14:36.449129 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:14:36.449094 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9583c0d_6225_405f_9b04_8b11fb2227d6.slice/crio-1713998d5ec572f8dad7acb13125c6f0e3f2ab398ce012d11784a982e90a75f1 WatchSource:0}: Error finding container 1713998d5ec572f8dad7acb13125c6f0e3f2ab398ce012d11784a982e90a75f1: Status 404 returned error can't find the container with id 1713998d5ec572f8dad7acb13125c6f0e3f2ab398ce012d11784a982e90a75f1 Jun 10 01:14:36.479967 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.479939 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" event={"ID":"b9583c0d-6225-405f-9b04-8b11fb2227d6","Type":"ContainerStarted","Data":"1713998d5ec572f8dad7acb13125c6f0e3f2ab398ce012d11784a982e90a75f1"} Jun 10 01:14:36.859700 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:36.859666 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c663ab8d-9404-4047-b85f-b1d804cc3429" path="/var/lib/kubelet/pods/c663ab8d-9404-4047-b85f-b1d804cc3429/volumes" Jun 10 01:14:38.499900 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:38.499861 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:42.522014 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:42.521979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" event={"ID":"b9583c0d-6225-405f-9b04-8b11fb2227d6","Type":"ContainerStarted","Data":"3c947f3cedfef36964c7d9422b04b4a13415748763a40e93d8d8273ec52fe7af"} Jun 10 01:14:42.522424 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:42.522132 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:42.538666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:42.538608 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" podStartSLOduration=2.390943822 podStartE2EDuration="7.538590189s" totalImagesPullingTime="5.147646367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:42.536857482 +0000 UTC m=+772.078687996" watchObservedRunningTime="2026-06-10 01:14:42.538590189 +0000 UTC m=+772.080420690" Jun 10 01:14:48.556886 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:48.556858 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-rc29c" Jun 10 01:14:48.847236 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:48.847142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:48.946457 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:48.946419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:49.089604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.089568 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:49.901977 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.901938 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt"] Jun 10 01:14:49.909280 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.909262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:49.911705 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.911678 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tnb6\"" Jun 10 01:14:49.911825 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.911762 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:14:49.912552 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.912459 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:14:49.913104 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:49.913084 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt"] Jun 10 01:14:50.007064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.007024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.007064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.007058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rjb\" (UniqueName: \"kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.007294 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.007193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.108509 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.108448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.108688 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.108549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.108688 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.108568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rjb\" (UniqueName: \"kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.108851 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.108831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.108891 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.108877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.117826 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.117798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rjb\" (UniqueName: \"kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.220686 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.220607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:50.356772 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.356744 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt"] Jun 10 01:14:50.358374 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:14:50.358345 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f80524e_5b68_4afd_ab8c_d92723d6777a.slice/crio-12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285 WatchSource:0}: Error finding container 12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285: Status 404 returned error can't find the container with id 12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285 Jun 10 01:14:50.569838 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.569802 2573 generic.go:356] "Generic (PLEG): container finished" podID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerID="787e7fc40fc4e1567dd630af84d8444d443fc5be991ff5f0c4ffd0300e4e7742" exitCode=0 Jun 10 01:14:50.570011 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.569849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" event={"ID":"6f80524e-5b68-4afd-ab8c-d92723d6777a","Type":"ContainerDied","Data":"787e7fc40fc4e1567dd630af84d8444d443fc5be991ff5f0c4ffd0300e4e7742"} Jun 10 01:14:50.570011 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:50.569893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" event={"ID":"6f80524e-5b68-4afd-ab8c-d92723d6777a","Type":"ContainerStarted","Data":"12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285"} Jun 10 01:14:51.577661 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:51.577565 2573 generic.go:356] "Generic (PLEG): container finished" podID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerID="79bc7251c9147f60e8a97c8144e967341defa7b9f9f2df27a0f9987248584d0c" exitCode=0 Jun 10 01:14:51.578027 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:51.577654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" event={"ID":"6f80524e-5b68-4afd-ab8c-d92723d6777a","Type":"ContainerDied","Data":"79bc7251c9147f60e8a97c8144e967341defa7b9f9f2df27a0f9987248584d0c"} Jun 10 01:14:52.585828 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:52.585793 2573 generic.go:356] "Generic (PLEG): container finished" podID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerID="b42ad7575f28c99de32a6ec7adcdfcec5e3e1a7d4d82420410d7712b5d0b2614" exitCode=0 Jun 10 01:14:52.586229 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:52.585884 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" event={"ID":"6f80524e-5b68-4afd-ab8c-d92723d6777a","Type":"ContainerDied","Data":"b42ad7575f28c99de32a6ec7adcdfcec5e3e1a7d4d82420410d7712b5d0b2614"} Jun 10 01:14:53.730073 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.730048 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:53.844120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.844021 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle\") pod \"6f80524e-5b68-4afd-ab8c-d92723d6777a\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " Jun 10 01:14:53.844120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.844072 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util\") pod \"6f80524e-5b68-4afd-ab8c-d92723d6777a\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " Jun 10 01:14:53.844338 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.844169 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rjb\" (UniqueName: \"kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb\") pod \"6f80524e-5b68-4afd-ab8c-d92723d6777a\" (UID: \"6f80524e-5b68-4afd-ab8c-d92723d6777a\") " Jun 10 01:14:53.844657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.844624 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle" (OuterVolumeSpecName: "bundle") pod "6f80524e-5b68-4afd-ab8c-d92723d6777a" (UID: "6f80524e-5b68-4afd-ab8c-d92723d6777a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:14:53.846173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.846149 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb" (OuterVolumeSpecName: "kube-api-access-59rjb") pod "6f80524e-5b68-4afd-ab8c-d92723d6777a" (UID: "6f80524e-5b68-4afd-ab8c-d92723d6777a"). InnerVolumeSpecName "kube-api-access-59rjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:53.849453 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.849430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util" (OuterVolumeSpecName: "util") pod "6f80524e-5b68-4afd-ab8c-d92723d6777a" (UID: "6f80524e-5b68-4afd-ab8c-d92723d6777a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:14:53.945802 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.945764 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-bundle\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:53.945802 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.945795 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f80524e-5b68-4afd-ab8c-d92723d6777a-util\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:53.945802 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:53.945804 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rjb\" (UniqueName: \"kubernetes.io/projected/6f80524e-5b68-4afd-ab8c-d92723d6777a-kube-api-access-59rjb\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:14:54.600245 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:54.600213 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" Jun 10 01:14:54.600245 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:54.600240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hxvzt" event={"ID":"6f80524e-5b68-4afd-ab8c-d92723d6777a","Type":"ContainerDied","Data":"12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285"} Jun 10 01:14:54.600494 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:54.600298 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12c5ed4582bccb7d0d807fcb5bbfaf6ecd3cf4661d02858149075df9944a8285" Jun 10 01:14:57.142794 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.142753 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-j79db"] Jun 10 01:14:57.143166 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143155 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="extract" Jun 10 01:14:57.143206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143168 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="extract" Jun 10 01:14:57.143206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143182 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="pull" Jun 10 01:14:57.143206 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143188 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="pull" Jun 10 01:14:57.143300 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143207 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="util" Jun 10 01:14:57.143300 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143214 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="util" Jun 10 01:14:57.143300 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.143275 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f80524e-5b68-4afd-ab8c-d92723d6777a" containerName="extract" Jun 10 01:14:57.351152 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.351109 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-j79db"] Jun 10 01:14:57.351319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.351225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" Jun 10 01:14:57.353858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.353837 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 01:14:57.353993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.353890 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 01:14:57.353993 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.353952 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-g867n\"" Jun 10 01:14:57.483657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.483544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tdmj\" (UniqueName: \"kubernetes.io/projected/2e8f5d04-3732-4438-b962-191a8cf511b0-kube-api-access-7tdmj\") pod \"keycloak-operator-d67dbbb48-j79db\" (UID: \"2e8f5d04-3732-4438-b962-191a8cf511b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" Jun 10 01:14:57.585034 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.584990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tdmj\" (UniqueName: \"kubernetes.io/projected/2e8f5d04-3732-4438-b962-191a8cf511b0-kube-api-access-7tdmj\") pod \"keycloak-operator-d67dbbb48-j79db\" (UID: \"2e8f5d04-3732-4438-b962-191a8cf511b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" Jun 10 01:14:57.593564 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.593519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tdmj\" (UniqueName: \"kubernetes.io/projected/2e8f5d04-3732-4438-b962-191a8cf511b0-kube-api-access-7tdmj\") pod \"keycloak-operator-d67dbbb48-j79db\" (UID: \"2e8f5d04-3732-4438-b962-191a8cf511b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" Jun 10 01:14:57.661220 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.661181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" Jun 10 01:14:57.800159 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:57.800126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-j79db"] Jun 10 01:14:57.801517 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:14:57.801448 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8f5d04_3732_4438_b962_191a8cf511b0.slice/crio-f013ec1e1757f77f2b9c7e4fe1caac15588f59365e2a3daeff5e96d033908797 WatchSource:0}: Error finding container f013ec1e1757f77f2b9c7e4fe1caac15588f59365e2a3daeff5e96d033908797: Status 404 returned error can't find the container with id f013ec1e1757f77f2b9c7e4fe1caac15588f59365e2a3daeff5e96d033908797 Jun 10 01:14:58.626863 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:14:58.626792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" event={"ID":"2e8f5d04-3732-4438-b962-191a8cf511b0","Type":"ContainerStarted","Data":"f013ec1e1757f77f2b9c7e4fe1caac15588f59365e2a3daeff5e96d033908797"} Jun 10 01:15:05.671684 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:05.671647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" event={"ID":"2e8f5d04-3732-4438-b962-191a8cf511b0","Type":"ContainerStarted","Data":"0b2b0a1fb5aac9387c4ce414bb5de2e9b89aa65ad8f88d9f5d03b6779ef0f492"} Jun 10 01:15:05.692483 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:05.692424 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-j79db" podStartSLOduration=1.71143716 podStartE2EDuration="8.692408139s" totalImagesPullingTime="6.980970979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:05.688425947 +0000 UTC m=+795.230256448" watchObservedRunningTime="2026-06-10 01:15:05.692408139 +0000 UTC m=+795.234238640" Jun 10 01:15:14.093117 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:14.093076 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:14.144213 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:14.144173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:44.547292 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.547212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:44.741805 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.741768 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:44.765736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.765700 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:44.772915 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.772886 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:44.773079 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.772979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:44.775337 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.775308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9vbnj\"" Jun 10 01:15:44.852305 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.852267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl8tc\" (UniqueName: \"kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc\") pod \"authorino-5d4b67c446-2hbms\" (UID: \"83bc29e4-353d-4844-b8f3-89f681f4d1d3\") " pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:44.953011 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.952980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl8tc\" (UniqueName: \"kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc\") pod \"authorino-5d4b67c446-2hbms\" (UID: \"83bc29e4-353d-4844-b8f3-89f681f4d1d3\") " pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:44.960379 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.960353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl8tc\" (UniqueName: \"kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc\") pod \"authorino-5d4b67c446-2hbms\" (UID: \"83bc29e4-353d-4844-b8f3-89f681f4d1d3\") " pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:44.982513 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.982461 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:44.982795 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:44.982782 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:45.008093 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.008062 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9d5699fb5-qdblb"] Jun 10 01:15:45.010764 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.010739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.023870 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.023828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9d5699fb5-qdblb"] Jun 10 01:15:45.051987 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.051954 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9d5699fb5-qdblb"] Jun 10 01:15:45.052392 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:15:45.052355 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5dz9r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-9d5699fb5-qdblb" podUID="1820e466-8b21-453b-abd8-052d6cc115ea" Jun 10 01:15:45.054330 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.054297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dz9r\" (UniqueName: \"kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r\") pod \"authorino-9d5699fb5-qdblb\" (UID: \"1820e466-8b21-453b-abd8-052d6cc115ea\") " pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.078667 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.078630 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:15:45.082177 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.082150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.084702 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.084678 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 01:15:45.088529 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.088460 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:15:45.126064 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.126037 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:45.127395 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:15:45.127363 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83bc29e4_353d_4844_b8f3_89f681f4d1d3.slice/crio-7548b6f13d9cb134980bd7a96c72d388391c91dcd7f339641232aaa694ad911c WatchSource:0}: Error finding container 7548b6f13d9cb134980bd7a96c72d388391c91dcd7f339641232aaa694ad911c: Status 404 returned error can't find the container with id 7548b6f13d9cb134980bd7a96c72d388391c91dcd7f339641232aaa694ad911c Jun 10 01:15:45.155846 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.155819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8qs\" (UniqueName: \"kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.156067 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.155919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.156067 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.155947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dz9r\" (UniqueName: \"kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r\") pod \"authorino-9d5699fb5-qdblb\" (UID: \"1820e466-8b21-453b-abd8-052d6cc115ea\") " pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.163411 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.163377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dz9r\" (UniqueName: \"kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r\") pod \"authorino-9d5699fb5-qdblb\" (UID: \"1820e466-8b21-453b-abd8-052d6cc115ea\") " pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.256871 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.256840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.257059 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.256895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8qs\" (UniqueName: \"kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.259247 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.259222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.263912 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.263891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8qs\" (UniqueName: \"kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs\") pod \"authorino-d89b64bbf-hh4tr\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.393593 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.393504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:15:45.529965 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.529939 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:15:45.530954 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:15:45.530919 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb87b396b_3978_495c_b70f_a73904346f32.slice/crio-8dc61e20e2f5062665cadce581a2572487b9f81d26091daa8bfd5bf4b5e7e883 WatchSource:0}: Error finding container 8dc61e20e2f5062665cadce581a2572487b9f81d26091daa8bfd5bf4b5e7e883: Status 404 returned error can't find the container with id 8dc61e20e2f5062665cadce581a2572487b9f81d26091daa8bfd5bf4b5e7e883 Jun 10 01:15:45.913107 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.913078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hbms" event={"ID":"83bc29e4-353d-4844-b8f3-89f681f4d1d3","Type":"ContainerStarted","Data":"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f"} Jun 10 01:15:45.913520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.913119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hbms" event={"ID":"83bc29e4-353d-4844-b8f3-89f681f4d1d3","Type":"ContainerStarted","Data":"7548b6f13d9cb134980bd7a96c72d388391c91dcd7f339641232aaa694ad911c"} Jun 10 01:15:45.913520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.913123 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2hbms" podUID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" containerName="authorino" containerID="cri-o://f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f" gracePeriod=30 Jun 10 01:15:45.914735 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.914711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" event={"ID":"b87b396b-3978-495c-b70f-a73904346f32","Type":"ContainerStarted","Data":"8dc61e20e2f5062665cadce581a2572487b9f81d26091daa8bfd5bf4b5e7e883"} Jun 10 01:15:45.914735 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.914726 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.922269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.922247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:45.930096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.930046 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2hbms" podStartSLOduration=1.61791068 podStartE2EDuration="1.930030175s" totalImagesPullingTime="312.119495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:45.926449821 +0000 UTC m=+835.468280346" watchObservedRunningTime="2026-06-10 01:15:45.930030175 +0000 UTC m=+835.471860677" Jun 10 01:15:45.941560 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.941508 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" podStartSLOduration=0.620731853 podStartE2EDuration="941.492592ms" totalImagesPullingTime="320.760739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:45.940762114 +0000 UTC m=+835.482592618" watchObservedRunningTime="2026-06-10 01:15:45.941492592 +0000 UTC m=+835.483323087" Jun 10 01:15:45.964283 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.964245 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dz9r\" (UniqueName: \"kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r\") pod \"1820e466-8b21-453b-abd8-052d6cc115ea\" (UID: \"1820e466-8b21-453b-abd8-052d6cc115ea\") " Jun 10 01:15:45.967432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:45.967396 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r" (OuterVolumeSpecName: "kube-api-access-5dz9r") pod "1820e466-8b21-453b-abd8-052d6cc115ea" (UID: "1820e466-8b21-453b-abd8-052d6cc115ea"). InnerVolumeSpecName "kube-api-access-5dz9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:15:46.065308 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.065272 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dz9r\" (UniqueName: \"kubernetes.io/projected/1820e466-8b21-453b-abd8-052d6cc115ea-kube-api-access-5dz9r\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:15:46.158692 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.158661 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:46.266995 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.266957 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl8tc\" (UniqueName: \"kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc\") pod \"83bc29e4-353d-4844-b8f3-89f681f4d1d3\" (UID: \"83bc29e4-353d-4844-b8f3-89f681f4d1d3\") " Jun 10 01:15:46.269087 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.269055 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc" (OuterVolumeSpecName: "kube-api-access-xl8tc") pod "83bc29e4-353d-4844-b8f3-89f681f4d1d3" (UID: "83bc29e4-353d-4844-b8f3-89f681f4d1d3"). InnerVolumeSpecName "kube-api-access-xl8tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:15:46.368320 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.368280 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl8tc\" (UniqueName: \"kubernetes.io/projected/83bc29e4-353d-4844-b8f3-89f681f4d1d3-kube-api-access-xl8tc\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:15:46.921777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.921737 2573 generic.go:356] "Generic (PLEG): container finished" podID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" containerID="f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f" exitCode=0 Jun 10 01:15:46.922281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.921783 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hbms" Jun 10 01:15:46.922281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.921818 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hbms" event={"ID":"83bc29e4-353d-4844-b8f3-89f681f4d1d3","Type":"ContainerDied","Data":"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f"} Jun 10 01:15:46.922281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.921863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hbms" event={"ID":"83bc29e4-353d-4844-b8f3-89f681f4d1d3","Type":"ContainerDied","Data":"7548b6f13d9cb134980bd7a96c72d388391c91dcd7f339641232aaa694ad911c"} Jun 10 01:15:46.922281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.921882 2573 scope.go:117] "RemoveContainer" containerID="f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f" Jun 10 01:15:46.923788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.923738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d5699fb5-qdblb" Jun 10 01:15:46.923788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.923743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" event={"ID":"b87b396b-3978-495c-b70f-a73904346f32","Type":"ContainerStarted","Data":"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7"} Jun 10 01:15:46.931729 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.931710 2573 scope.go:117] "RemoveContainer" containerID="f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f" Jun 10 01:15:46.932048 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:15:46.932022 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f\": container with ID starting with f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f not found: ID does not exist" containerID="f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f" Jun 10 01:15:46.932106 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.932061 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f"} err="failed to get container status \"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f\": rpc error: code = NotFound desc = could not find container \"f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f\": container with ID starting with f9b832d7878a713b6aeb850801347dffb1d1f222b120128483da45e8872b1c7f not found: ID does not exist" Jun 10 01:15:46.944339 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.944313 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:46.947955 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.947931 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hbms"] Jun 10 01:15:46.966803 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.966773 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9d5699fb5-qdblb"] Jun 10 01:15:46.971851 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:46.971823 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9d5699fb5-qdblb"] Jun 10 01:15:48.859164 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:48.859122 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1820e466-8b21-453b-abd8-052d6cc115ea" path="/var/lib/kubelet/pods/1820e466-8b21-453b-abd8-052d6cc115ea/volumes" Jun 10 01:15:48.859688 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:48.859523 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" path="/var/lib/kubelet/pods/83bc29e4-353d-4844-b8f3-89f681f4d1d3/volumes" Jun 10 01:15:49.380387 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:49.380355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:49.475492 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:49.475448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:49.539433 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:49.539395 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:49.689323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:49.689236 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:52.768660 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:52.768627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:52.866563 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:52.866513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:55.003497 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:55.003426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:55.050728 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:15:55.050693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:23.793539 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:23.793505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:24.202528 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:24.202489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:24.302045 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:24.302013 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:24.453765 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:24.453683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:50.908486 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:50.908432 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:16:50.910924 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:16:50.910900 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:17:14.324043 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.324006 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:17:14.325323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.324453 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" containerName="authorino" Jun 10 01:17:14.325323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.324481 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" containerName="authorino" Jun 10 01:17:14.325323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.324547 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="83bc29e4-353d-4844-b8f3-89f681f4d1d3" containerName="authorino" Jun 10 01:17:14.326370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.326355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.328454 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.328432 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 01:17:14.335533 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.335487 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:17:14.405422 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.405384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.405659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.405553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.405659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.405622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwx9z\" (UniqueName: \"kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.507151 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.507112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.507332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.507171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwx9z\" (UniqueName: \"kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.507332 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.507214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.507926 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.507894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.509694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.509672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.514090 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.514063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwx9z\" (UniqueName: \"kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z\") pod \"authorino-865f856b85-5k72p\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.635845 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.635807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:17:14.769866 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:14.769832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:17:14.771533 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:17:14.771503 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc94eb8eb_0814_41b1_949a_c5e6fbadab48.slice/crio-1e81bacdb75ddacd3b96cd4b31328d849f0c28317ef8ea4038ddcbabbc79c3ad WatchSource:0}: Error finding container 1e81bacdb75ddacd3b96cd4b31328d849f0c28317ef8ea4038ddcbabbc79c3ad: Status 404 returned error can't find the container with id 1e81bacdb75ddacd3b96cd4b31328d849f0c28317ef8ea4038ddcbabbc79c3ad Jun 10 01:17:15.440739 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.440700 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865f856b85-5k72p" event={"ID":"c94eb8eb-0814-41b1-949a-c5e6fbadab48","Type":"ContainerStarted","Data":"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014"} Jun 10 01:17:15.441134 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.440750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865f856b85-5k72p" event={"ID":"c94eb8eb-0814-41b1-949a-c5e6fbadab48","Type":"ContainerStarted","Data":"1e81bacdb75ddacd3b96cd4b31328d849f0c28317ef8ea4038ddcbabbc79c3ad"} Jun 10 01:17:15.458318 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.458269 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-865f856b85-5k72p" podStartSLOduration=1.1681227650000001 podStartE2EDuration="1.458253945s" totalImagesPullingTime="290.13118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:17:15.457405191 +0000 UTC m=+924.999235692" watchObservedRunningTime="2026-06-10 01:17:15.458253945 +0000 UTC m=+925.000084444" Jun 10 01:17:15.485694 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.485656 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:17:15.486139 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.486091 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" podUID="b87b396b-3978-495c-b70f-a73904346f32" containerName="authorino" containerID="cri-o://c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7" gracePeriod=30 Jun 10 01:17:15.734737 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.734714 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:17:15.821356 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.821318 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg8qs\" (UniqueName: \"kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs\") pod \"b87b396b-3978-495c-b70f-a73904346f32\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " Jun 10 01:17:15.821561 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.821420 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert\") pod \"b87b396b-3978-495c-b70f-a73904346f32\" (UID: \"b87b396b-3978-495c-b70f-a73904346f32\") " Jun 10 01:17:15.823451 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.823408 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs" (OuterVolumeSpecName: "kube-api-access-rg8qs") pod "b87b396b-3978-495c-b70f-a73904346f32" (UID: "b87b396b-3978-495c-b70f-a73904346f32"). InnerVolumeSpecName "kube-api-access-rg8qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:17:15.831739 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.831716 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b87b396b-3978-495c-b70f-a73904346f32" (UID: "b87b396b-3978-495c-b70f-a73904346f32"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:17:15.897615 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.897584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:15.922707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.922673 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b87b396b-3978-495c-b70f-a73904346f32-tls-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:17:15.922707 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:15.922700 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg8qs\" (UniqueName: \"kubernetes.io/projected/b87b396b-3978-495c-b70f-a73904346f32-kube-api-access-rg8qs\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:17:16.448724 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.448685 2573 generic.go:356] "Generic (PLEG): container finished" podID="b87b396b-3978-495c-b70f-a73904346f32" containerID="c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7" exitCode=0 Jun 10 01:17:16.449156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.448737 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" Jun 10 01:17:16.449156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.448773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" event={"ID":"b87b396b-3978-495c-b70f-a73904346f32","Type":"ContainerDied","Data":"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7"} Jun 10 01:17:16.449156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.448815 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d89b64bbf-hh4tr" event={"ID":"b87b396b-3978-495c-b70f-a73904346f32","Type":"ContainerDied","Data":"8dc61e20e2f5062665cadce581a2572487b9f81d26091daa8bfd5bf4b5e7e883"} Jun 10 01:17:16.449156 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.448836 2573 scope.go:117] "RemoveContainer" containerID="c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7" Jun 10 01:17:16.458758 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.458737 2573 scope.go:117] "RemoveContainer" containerID="c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7" Jun 10 01:17:16.459007 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:17:16.458990 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7\": container with ID starting with c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7 not found: ID does not exist" containerID="c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7" Jun 10 01:17:16.459052 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.459014 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7"} err="failed to get container status \"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7\": rpc error: code = NotFound desc = could not find container \"c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7\": container with ID starting with c298d0f164b512a49d6a72056306236c3767325ae46e763fcd0818ff9ff1c7f7 not found: ID does not exist" Jun 10 01:17:16.470551 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.470523 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:17:16.481589 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.481562 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d89b64bbf-hh4tr"] Jun 10 01:17:16.859479 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:16.859430 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b87b396b-3978-495c-b70f-a73904346f32" path="/var/lib/kubelet/pods/b87b396b-3978-495c-b70f-a73904346f32/volumes" Jun 10 01:17:17.123495 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:17.123383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:26.205531 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:26.205494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:33.294965 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:33.294931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:39.083026 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:39.082993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:55.284363 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:55.284324 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:55.335719 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:55.335679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:56.281656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:56.281622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:56.330284 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:56.330250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:56.831520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:17:56.831456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:00.594619 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:18:00.594583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:05.990988 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:18:05.990902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:09.321885 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.321851 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dbff98b48-5jwv8"] Jun 10 01:19:09.322370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.322258 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b87b396b-3978-495c-b70f-a73904346f32" containerName="authorino" Jun 10 01:19:09.322370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.322269 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b87b396b-3978-495c-b70f-a73904346f32" containerName="authorino" Jun 10 01:19:09.322370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.322339 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b87b396b-3978-495c-b70f-a73904346f32" containerName="authorino" Jun 10 01:19:09.325539 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.325517 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.330647 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.330615 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbff98b48-5jwv8"] Jun 10 01:19:09.400126 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.400080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d0773570-cd31-4a62-abe8-2402ed05ea95-oidc-ca\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.400126 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.400125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0773570-cd31-4a62-abe8-2402ed05ea95-tls-cert\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.400402 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.400190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jx9\" (UniqueName: \"kubernetes.io/projected/d0773570-cd31-4a62-abe8-2402ed05ea95-kube-api-access-94jx9\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.501600 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.501555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d0773570-cd31-4a62-abe8-2402ed05ea95-oidc-ca\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.501600 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.501606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0773570-cd31-4a62-abe8-2402ed05ea95-tls-cert\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.501822 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.501637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jx9\" (UniqueName: \"kubernetes.io/projected/d0773570-cd31-4a62-abe8-2402ed05ea95-kube-api-access-94jx9\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.502353 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.502328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d0773570-cd31-4a62-abe8-2402ed05ea95-oidc-ca\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.504224 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.504200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0773570-cd31-4a62-abe8-2402ed05ea95-tls-cert\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.508629 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.508606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jx9\" (UniqueName: \"kubernetes.io/projected/d0773570-cd31-4a62-abe8-2402ed05ea95-kube-api-access-94jx9\") pod \"authorino-dbff98b48-5jwv8\" (UID: \"d0773570-cd31-4a62-abe8-2402ed05ea95\") " pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.636576 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.636524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbff98b48-5jwv8" Jun 10 01:19:09.732848 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.732801 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:09.778369 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.778343 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbff98b48-5jwv8"] Jun 10 01:19:09.780421 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:19:09.780393 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0773570_cd31_4a62_abe8_2402ed05ea95.slice/crio-00daf88f0a12f3b54d874117d1329b7ece1a76e4d7c3bcdaed167eac3427d680 WatchSource:0}: Error finding container 00daf88f0a12f3b54d874117d1329b7ece1a76e4d7c3bcdaed167eac3427d680: Status 404 returned error can't find the container with id 00daf88f0a12f3b54d874117d1329b7ece1a76e4d7c3bcdaed167eac3427d680 Jun 10 01:19:09.781857 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.781838 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:19:09.834990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:09.834952 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:10.135073 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:10.135031 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbff98b48-5jwv8" event={"ID":"d0773570-cd31-4a62-abe8-2402ed05ea95","Type":"ContainerStarted","Data":"00daf88f0a12f3b54d874117d1329b7ece1a76e4d7c3bcdaed167eac3427d680"} Jun 10 01:19:10.812426 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:10.812387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:10.913738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:10.913699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:11.145079 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.145041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbff98b48-5jwv8" event={"ID":"d0773570-cd31-4a62-abe8-2402ed05ea95","Type":"ContainerStarted","Data":"61296d22d06e53f97d593092ec421905904861ca36709919b8494eb025b73d7b"} Jun 10 01:19:11.161533 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.161448 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dbff98b48-5jwv8" podStartSLOduration=1.758752637 podStartE2EDuration="2.161427544s" totalImagesPullingTime="402.674907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:11.160761982 +0000 UTC m=+1040.702592494" watchObservedRunningTime="2026-06-10 01:19:11.161427544 +0000 UTC m=+1040.703258045" Jun 10 01:19:11.186285 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.186251 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:19:11.186520 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.186480 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-865f856b85-5k72p" podUID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" containerName="authorino" containerID="cri-o://eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014" gracePeriod=30 Jun 10 01:19:11.447817 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.447785 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:19:11.522595 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.522551 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca\") pod \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " Jun 10 01:19:11.522786 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.522622 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwx9z\" (UniqueName: \"kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z\") pod \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " Jun 10 01:19:11.522786 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.522701 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert\") pod \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\" (UID: \"c94eb8eb-0814-41b1-949a-c5e6fbadab48\") " Jun 10 01:19:11.524663 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.524626 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z" (OuterVolumeSpecName: "kube-api-access-rwx9z") pod "c94eb8eb-0814-41b1-949a-c5e6fbadab48" (UID: "c94eb8eb-0814-41b1-949a-c5e6fbadab48"). InnerVolumeSpecName "kube-api-access-rwx9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:19:11.529170 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.529141 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c94eb8eb-0814-41b1-949a-c5e6fbadab48" (UID: "c94eb8eb-0814-41b1-949a-c5e6fbadab48"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:19:11.534125 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.534093 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c94eb8eb-0814-41b1-949a-c5e6fbadab48" (UID: "c94eb8eb-0814-41b1-949a-c5e6fbadab48"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:19:11.623691 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.623652 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c94eb8eb-0814-41b1-949a-c5e6fbadab48-oidc-ca\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:19:11.623691 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.623686 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwx9z\" (UniqueName: \"kubernetes.io/projected/c94eb8eb-0814-41b1-949a-c5e6fbadab48-kube-api-access-rwx9z\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:19:11.623691 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:11.623696 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c94eb8eb-0814-41b1-949a-c5e6fbadab48-tls-cert\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:19:12.152513 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.152480 2573 generic.go:356] "Generic (PLEG): container finished" podID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" containerID="eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014" exitCode=0 Jun 10 01:19:12.153033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.152546 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865f856b85-5k72p" Jun 10 01:19:12.153033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.152563 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865f856b85-5k72p" event={"ID":"c94eb8eb-0814-41b1-949a-c5e6fbadab48","Type":"ContainerDied","Data":"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014"} Jun 10 01:19:12.153033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.152609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865f856b85-5k72p" event={"ID":"c94eb8eb-0814-41b1-949a-c5e6fbadab48","Type":"ContainerDied","Data":"1e81bacdb75ddacd3b96cd4b31328d849f0c28317ef8ea4038ddcbabbc79c3ad"} Jun 10 01:19:12.153033 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.152628 2573 scope.go:117] "RemoveContainer" containerID="eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014" Jun 10 01:19:12.163075 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.163056 2573 scope.go:117] "RemoveContainer" containerID="eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014" Jun 10 01:19:12.163321 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:19:12.163301 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014\": container with ID starting with eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014 not found: ID does not exist" containerID="eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014" Jun 10 01:19:12.163362 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.163329 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014"} err="failed to get container status \"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014\": rpc error: code = NotFound desc = could not find container \"eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014\": container with ID starting with eb50b47467614f20fab0304d19404043e81d5a9656b020dad283670001def014 not found: ID does not exist" Jun 10 01:19:12.176103 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.176074 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:19:12.179118 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.179095 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-865f856b85-5k72p"] Jun 10 01:19:12.859864 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:12.859830 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" path="/var/lib/kubelet/pods/c94eb8eb-0814-41b1-949a-c5e6fbadab48/volumes" Jun 10 01:19:58.289569 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:19:58.289530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:36.140349 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:20:36.140305 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:38.047201 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:20:38.047161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:17.817427 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:17.817327 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:17.919222 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:17.919186 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:18.140641 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:18.140601 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:18.547233 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:18.547135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:18.644451 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:18.644407 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:26.365930 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:26.365892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:32.239173 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:32.239140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:32.296755 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:32.296717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:50.952302 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:50.952270 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:21:50.964072 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:21:50.964045 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:22:04.349367 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:04.349319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:04.450000 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:04.449964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:04.547168 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:04.547133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:04.996346 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:04.996313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:05.093112 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:05.093078 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:28.308637 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:28.308602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:33.990199 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:33.990119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:34.093661 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:34.093622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:34.187873 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:34.187838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:34.352153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:34.352121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:34.518574 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:34.518537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:50.854120 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:50.854057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:50.961479 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:50.961444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:51.067431 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:51.067393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:54.031962 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:54.031928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:54.131874 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:54.131840 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:56.898715 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:56.898677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:22:56.948096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:22:56.948059 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:05.036407 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:05.036369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:05.137455 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:05.137403 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:05.236127 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:05.236091 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:05.336183 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:05.336096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:21.719997 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:21.719962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:21.823771 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:21.823736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:21.935748 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:21.935715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:27.559662 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:27.559613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:27.618777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:27.618744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:47.921281 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:47.921245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:48.048603 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:48.048567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:48.148879 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:48.148847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:53.638215 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:53.638179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:53.692247 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:53.692213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:53.779076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:53.779039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:53.877847 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:53.877814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:53.982227 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:53.982142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:59.660763 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:59.660726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:23:59.713681 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:23:59.713644 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:25:58.906747 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:25:58.906706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:25:58.957854 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:25:58.957821 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:26:50.995522 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:26:50.995493 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:26:51.008457 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:26:51.008430 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:30:00.138446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.138401 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:30:00.139085 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.139063 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" containerName="authorino" Jun 10 01:30:00.139179 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.139089 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" containerName="authorino" Jun 10 01:30:00.139234 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.139192 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94eb8eb-0814-41b1-949a-c5e6fbadab48" containerName="authorino" Jun 10 01:30:00.142306 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.142283 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:30:00.144683 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.144661 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-dph74\"" Jun 10 01:30:00.158515 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.158462 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:30:00.190242 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.190200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cz76\" (UniqueName: \"kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76\") pod \"maas-api-key-cleanup-29684250-tqqxz\" (UID: \"3bdfe364-6433-4c43-95b6-e64409012075\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:30:00.290865 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.290822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cz76\" (UniqueName: \"kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76\") pod \"maas-api-key-cleanup-29684250-tqqxz\" (UID: \"3bdfe364-6433-4c43-95b6-e64409012075\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:30:00.298984 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.298960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cz76\" (UniqueName: \"kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76\") pod \"maas-api-key-cleanup-29684250-tqqxz\" (UID: \"3bdfe364-6433-4c43-95b6-e64409012075\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:30:00.453000 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.452916 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:30:00.588313 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.588281 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:30:00.589771 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:30:00.589746 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdfe364_6433_4c43_95b6_e64409012075.slice/crio-ca0aa89b210251da0473524a831080de06e7653070e07c71e9a2863625a347e7 WatchSource:0}: Error finding container ca0aa89b210251da0473524a831080de06e7653070e07c71e9a2863625a347e7: Status 404 returned error can't find the container with id ca0aa89b210251da0473524a831080de06e7653070e07c71e9a2863625a347e7 Jun 10 01:30:00.591733 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:00.591713 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:30:01.065062 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:01.065027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" event={"ID":"3bdfe364-6433-4c43-95b6-e64409012075","Type":"ContainerStarted","Data":"ca0aa89b210251da0473524a831080de06e7653070e07c71e9a2863625a347e7"} Jun 10 01:30:05.098620 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:05.098584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" event={"ID":"3bdfe364-6433-4c43-95b6-e64409012075","Type":"ContainerStarted","Data":"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028"} Jun 10 01:30:05.113387 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:30:05.113340 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" podStartSLOduration=1.798751678 podStartE2EDuration="5.113325613s" totalImagesPullingTime="3.314573935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:30:05.112228685 +0000 UTC m=+1694.654059186" watchObservedRunningTime="2026-06-10 01:30:05.113325613 +0000 UTC m=+1694.655156114" Jun 10 01:31:00.013153 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:00.013113 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:31:00.013643 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:00.013310 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" podUID="3bdfe364-6433-4c43-95b6-e64409012075" containerName="cleanup" containerID="cri-o://d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028" gracePeriod=30 Jun 10 01:31:30.204652 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.204620 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:31:30.262666 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.262633 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cz76\" (UniqueName: \"kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76\") pod \"3bdfe364-6433-4c43-95b6-e64409012075\" (UID: \"3bdfe364-6433-4c43-95b6-e64409012075\") " Jun 10 01:31:30.264849 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.264824 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76" (OuterVolumeSpecName: "kube-api-access-2cz76") pod "3bdfe364-6433-4c43-95b6-e64409012075" (UID: "3bdfe364-6433-4c43-95b6-e64409012075"). InnerVolumeSpecName "kube-api-access-2cz76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:31:30.363408 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.363375 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cz76\" (UniqueName: \"kubernetes.io/projected/3bdfe364-6433-4c43-95b6-e64409012075-kube-api-access-2cz76\") on node \"ip-10-0-132-148.ec2.internal\" DevicePath \"\"" Jun 10 01:31:30.602398 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.602368 2573 generic.go:356] "Generic (PLEG): container finished" podID="3bdfe364-6433-4c43-95b6-e64409012075" containerID="d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028" exitCode=137 Jun 10 01:31:30.602604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.602415 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" Jun 10 01:31:30.602604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.602416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" event={"ID":"3bdfe364-6433-4c43-95b6-e64409012075","Type":"ContainerDied","Data":"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028"} Jun 10 01:31:30.602604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.602548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz" event={"ID":"3bdfe364-6433-4c43-95b6-e64409012075","Type":"ContainerDied","Data":"ca0aa89b210251da0473524a831080de06e7653070e07c71e9a2863625a347e7"} Jun 10 01:31:30.602604 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.602573 2573 scope.go:117] "RemoveContainer" containerID="d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028" Jun 10 01:31:30.613014 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.612935 2573 scope.go:117] "RemoveContainer" containerID="d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028" Jun 10 01:31:30.613250 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:31:30.613233 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028\": container with ID starting with d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028 not found: ID does not exist" containerID="d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028" Jun 10 01:31:30.613296 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.613261 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028"} err="failed to get container status \"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028\": rpc error: code = NotFound desc = could not find container \"d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028\": container with ID starting with d621832ccb8007dcd198bd27e2f469143be2fe702033e8a8de0641e0551ea028 not found: ID does not exist" Jun 10 01:31:30.623571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.623542 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:31:30.629116 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.629091 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684250-tqqxz"] Jun 10 01:31:30.860180 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:30.860082 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bdfe364-6433-4c43-95b6-e64409012075" path="/var/lib/kubelet/pods/3bdfe364-6433-4c43-95b6-e64409012075/volumes" Jun 10 01:31:51.038397 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:51.038368 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:31:51.053650 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:31:51.053630 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:32:05.032945 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:32:05.032898 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:34:03.607786 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:34:03.607751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:35:06.422003 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:35:06.421968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:35:06.522668 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:35:06.522635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:35:40.528726 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:35:40.528686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:36:51.081402 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:36:51.081374 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:36:51.104610 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:36:51.104575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:37:48.583293 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:37:48.583256 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:38:14.379643 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:38:14.379597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:38:14.426803 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:38:14.426767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:40:01.827434 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:40:01.827394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:40:52.623820 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:40:52.623771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:40:58.018027 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:40:58.017963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:22.266167 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:22.266132 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:35.306438 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:35.306404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:36.898858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:36.898827 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:36.945990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:36.945949 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.047771 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.047724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.127658 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.127573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.129648 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.129620 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr"] Jun 10 01:41:37.130091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.130069 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bdfe364-6433-4c43-95b6-e64409012075" containerName="cleanup" Jun 10 01:41:37.130091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.130087 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bdfe364-6433-4c43-95b6-e64409012075" containerName="cleanup" Jun 10 01:41:37.130277 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.130172 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bdfe364-6433-4c43-95b6-e64409012075" containerName="cleanup" Jun 10 01:41:37.133459 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.133440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.136626 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.136602 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 01:41:37.136725 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.136602 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-dph74\"" Jun 10 01:41:37.144631 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.144610 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr"] Jun 10 01:41:37.233047 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.233006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69467d5f-9a72-4019-886a-009d87013103-maas-api-tls\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.233239 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.233146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f49z\" (UniqueName: \"kubernetes.io/projected/69467d5f-9a72-4019-886a-009d87013103-kube-api-access-5f49z\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.250211 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.250171 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.334699 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.334658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69467d5f-9a72-4019-886a-009d87013103-maas-api-tls\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.334882 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.334756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f49z\" (UniqueName: \"kubernetes.io/projected/69467d5f-9a72-4019-886a-009d87013103-kube-api-access-5f49z\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.337428 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.337393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69467d5f-9a72-4019-886a-009d87013103-maas-api-tls\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.346602 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.346575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f49z\" (UniqueName: \"kubernetes.io/projected/69467d5f-9a72-4019-886a-009d87013103-kube-api-access-5f49z\") pod \"maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr\" (UID: \"69467d5f-9a72-4019-886a-009d87013103\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.447668 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.447566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:37.472825 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.472790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.598756 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.598730 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr"] Jun 10 01:41:37.600669 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:41:37.600638 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69467d5f_9a72_4019_886a_009d87013103.slice/crio-19569ae40a165f27e429157bf672f603ed110d71cbf319d7014f033253be4b08 WatchSource:0}: Error finding container 19569ae40a165f27e429157bf672f603ed110d71cbf319d7014f033253be4b08: Status 404 returned error can't find the container with id 19569ae40a165f27e429157bf672f603ed110d71cbf319d7014f033253be4b08 Jun 10 01:41:37.602123 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.602104 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:41:37.613176 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.613148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.791449 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.791350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.891689 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.891657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:37.991261 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:37.991220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:38.234116 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:38.234077 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerStarted","Data":"19569ae40a165f27e429157bf672f603ed110d71cbf319d7014f033253be4b08"} Jun 10 01:41:38.462413 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:38.462354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:39.063643 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:39.063604 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:39.661244 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:39.661207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:40.251990 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.251943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerStarted","Data":"1ecd2cb2d46458f3a90a245565016890f8ea11d439ef6c6a5a40943c67e22c2d"} Jun 10 01:41:40.252423 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.252058 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:40.260709 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.260628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:40.269615 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.269566 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podStartSLOduration=0.841709537 podStartE2EDuration="3.269549823s" totalImagesPullingTime="2.427840286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:41:40.269239495 +0000 UTC m=+2389.811069998" watchObservedRunningTime="2026-06-10 01:41:40.269549823 +0000 UTC m=+2389.811380323" Jun 10 01:41:40.543310 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.543266 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:40.861483 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:40.861424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:41.259769 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:41.259674 2573 generic.go:356] "Generic (PLEG): container finished" podID="69467d5f-9a72-4019-886a-009d87013103" containerID="1ecd2cb2d46458f3a90a245565016890f8ea11d439ef6c6a5a40943c67e22c2d" exitCode=1 Jun 10 01:41:41.259769 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:41.259761 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerDied","Data":"1ecd2cb2d46458f3a90a245565016890f8ea11d439ef6c6a5a40943c67e22c2d"} Jun 10 01:41:41.260172 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:41.259975 2573 scope.go:117] "RemoveContainer" containerID="1ecd2cb2d46458f3a90a245565016890f8ea11d439ef6c6a5a40943c67e22c2d" Jun 10 01:41:41.463810 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:41.463779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:42.268058 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:42.267972 2573 generic.go:356] "Generic (PLEG): container finished" podID="69467d5f-9a72-4019-886a-009d87013103" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" exitCode=1 Jun 10 01:41:42.268446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:42.268052 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerDied","Data":"65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848"} Jun 10 01:41:42.268446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:42.268109 2573 scope.go:117] "RemoveContainer" containerID="1ecd2cb2d46458f3a90a245565016890f8ea11d439ef6c6a5a40943c67e22c2d" Jun 10 01:41:42.268446 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:42.268383 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:41:42.268667 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:41:42.268640 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:41:43.106428 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:43.106391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:43.276217 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:43.276189 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:41:43.276663 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:41:43.276392 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:41:43.294313 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:43.294276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:43.395830 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:43.395744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:44.902523 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:44.902483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:45.253058 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:45.252965 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:45.253401 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:45.253383 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:41:45.253677 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:41:45.253653 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:41:47.448242 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:47.448191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:47.448788 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:47.448632 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:41:47.448857 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:41:47.448810 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:41:49.014728 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.014697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.120500 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.120453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.215999 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.215962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.314830 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.314744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.415689 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.415650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.515229 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.515183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.652390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.652347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:49.810100 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:49.810063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:50.093547 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:50.093432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:50.195764 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:50.195712 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:50.453758 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:50.453725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:50.643776 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:50.643737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:51.137145 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:51.137113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:41:51.153016 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:51.152991 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnplz_a061b0fb-cf9e-4d98-a549-03b08ef65f42/ovn-acl-logging/0.log" Jun 10 01:41:51.238420 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:51.238388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:51.839423 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:51.839390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:52.439319 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:52.439278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:52.614656 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:52.614626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:53.036524 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:53.036492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:53.639259 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:53.639222 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:55.471634 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:55.471583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:56.613892 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:56.613841 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:56.704678 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:56.704640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:41:58.853454 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:58.853423 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:41:59.372547 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:59.372437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerStarted","Data":"40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94"} Jun 10 01:41:59.372723 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:59.372679 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:41:59.815048 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:41:59.815015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:42:00.380263 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:00.380227 2573 generic.go:356] "Generic (PLEG): container finished" podID="69467d5f-9a72-4019-886a-009d87013103" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" exitCode=1 Jun 10 01:42:00.380740 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:00.380316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerDied","Data":"40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94"} Jun 10 01:42:00.380740 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:00.380407 2573 scope.go:117] "RemoveContainer" containerID="65bccf1231ea41f83c404d96f81b4faa6b0a41af4e88d9dbf6d414908ecb8848" Jun 10 01:42:00.380740 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:00.380719 2573 scope.go:117] "RemoveContainer" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" Jun 10 01:42:00.380997 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:00.380978 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:01.387760 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:01.387731 2573 scope.go:117] "RemoveContainer" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" Jun 10 01:42:01.388150 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:01.387951 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:02.364322 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:02.364290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:42:02.415364 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:02.415328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:42:07.448491 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:07.448426 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:42:07.448988 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:07.448875 2573 scope.go:117] "RemoveContainer" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" Jun 10 01:42:07.449106 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:07.449061 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:09.784586 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:09.784549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbff98b48-5jwv8_d0773570-cd31-4a62-abe8-2402ed05ea95/authorino/0.log" Jun 10 01:42:15.063570 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:15.063534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-h5kxx_caee5ef7-78ae-4d40-a814-26328768ac9d/copy-manifests/0.log" Jun 10 01:42:15.075477 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:15.075442 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-h5kxx_caee5ef7-78ae-4d40-a814-26328768ac9d/manager/0.log" Jun 10 01:42:15.942182 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:15.942152 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/util/0.log" Jun 10 01:42:15.947916 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:15.947891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/pull/0.log" Jun 10 01:42:15.953649 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:15.953610 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/extract/0.log" Jun 10 01:42:16.061358 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.061325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/util/0.log" Jun 10 01:42:16.066736 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.066713 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/pull/0.log" Jun 10 01:42:16.073262 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.073236 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/extract/0.log" Jun 10 01:42:16.180495 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.180453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/pull/0.log" Jun 10 01:42:16.186165 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.186140 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/extract/0.log" Jun 10 01:42:16.191715 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.191690 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/util/0.log" Jun 10 01:42:16.298852 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.298767 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/util/0.log" Jun 10 01:42:16.304657 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.304624 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/pull/0.log" Jun 10 01:42:16.310365 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.310346 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/extract/0.log" Jun 10 01:42:16.422770 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.422737 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbff98b48-5jwv8_d0773570-cd31-4a62-abe8-2402ed05ea95/authorino/0.log" Jun 10 01:42:16.751378 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:16.751347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8lccn_abb04762-a51d-4141-ba64-1b1f44b9c2f6/kuadrant-console-plugin/0.log" Jun 10 01:42:17.786192 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:17.786158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-5jgbz_7a1f299d-463b-46ec-9cc1-e6bbf006f561/kube-auth-proxy/0.log" Jun 10 01:42:19.853062 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:19.853032 2573 scope.go:117] "RemoveContainer" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" Jun 10 01:42:20.501356 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:20.501259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerStarted","Data":"761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61"} Jun 10 01:42:20.501530 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:20.501503 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:42:21.508821 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:21.508784 2573 generic.go:356] "Generic (PLEG): container finished" podID="69467d5f-9a72-4019-886a-009d87013103" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" exitCode=1 Jun 10 01:42:21.509289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:21.508867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" event={"ID":"69467d5f-9a72-4019-886a-009d87013103","Type":"ContainerDied","Data":"761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61"} Jun 10 01:42:21.509289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:21.508931 2573 scope.go:117] "RemoveContainer" containerID="40b489d57dda86ac71795d6c8c888e58e23aa6b80cded5551f39c5ffdc1f4f94" Jun 10 01:42:21.509289 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:21.509158 2573 scope.go:117] "RemoveContainer" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" Jun 10 01:42:21.509433 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:21.509409 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:22.516166 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:22.516137 2573 scope.go:117] "RemoveContainer" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" Jun 10 01:42:22.516611 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:22.516382 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:23.413785 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.413736 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kdsff/must-gather-9twhl"] Jun 10 01:42:23.418794 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.418768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.421132 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.421108 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"kube-root-ca.crt\"" Jun 10 01:42:23.421257 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.421219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kdsff\"/\"default-dockercfg-zj2n9\"" Jun 10 01:42:23.421959 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.421939 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"openshift-service-ca.crt\"" Jun 10 01:42:23.426009 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.425978 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/must-gather-9twhl"] Jun 10 01:42:23.427034 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.427001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:42:23.529634 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.529590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" limit=1024 Jun 10 01:42:23.594807 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.594770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1761a91d-dfc5-448b-9918-683ff6266d99-must-gather-output\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.595018 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.594821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvbtg\" (UniqueName: \"kubernetes.io/projected/1761a91d-dfc5-448b-9918-683ff6266d99-kube-api-access-dvbtg\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.696460 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.696347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1761a91d-dfc5-448b-9918-683ff6266d99-must-gather-output\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.696460 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.696416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvbtg\" (UniqueName: \"kubernetes.io/projected/1761a91d-dfc5-448b-9918-683ff6266d99-kube-api-access-dvbtg\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.696777 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.696752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1761a91d-dfc5-448b-9918-683ff6266d99-must-gather-output\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.703741 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.703714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvbtg\" (UniqueName: \"kubernetes.io/projected/1761a91d-dfc5-448b-9918-683ff6266d99-kube-api-access-dvbtg\") pod \"must-gather-9twhl\" (UID: \"1761a91d-dfc5-448b-9918-683ff6266d99\") " pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.730556 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.730515 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/must-gather-9twhl" Jun 10 01:42:23.871674 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:23.871637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/must-gather-9twhl"] Jun 10 01:42:23.872976 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:42:23.872951 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1761a91d_dfc5_448b_9918_683ff6266d99.slice/crio-dc9e799426ff136d7722ea33ebc3be308f2c820e31190e3aab3a4cdf87bdf826 WatchSource:0}: Error finding container dc9e799426ff136d7722ea33ebc3be308f2c820e31190e3aab3a4cdf87bdf826: Status 404 returned error can't find the container with id dc9e799426ff136d7722ea33ebc3be308f2c820e31190e3aab3a4cdf87bdf826 Jun 10 01:42:24.530400 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:24.530361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/must-gather-9twhl" event={"ID":"1761a91d-dfc5-448b-9918-683ff6266d99","Type":"ContainerStarted","Data":"dc9e799426ff136d7722ea33ebc3be308f2c820e31190e3aab3a4cdf87bdf826"} Jun 10 01:42:25.540687 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:25.540645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/must-gather-9twhl" event={"ID":"1761a91d-dfc5-448b-9918-683ff6266d99","Type":"ContainerStarted","Data":"3eea8f64f1a9f06454625309312218347872b7c408a4ad0348654df4bb808ff2"} Jun 10 01:42:25.541229 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:25.540705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/must-gather-9twhl" event={"ID":"1761a91d-dfc5-448b-9918-683ff6266d99","Type":"ContainerStarted","Data":"1ed3be9ed78c9ba768d04ca9f44126ddd98895d3b6745c08e3c2836beb88c059"} Jun 10 01:42:25.558029 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:25.557966 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kdsff/must-gather-9twhl" podStartSLOduration=1.628813592 podStartE2EDuration="2.557938582s" totalImagesPullingTime="929.12499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:42:25.556005968 +0000 UTC m=+2435.097836492" watchObservedRunningTime="2026-06-10 01:42:25.557938582 +0000 UTC m=+2435.099769083" Jun 10 01:42:26.701331 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:26.701290 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jg52f_6f8a8a53-0662-4190-a27f-c47458abb82b/global-pull-secret-syncer/0.log" Jun 10 01:42:26.753309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:26.753282 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4h48k_07a16d89-3dde-4590-94ce-81a43debd4fb/konnectivity-agent/0.log" Jun 10 01:42:26.847659 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:26.847622 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-148.ec2.internal_b726b16e3f101e7505136e45fb711c88/haproxy/0.log" Jun 10 01:42:27.448575 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:27.448542 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" Jun 10 01:42:27.448962 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:27.448947 2573 scope.go:117] "RemoveContainer" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" Jun 10 01:42:27.449150 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:27.449128 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:31.587751 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.587719 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/extract/0.log" Jun 10 01:42:31.611265 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.611235 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/util/0.log" Jun 10 01:42:31.645191 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.645155 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ktkzc_0844ff80-b9c4-4ef0-ae24-7ee85f41828b/pull/0.log" Jun 10 01:42:31.675870 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.675822 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/extract/0.log" Jun 10 01:42:31.698748 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.698718 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/util/0.log" Jun 10 01:42:31.724668 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.724585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0994tx_2706e7b8-28a0-4346-aab6-cd731ef0836a/pull/0.log" Jun 10 01:42:31.755439 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.755409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/extract/0.log" Jun 10 01:42:31.780567 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.780521 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/util/0.log" Jun 10 01:42:31.804825 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.804797 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k8wpg_5f1a5c76-1584-4983-b085-af58bf2fb332/pull/0.log" Jun 10 01:42:31.839858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.839780 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/extract/0.log" Jun 10 01:42:31.866363 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.866322 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/util/0.log" Jun 10 01:42:31.888887 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:31.888850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w8jc6_ebc28c4e-1250-4b19-8514-29532d9043a3/pull/0.log" Jun 10 01:42:32.141858 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:32.141820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbff98b48-5jwv8_d0773570-cd31-4a62-abe8-2402ed05ea95/authorino/0.log" Jun 10 01:42:32.235269 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:32.235228 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8lccn_abb04762-a51d-4141-ba64-1b1f44b9c2f6/kuadrant-console-plugin/0.log" Jun 10 01:42:34.007564 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.007526 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/alertmanager/0.log" Jun 10 01:42:34.028935 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.028902 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/config-reloader/0.log" Jun 10 01:42:34.055017 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.054988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/kube-rbac-proxy-web/0.log" Jun 10 01:42:34.078149 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.078117 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/kube-rbac-proxy/0.log" Jun 10 01:42:34.101599 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.101566 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/kube-rbac-proxy-metric/0.log" Jun 10 01:42:34.126509 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.126458 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/prom-label-proxy/0.log" Jun 10 01:42:34.150865 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.150837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_825c7e95-c751-4826-bb79-ac19ead8bc63/init-config-reloader/0.log" Jun 10 01:42:34.195724 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.195690 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-kcc4q_7926da5e-90de-4049-bda0-cf59a19507b5/cluster-monitoring-operator/0.log" Jun 10 01:42:34.223323 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.223285 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-state-metrics/0.log" Jun 10 01:42:34.244675 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.244642 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-rbac-proxy-main/0.log" Jun 10 01:42:34.271102 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.271016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v6v6x_d813335b-31e7-47c2-878e-0a751ab20b43/kube-rbac-proxy-self/0.log" Jun 10 01:42:34.298729 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.298694 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-695779d7fb-j4thh_f82dbdf7-b1ab-4afd-93d3-b3294dad39e6/metrics-server/0.log" Jun 10 01:42:34.430432 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.430382 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/node-exporter/0.log" Jun 10 01:42:34.456179 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.456139 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/kube-rbac-proxy/0.log" Jun 10 01:42:34.477843 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.477812 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8h8r_91164216-6589-4996-91d3-792cd7f2e3fc/init-textfile/0.log" Jun 10 01:42:34.606415 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.606381 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/kube-rbac-proxy-main/0.log" Jun 10 01:42:34.632591 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.632542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/kube-rbac-proxy-self/0.log" Jun 10 01:42:34.654255 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.654207 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zk9dx_56ef8eea-7591-47a3-be49-bea9c153277d/openshift-state-metrics/0.log" Jun 10 01:42:34.868884 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.868572 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-tfrhq_0481f85a-8423-41dc-96a7-518f8ef63424/prometheus-operator/0.log" Jun 10 01:42:34.889490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.888879 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-tfrhq_0481f85a-8423-41dc-96a7-518f8ef63424/kube-rbac-proxy/0.log" Jun 10 01:42:34.926159 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.926129 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-d8xct_2ca0a86b-d608-41c4-9cb1-0026595435af/prometheus-operator-admission-webhook/0.log" Jun 10 01:42:34.973490 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:34.970811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7ddd5798c8-7skgq_2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea/telemeter-client/0.log" Jun 10 01:42:35.003063 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.002218 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7ddd5798c8-7skgq_2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea/reload/0.log" Jun 10 01:42:35.036253 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.033966 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7ddd5798c8-7skgq_2d279fec-2fa7-4eb6-9aa6-f402d0d3c0ea/kube-rbac-proxy/0.log" Jun 10 01:42:35.082246 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.082202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/thanos-query/0.log" Jun 10 01:42:35.105013 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.104985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-web/0.log" Jun 10 01:42:35.125919 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.125834 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy/0.log" Jun 10 01:42:35.149942 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.149915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/prom-label-proxy/0.log" Jun 10 01:42:35.175091 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.175062 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-rules/0.log" Jun 10 01:42:35.196309 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:35.196266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f75f6c47-clbvt_73beae1c-8780-4e85-9876-0fd8fb34755f/kube-rbac-proxy-metrics/0.log" Jun 10 01:42:36.694492 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:36.694432 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-hg6ck_4d02afb5-e3fe-4b4e-b964-bde6a01198d3/networking-console-plugin/0.log" Jun 10 01:42:37.963508 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:37.963460 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5479cc7db-fssq4_3ee74141-2322-4ee0-afdc-23e36e5a07a9/console/0.log" Jun 10 01:42:38.703488 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:38.701686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-mwvxp_52e17c52-b1d8-4a71-a6ff-fd9940fcc3d0/volume-data-source-validator/0.log" Jun 10 01:42:38.993096 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:38.993004 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6"] Jun 10 01:42:39.002097 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.002062 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.004146 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.004039 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6"] Jun 10 01:42:39.082070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.080736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-proc\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.082070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.080807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-podres\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.082070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.080976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fllk\" (UniqueName: \"kubernetes.io/projected/501e92b4-f6db-41d2-8739-110d8837a86a-kube-api-access-7fllk\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.082070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.081067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-sys\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.082070 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.081162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-lib-modules\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183101 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-lib-modules\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183403 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-lib-modules\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-proc\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-podres\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183571 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-proc\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fllk\" (UniqueName: \"kubernetes.io/projected/501e92b4-f6db-41d2-8739-110d8837a86a-kube-api-access-7fllk\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-podres\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183727 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-sys\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.183866 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.183740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501e92b4-f6db-41d2-8739-110d8837a86a-sys\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.191425 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.191395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fllk\" (UniqueName: \"kubernetes.io/projected/501e92b4-f6db-41d2-8739-110d8837a86a-kube-api-access-7fllk\") pod \"perf-node-gather-daemonset-bvww6\" (UID: \"501e92b4-f6db-41d2-8739-110d8837a86a\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.319358 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.319275 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.511527 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.510859 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6"] Jun 10 01:42:39.521237 ip-10-0-132-148 kubenswrapper[2573]: W0610 01:42:39.521200 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod501e92b4_f6db_41d2_8739_110d8837a86a.slice/crio-299f8764e2f3de209e8999450198ffa3c3885dc9181f717363aacb051201b44b WatchSource:0}: Error finding container 299f8764e2f3de209e8999450198ffa3c3885dc9181f717363aacb051201b44b: Status 404 returned error can't find the container with id 299f8764e2f3de209e8999450198ffa3c3885dc9181f717363aacb051201b44b Jun 10 01:42:39.712061 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.712020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" event={"ID":"501e92b4-f6db-41d2-8739-110d8837a86a","Type":"ContainerStarted","Data":"97fb732ec946546aea7723af13a9666c966e929a147ef2951f64d59ad8a6be36"} Jun 10 01:42:39.712248 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.712082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" event={"ID":"501e92b4-f6db-41d2-8739-110d8837a86a","Type":"ContainerStarted","Data":"299f8764e2f3de209e8999450198ffa3c3885dc9181f717363aacb051201b44b"} Jun 10 01:42:39.712248 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.712103 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:39.726728 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:39.726672 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" podStartSLOduration=1.726651514 podStartE2EDuration="1.726651514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:42:39.72540613 +0000 UTC m=+2449.267236656" watchObservedRunningTime="2026-06-10 01:42:39.726651514 +0000 UTC m=+2449.268482019" Jun 10 01:42:40.000928 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:40.000898 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2mbz_77209cfa-414b-45ed-bbd8-0834b02c503f/dns/0.log" Jun 10 01:42:40.022390 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:40.022365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2mbz_77209cfa-414b-45ed-bbd8-0834b02c503f/kube-rbac-proxy/0.log" Jun 10 01:42:40.146680 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:40.146650 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wh67m_95cec5d3-399b-480f-be47-6b4e9260e5d0/dns-node-resolver/0.log" Jun 10 01:42:40.754480 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:40.754435 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4qrl_1bd7b302-ffc2-4798-8454-5f8287ef2bb1/node-ca/0.log" Jun 10 01:42:41.852966 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:41.852940 2573 scope.go:117] "RemoveContainer" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" Jun 10 01:42:41.853348 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:41.853144 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:41.885738 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:41.885704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-5jgbz_7a1f299d-463b-46ec-9cc1-e6bbf006f561/kube-auth-proxy/0.log" Jun 10 01:42:42.759899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:42.759856 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jzcvj_e5ccc734-1aa2-4448-9ff8-f96c45c6e6f7/serve-healthcheck-canary/0.log" Jun 10 01:42:43.287448 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:43.287411 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5b8jw_1e683a7c-85d9-4c67-b66f-1e5355f88a4b/insights-operator/0.log" Jun 10 01:42:43.289742 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:43.289718 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5b8jw_1e683a7c-85d9-4c67-b66f-1e5355f88a4b/insights-operator/1.log" Jun 10 01:42:43.312042 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:43.311988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l246x_38651e13-d5b2-4090-b995-0af2889f6c44/kube-rbac-proxy/0.log" Jun 10 01:42:43.332899 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:43.332875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l246x_38651e13-d5b2-4090-b995-0af2889f6c44/exporter/0.log" Jun 10 01:42:43.354763 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:43.354736 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l246x_38651e13-d5b2-4090-b995-0af2889f6c44/extractor/0.log" Jun 10 01:42:45.730895 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:45.730865 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-bvww6" Jun 10 01:42:46.215345 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:46.215314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-h5kxx_caee5ef7-78ae-4d40-a814-26328768ac9d/manager/0.log" Jun 10 01:42:46.232612 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:46.232584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-h5kxx_caee5ef7-78ae-4d40-a814-26328768ac9d/copy-manifests/0.log" Jun 10 01:42:47.854942 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:47.854912 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67d5b6d8d5-h7tw4_43887db4-118c-48b7-96bd-db304bc10699/manager/0.log" Jun 10 01:42:52.493128 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:52.493095 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-5jgbz_7a1f299d-463b-46ec-9cc1-e6bbf006f561/kube-auth-proxy/0.log" Jun 10 01:42:53.776053 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:53.776023 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-trtp5_6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2/kube-storage-version-migrator-operator/1.log" Jun 10 01:42:53.776979 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:53.776957 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-trtp5_6f0902d8-d0ff-4387-8dfe-ae1d2db0c7c2/kube-storage-version-migrator-operator/0.log" Jun 10 01:42:53.853589 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:53.853559 2573 scope.go:117] "RemoveContainer" containerID="761d35b7c85cc89821088a2c1db97530576ec3f9d7246633ab6bb6bbf914fc61" Jun 10 01:42:53.854048 ip-10-0-132-148 kubenswrapper[2573]: E0610 01:42:53.854022 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr_redhat-ai-gateway-infra(69467d5f-9a72-4019-886a-009d87013103)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-597e3e56-6fd8b45f99-92fdr" podUID="69467d5f-9a72-4019-886a-009d87013103" Jun 10 01:42:53.893433 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:53.893397 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-5jgbz_7a1f299d-463b-46ec-9cc1-e6bbf006f561/kube-auth-proxy/0.log" Jun 10 01:42:54.982780 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:54.982746 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/kube-multus-additional-cni-plugins/0.log" Jun 10 01:42:55.008102 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.008077 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/egress-router-binary-copy/0.log" Jun 10 01:42:55.030995 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.030963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/cni-plugins/0.log" Jun 10 01:42:55.055370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.055344 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/bond-cni-plugin/0.log" Jun 10 01:42:55.075988 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.075958 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/routeoverride-cni/0.log" Jun 10 01:42:55.097482 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.097438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/whereabouts-cni-bincopy/0.log" Jun 10 01:42:55.117717 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.117683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xq24_e28bb9c1-0e07-412b-bd7b-8d6852edfdee/whereabouts-cni/0.log" Jun 10 01:42:55.504370 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.504334 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wlwd7_ff94ac60-f30f-43d0-b7b0-12612a07d1c1/kube-multus/0.log" Jun 10 01:42:55.526132 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.526093 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d7lj7_d492c48d-0ac1-49c3-9127-caf36e96c576/network-metrics-daemon/0.log" Jun 10 01:42:55.546198 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.546173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d7lj7_d492c48d-0ac1-49c3-9127-caf36e96c576/kube-rbac-proxy/0.log" Jun 10 01:42:55.772076 ip-10-0-132-148 kubenswrapper[2573]: I0610 01:42:55.772002 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-5jgbz_7a1f299d-463b-46ec-9cc1-e6bbf006f561/kube-auth-proxy/0.log"