Jul 23 21:26:02.361389 ip-10-0-132-103 systemd[1]: Starting Kubernetes Kubelet... Jul 23 21:26:02.785349 ip-10-0-132-103 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:02.785349 ip-10-0-132-103 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 21:26:02.785349 ip-10-0-132-103 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:02.785349 ip-10-0-132-103 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 21:26:02.785349 ip-10-0-132-103 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:02.786627 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.786547 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 21:26:02.794024 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794001 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.794024 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794022 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.794024 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794026 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.794024 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794029 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794033 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794037 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794040 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794043 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794046 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794048 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794051 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794054 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794056 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794059 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794062 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794064 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794067 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794082 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794086 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794092 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794097 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794101 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.794211 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794105 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794108 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794111 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794113 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794116 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794119 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794122 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794124 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794127 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794130 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794133 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794135 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794138 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794140 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794143 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794147 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794150 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794152 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794155 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794157 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.794658 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794160 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794162 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794165 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794167 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794169 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794172 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794174 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794177 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794179 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794181 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794184 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794187 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794189 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794191 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794194 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794196 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794198 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794201 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794203 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794205 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.795182 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794208 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794211 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794213 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794216 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794218 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794221 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794227 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794232 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794236 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794241 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794245 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794249 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794253 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794257 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794261 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794264 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794267 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794269 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794272 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794274 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.795655 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794277 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794280 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794284 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794286 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794288 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794291 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794293 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794296 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794298 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794301 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794303 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794305 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794308 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794311 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794313 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794315 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.794317 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795012 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795019 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.796146 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795023 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795026 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795031 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795035 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795038 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795041 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795043 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795046 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795048 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795051 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795053 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795055 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795058 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795060 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795063 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795066 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795068 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795086 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795089 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.796592 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795091 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795094 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795096 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795099 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795101 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795104 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795106 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795108 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795111 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795114 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795116 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795118 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795121 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795125 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795128 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795130 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795133 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795135 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795138 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795140 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.797047 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795143 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795145 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795148 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795150 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795153 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795155 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795157 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795160 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795164 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795168 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795170 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795174 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795184 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795187 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795190 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795193 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795196 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795199 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795201 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795204 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.797524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795207 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795217 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795220 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795223 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795228 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795231 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795234 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795237 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795240 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795242 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795245 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795247 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795249 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795252 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795255 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795257 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795259 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795263 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795267 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.798042 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795269 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795272 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795274 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795277 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795280 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795282 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795285 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795287 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795290 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795292 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795295 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795297 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795299 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795302 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795304 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795307 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795309 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795312 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795315 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795685 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.798625 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795690 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795692 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795695 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795698 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795701 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795703 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795706 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795708 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795713 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795716 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795719 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795722 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795725 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795728 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795730 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795734 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795736 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795739 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795742 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.799117 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795744 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795747 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795749 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795752 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795754 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795757 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795759 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795762 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795764 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795766 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795769 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795773 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795775 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795778 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795780 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795783 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795785 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795788 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795790 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795793 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.799575 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795795 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795798 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795801 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795803 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795806 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795808 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795810 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795813 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795815 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795822 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795824 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795827 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795829 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795832 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795834 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795836 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795839 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795841 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795844 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.800050 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795846 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795848 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795851 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795853 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795856 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795859 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795862 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795864 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795867 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795871 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795874 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795876 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795879 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795882 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795884 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795887 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795890 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795892 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795896 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795899 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.800513 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795901 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795904 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795906 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795909 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795911 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795914 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795917 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795919 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795922 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795924 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795926 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795929 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795933 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795936 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795938 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795943 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795947 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795950 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795952 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.795954 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.800992 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796027 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796034 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796040 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796044 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796048 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796051 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796055 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796059 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796063 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796065 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796068 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796088 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796092 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796096 2569 flags.go:64] FLAG: --cgroup-root="" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796099 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796102 2569 flags.go:64] FLAG: --client-ca-file="" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796111 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796114 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796121 2569 flags.go:64] FLAG: --cluster-domain="" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796124 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796127 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796130 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796133 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796137 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 21:26:02.801484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796143 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796146 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796149 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796154 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796157 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796160 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796163 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796166 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796169 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796172 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796175 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796178 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796180 2569 flags.go:64] FLAG: --enable-server="true" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796183 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796189 2569 flags.go:64] FLAG: --event-burst="100" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796193 2569 flags.go:64] FLAG: --event-qps="50" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796195 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796198 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796201 2569 flags.go:64] FLAG: --eviction-hard="" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796205 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796208 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796211 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796213 2569 flags.go:64] FLAG: --eviction-soft="" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796216 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796219 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 21:26:02.802039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796227 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796230 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796233 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796235 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796238 2569 flags.go:64] FLAG: --feature-gates="" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796242 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796245 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796250 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796252 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796256 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796260 2569 flags.go:64] FLAG: --help="false" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796263 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-132-103.ec2.internal" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796266 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796269 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796272 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796275 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796278 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796281 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796283 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796286 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796289 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796292 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796295 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796297 2569 flags.go:64] FLAG: --kube-reserved="" Jul 23 21:26:02.802711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796300 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796303 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796305 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796308 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796311 2569 flags.go:64] FLAG: --lock-file="" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796313 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796316 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796319 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796324 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796332 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796335 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796337 2569 flags.go:64] FLAG: --logging-format="text" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796340 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796343 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796346 2569 flags.go:64] FLAG: --manifest-url="" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796349 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796354 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796356 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796361 2569 flags.go:64] FLAG: --max-pods="110" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796364 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796367 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796370 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796373 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796375 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796378 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 21:26:02.803321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796381 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796388 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796391 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796394 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796397 2569 flags.go:64] FLAG: --pod-cidr="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796400 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796406 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796408 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796411 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796414 2569 flags.go:64] FLAG: --port="10250" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796417 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796420 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f4ed69264321982c" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796423 2569 flags.go:64] FLAG: --qos-reserved="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796425 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796428 2569 flags.go:64] FLAG: --register-node="true" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796431 2569 flags.go:64] FLAG: --register-with-taints="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796435 2569 flags.go:64] FLAG: --registry-burst="10" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796438 2569 flags.go:64] FLAG: --registry-qps="5" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796441 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796443 2569 flags.go:64] FLAG: --reserved-memory="" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796447 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796450 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796452 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796456 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796459 2569 flags.go:64] FLAG: --runonce="false" Jul 23 21:26:02.803921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796463 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796466 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796469 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796472 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796474 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796477 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796480 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796483 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796486 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796488 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796491 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796494 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796496 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796499 2569 flags.go:64] FLAG: --system-cgroups="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796502 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796507 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796509 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796512 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796518 2569 flags.go:64] FLAG: --tls-min-version="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796520 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796523 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796526 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796528 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796531 2569 flags.go:64] FLAG: --v="2" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796535 2569 flags.go:64] FLAG: --version="false" Jul 23 21:26:02.804537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796540 2569 flags.go:64] FLAG: --vmodule="" Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796543 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.796546 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796652 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796656 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796660 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796663 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796667 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796669 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796673 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796677 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796680 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796682 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796685 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796687 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796690 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796692 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796695 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796697 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.805154 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796700 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796702 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796706 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796709 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796713 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796716 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796718 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796720 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796723 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796726 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796728 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796731 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796733 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796736 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796739 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796741 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796744 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796746 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796750 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796752 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.805606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796756 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796758 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796761 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796763 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796766 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796768 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796771 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796773 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796775 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796778 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796782 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796785 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796788 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796791 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796793 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796796 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796799 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796801 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796804 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.806111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796806 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796809 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796811 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796814 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796816 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796818 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796821 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796823 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796826 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796829 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796831 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796835 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796837 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796841 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796843 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796846 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796849 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796851 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796854 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796856 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.806565 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796858 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796861 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796864 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796866 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796869 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796871 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796874 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796876 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796878 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796881 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796883 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796886 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796888 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796890 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796893 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796895 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796897 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796899 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796902 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796904 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.807097 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796907 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796910 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796912 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.796916 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.797589 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.804269 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.804283 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.805167 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.805175 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805230 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805234 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805238 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805241 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805244 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.807580 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805247 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805251 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805254 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805258 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805261 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805264 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805266 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805269 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805272 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805275 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805277 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805280 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805283 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805285 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805288 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805290 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805293 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805295 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805298 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.807929 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805301 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805303 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805306 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805309 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805311 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805315 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805318 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805320 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805322 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805325 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805327 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805330 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805332 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805336 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805340 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805343 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805346 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805348 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805351 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805354 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.808414 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805357 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805359 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805362 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805365 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805367 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805370 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805373 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805375 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805378 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805380 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805382 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805385 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805387 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805390 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805392 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805394 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805397 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805399 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805402 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.808909 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805405 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805407 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805410 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805412 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805416 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805419 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805421 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805424 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805426 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805428 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805431 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805433 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805435 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805438 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805440 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805443 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805445 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805448 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805450 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805452 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.809392 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805455 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805457 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805459 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805462 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805464 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805466 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805469 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805471 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805474 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805476 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805478 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805481 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805484 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805486 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805489 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.809860 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805491 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.805496 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805606 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805611 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805614 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805616 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805619 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805622 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805625 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805627 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805630 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805632 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805635 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805638 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805641 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:02.810376 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805644 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805647 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805649 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805652 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805655 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805657 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805659 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805662 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805664 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805667 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805669 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805671 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805674 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805676 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805679 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805681 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805684 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805686 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805688 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805691 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:02.810735 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805694 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805698 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805701 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805703 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805706 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805708 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805711 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805713 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805715 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805718 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805721 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805723 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805725 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805728 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805730 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805732 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805735 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805737 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805739 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:02.811230 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805742 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805744 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805747 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805749 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805751 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805754 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805756 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805759 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805761 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805764 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805766 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805769 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805771 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805774 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805776 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805778 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805781 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805783 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805785 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805788 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:02.811677 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805790 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805792 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805795 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805798 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805800 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805802 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805805 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805807 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805809 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805812 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805814 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805816 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805819 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805821 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805823 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805826 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805828 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805830 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805834 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:02.812161 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805837 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805841 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805843 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805846 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805850 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805853 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805856 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:02.805858 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.805863 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.805960 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.808155 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.811040 2569 server.go:1019] "Starting client certificate rotation" Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.811144 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:26:02.812596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.811183 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:26:02.813368 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.813353 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:26:02.817362 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.817341 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:26:02.832448 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.832426 2569 log.go:25] "Validated CRI v1 runtime API" Jul 23 21:26:02.835336 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.835320 2569 log.go:25] "Validated CRI v1 image API" Jul 23 21:26:02.836125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.836104 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 21:26:02.838646 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.838618 2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91bc1cf3-b791-4c44-8cac-e51e917f0184:/dev/nvme0n1p3 ab926d70-a8a6-473a-8c6d-5c2d9395ebb5:/dev/nvme0n1p4] Jul 23 21:26:02.838731 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.838645 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 21:26:02.843807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.843789 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:26:02.844094 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.843969 2569 manager.go:216] Machine: {Timestamp:2026-07-23 21:26:02.842564246 +0000 UTC m=+0.359459295 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3078923 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec217581bc97559f11412deff60bcdbb SystemUUID:ec217581-bc97-559f-1141-2deff60bcdbb BootID:63827903-7151-4052-9daf-3baa59217ba8 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:fc:49:88:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:fc:49:88:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:d1:ac:6e:f6:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 21:26:02.844094 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.844092 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 21:26:02.844185 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.844174 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 21:26:02.848342 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.848320 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 21:26:02.848476 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.848346 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 21:26:02.849107 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.849098 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 21:26:02.849138 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.849110 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 21:26:02.849138 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.849117 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:26:02.849138 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.849130 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:26:02.850347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.850337 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 21:26:02.853264 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853253 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:26:02.853375 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853366 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 21:26:02.853413 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853401 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 23 21:26:02.853444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853418 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 21:26:02.853444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853440 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 21:26:02.853497 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853449 2569 kubelet.go:398] "Adding apiserver pod source" Jul 23 21:26:02.853497 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853463 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 21:26:02.853835 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853823 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:26:02.853938 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.853841 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:26:02.856064 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.856047 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 21:26:02.857999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.857985 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 21:26:02.858047 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.858016 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 21:26:02.859147 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859130 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 21:26:02.859147 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859148 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859153 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859159 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859169 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859174 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859182 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859187 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859194 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859199 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859217 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 21:26:02.859273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.859224 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 21:26:02.860997 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.860984 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 21:26:02.860997 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.860996 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 21:26:02.863741 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.863691 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 21:26:02.863741 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.863728 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 21:26:02.864753 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.864733 2569 server.go:1268] "Started kubelet" Jul 23 21:26:02.865238 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.865204 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 21:26:02.865321 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.865309 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 21:26:02.865434 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.865403 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 21:26:02.865717 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.865698 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csvvj" Jul 23 21:26:02.865740 ip-10-0-132-103 systemd[1]: Started Kubernetes Kubelet. Jul 23 21:26:02.866291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.866269 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 21:26:02.866844 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.866822 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 21:26:02.868096 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.868064 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 23 21:26:02.872121 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.872099 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 21:26:02.876372 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.876353 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csvvj" Jul 23 21:26:02.877206 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.877189 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 21:26:02.877206 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.877198 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 21:26:02.877374 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.877360 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:02.877946 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.877926 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.877963 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878048 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.877058 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-103.ec2.internal.18c5084f08c2ff8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-103.ec2.internal,UID:ip-10-0-132-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-103.ec2.internal,},FirstTimestamp:2026-07-23 21:26:02.864705421 +0000 UTC m=+0.381600471,LastTimestamp:2026-07-23 21:26:02.864705421 +0000 UTC m=+0.381600471,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-103.ec2.internal,}" Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878127 2569 factory.go:55] Registering systemd factory Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878141 2569 factory.go:223] Registration of the systemd container factory successfully Jul 23 21:26:02.878211 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878163 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 23 21:26:02.878484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878430 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 23 21:26:02.878484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878456 2569 factory.go:153] Registering CRI-O factory Jul 23 21:26:02.878484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878472 2569 factory.go:223] Registration of the crio container factory successfully Jul 23 21:26:02.878619 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878558 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 21:26:02.878619 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878583 2569 factory.go:103] Registering Raw factory Jul 23 21:26:02.878715 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.878627 2569 manager.go:1196] Started watching for new ooms in manager Jul 23 21:26:02.879291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.879269 2569 manager.go:349] Starting recovery of all containers Jul 23 21:26:02.885702 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.885682 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:02.888763 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.888738 2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-103.ec2.internal\" not found" node="ip-10-0-132-103.ec2.internal" Jul 23 21:26:02.888898 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.888886 2569 manager.go:354] Recovery completed Jul 23 21:26:02.893016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.893004 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:02.894702 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.894684 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:02.894783 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.894715 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:02.894783 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.894728 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:02.895259 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895244 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 21:26:02.895259 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895258 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 21:26:02.895387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895263 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:02.895387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895273 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:26:02.895943 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895924 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:02.896014 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895956 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:02.896014 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.895970 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:02.896435 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.896424 2569 policy_none.go:49] "None policy: Start" Jul 23 21:26:02.896471 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.896441 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 21:26:02.896471 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.896451 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 21:26:02.897770 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.897748 2569 policy_none.go:47] "Start" Jul 23 21:26:02.943731 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.943594 2569 manager.go:337] "Starting Device Plugin manager" Jul 23 21:26:02.943837 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.943755 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 21:26:02.943837 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.943768 2569 server.go:87] "Starting device plugin registration server" Jul 23 21:26:02.944014 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.944002 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 21:26:02.944059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.944015 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 21:26:02.944147 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.944130 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 21:26:02.944247 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.944228 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 21:26:02.944247 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:02.944242 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 21:26:02.944729 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.944711 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 21:26:02.944805 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:02.944767 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.044596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.044534 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:03.045641 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.045503 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:03.045641 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.045539 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:03.045641 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.045552 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:03.045641 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.045578 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.052232 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.052216 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.052303 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.052237 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-103.ec2.internal\": node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.063550 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.063529 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.068041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.068015 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 21:26:03.069274 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.069259 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 21:26:03.069334 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.069294 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 21:26:03.069334 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.069314 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 21:26:03.069409 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.069346 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 21:26:03.071620 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.071602 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:03.163898 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.163865 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.170016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.169996 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal"] Jul 23 21:26:03.170067 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.170062 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:03.172385 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.172366 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:03.172460 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.172398 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:03.172460 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.172408 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:03.173659 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.173647 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:03.173790 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.173774 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.173826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.173807 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:03.174426 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174403 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:03.174542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174439 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:03.174542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174450 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:03.174542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174408 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:03.174542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174512 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:03.174542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.174522 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:03.175807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.175792 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.175891 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.175815 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:03.176423 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.176409 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:03.176508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.176434 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:03.176508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.176449 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:03.179877 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.179857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.179961 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.179892 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.179961 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.179919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58b77fc7576202595728da24c1fb8b2a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-103.ec2.internal\" (UID: \"58b77fc7576202595728da24c1fb8b2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.201592 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.201570 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-103.ec2.internal\" not found" node="ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.205949 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.205936 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-103.ec2.internal\" not found" node="ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.264339 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.264314 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.280624 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280602 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.280700 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280633 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.280700 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58b77fc7576202595728da24c1fb8b2a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-103.ec2.internal\" (UID: \"58b77fc7576202595728da24c1fb8b2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.280798 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280707 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58b77fc7576202595728da24c1fb8b2a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-103.ec2.internal\" (UID: \"58b77fc7576202595728da24c1fb8b2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.280798 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280717 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.280798 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.280740 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5147dd0fddb2e4959f509033dbce18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal\" (UID: \"8c5147dd0fddb2e4959f509033dbce18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.365124 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.365043 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.465538 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.465501 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.505024 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.505000 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.509704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.509667 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:03.567268 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.567230 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.673218 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.673133 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.773292 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.773255 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.810422 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.810384 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 21:26:03.810897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.810549 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:26:03.810897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.810615 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:26:03.834201 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.834172 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:03.873738 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.873709 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:03.881326 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.881293 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 21:21:03 +0000 UTC" deadline="2028-04-27 01:37:43.030262002 +0000 UTC" Jul 23 21:26:03.881326 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:03.881322 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15436h11m39.148944632s" Jul 23 21:26:03.974134 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:03.974057 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-103.ec2.internal\" not found" Jul 23 21:26:04.064447 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.064417 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:04.078215 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.078196 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" Jul 23 21:26:04.095111 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:04.095077 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b77fc7576202595728da24c1fb8b2a.slice/crio-288029b1e3ee97ea6b2a024ab74692e7fcfaa99155c9892d304bb755fe96522e WatchSource:0}: Error finding container 288029b1e3ee97ea6b2a024ab74692e7fcfaa99155c9892d304bb755fe96522e: Status 404 returned error can't find the container with id 288029b1e3ee97ea6b2a024ab74692e7fcfaa99155c9892d304bb755fe96522e Jul 23 21:26:04.095606 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:04.095581 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5147dd0fddb2e4959f509033dbce18.slice/crio-12a6a9aa2ca71a8e586ac8ccb3af1098fad8be0efd100c8f45c8ed2546bd8b39 WatchSource:0}: Error finding container 12a6a9aa2ca71a8e586ac8ccb3af1098fad8be0efd100c8f45c8ed2546bd8b39: Status 404 returned error can't find the container with id 12a6a9aa2ca71a8e586ac8ccb3af1098fad8be0efd100c8f45c8ed2546bd8b39 Jul 23 21:26:04.100236 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.100221 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:26:04.101365 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.101347 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:26:04.102464 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.102446 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" Jul 23 21:26:04.115020 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.115002 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:26:04.702490 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.702463 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:04.854848 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.854813 2569 apiserver.go:52] "Watching apiserver" Jul 23 21:26:04.855378 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.854984 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:04.863071 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.863047 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 21:26:04.864157 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.864126 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-kxdkv","openshift-image-registry/node-ca-6qn96","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-gpmnh","openshift-network-diagnostics/network-check-target-47glr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz","openshift-cluster-node-tuning-operator/tuned-49w72","openshift-multus/multus-29gw7","openshift-multus/network-metrics-daemon-67t9z","openshift-network-operator/iptables-alerter-hnflf","openshift-ovn-kubernetes/ovnkube-node-vczgs","kube-system/global-pull-secret-syncer-hnpw7","kube-system/konnectivity-agent-r6w8p","kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal"] Jul 23 21:26:04.865902 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.865884 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.868191 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.868169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.870357 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.869558 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.870357 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.869598 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s9qjd\"" Jul 23 21:26:04.870357 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.869812 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.870357 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.869816 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.871347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.870952 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z46xs\"" Jul 23 21:26:04.871347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.870980 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 21:26:04.871347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.870983 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 21:26:04.871347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.871134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.872537 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.872515 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.872905 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.872887 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:04.872984 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.872923 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 21:26:04.873049 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:04.873000 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:04.873377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873348 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 21:26:04.873469 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873388 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.874070 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873794 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzpvs\"" Jul 23 21:26:04.874070 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873874 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 21:26:04.874070 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873882 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 21:26:04.874070 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.873996 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lt7pt\"" Jul 23 21:26:04.874571 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.874242 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.875681 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.875660 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:04.875794 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:04.875775 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:04.876934 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.876887 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.877120 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.877080 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zm6m\"" Jul 23 21:26:04.877685 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.877123 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 21:26:04.877798 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.877200 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.877879 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.877361 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.878937 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.878915 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.879051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.878944 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 21:26:04.880210 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.880189 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:04.881221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.881201 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.881425 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.881200 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.881660 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.881642 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5kxb8\"" Jul 23 21:26:04.881946 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.881928 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.882244 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.882227 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 21:26:04.882332 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.882282 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5j4qf\"" Jul 23 21:26:04.883067 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.882749 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.883281 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.883246 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 21:26:04.883792 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.883754 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-54t6f\"" Jul 23 21:26:04.884287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.884264 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.884578 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.884543 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.885023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.884999 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.886367 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.886349 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:04.886467 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:04.886424 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:04.887447 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.887425 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 21:26:04.887557 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.887471 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 21:26:04.889033 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889011 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v29xb\"" Jul 23 21:26:04.889127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889061 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 21:26:04.889127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889067 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 21:26:04.889301 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889126 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 21:26:04.889301 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-tmp\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889301 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889266 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-k8s-cni-cncf-io\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889301 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-multus-certs\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889311 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-modprobe-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889314 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-kubernetes\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-conf\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-netns\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889472 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-registration-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-sys\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-system-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-cnibin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889575 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889623 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnrl\" (UniqueName: \"kubernetes.io/projected/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-kube-api-access-bfnrl\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-daemon-config\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889670 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-sys-fs\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889693 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-bin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-lib-modules\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.889742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkxz\" (UniqueName: \"kubernetes.io/projected/b7d7f64d-333d-403e-816b-11a767b1ba2f-kube-api-access-qrkxz\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-conf-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889812 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed946ab-20a3-4fec-ad08-eff4c3d22642-konnectivity-ca\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889864 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-multus\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889891 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-kubelet\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889934 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-system-cni-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.889976 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-os-release\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890005 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5s82\" (UniqueName: \"kubernetes.io/projected/61017217-5c58-404f-9156-7f84d6582f73-kube-api-access-z5s82\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-os-release\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-hostroot\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-etc-kubernetes\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysconfig\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-run\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.890279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-tuned\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890319 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-socket-dir-parent\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-cnibin\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890405 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed946ab-20a3-4fec-ad08-eff4c3d22642-agent-certs\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-device-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-systemd\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890463 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-host\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890497 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwh9\" (UniqueName: \"kubernetes.io/projected/782aebb8-4e5d-4a0c-ab00-607c8346add7-kube-api-access-ptwh9\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890576 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61017217-5c58-404f-9156-7f84d6582f73-tmp-dir\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-socket-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890635 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x982c\" (UniqueName: \"kubernetes.io/projected/491ec3c0-52e5-41b1-b467-329414f4bb42-kube-api-access-x982c\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5363779-23fc-49b7-bf64-caf7c771214c-serviceca\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890670 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-cni-binary-copy\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.890880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.891576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890720 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61017217-5c58-404f-9156-7f84d6582f73-hosts-file\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.891576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-var-lib-kubelet\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.891576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890753 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5363779-23fc-49b7-bf64-caf7c771214c-host\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.891576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890776 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c99\" (UniqueName: \"kubernetes.io/projected/c5363779-23fc-49b7-bf64-caf7c771214c-kube-api-access-k2c99\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.891576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.890795 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5n67\" (UniqueName: \"kubernetes.io/projected/a9e16765-d35a-458b-90e2-8b8af35b72d4-kube-api-access-n5n67\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.896827 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.896810 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:26:04.924000 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.923975 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wftg6" Jul 23 21:26:04.930833 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.930805 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wftg6" Jul 23 21:26:04.978984 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.978907 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 21:26:04.991903 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.991864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-lib-modules\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.991903 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.991905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.991937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkxz\" (UniqueName: \"kubernetes.io/projected/b7d7f64d-333d-403e-816b-11a767b1ba2f-kube-api-access-qrkxz\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.991962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-conf-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.991981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed946ab-20a3-4fec-ad08-eff4c3d22642-konnectivity-ca\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992004 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-multus\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992069 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-conf-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992068 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-lib-modules\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-kubelet\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-var-lib-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-node-log\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992300 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-config\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992348 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-system-cni-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-os-release\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992423 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-multus\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992461 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-kubelet\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992485 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5s82\" (UniqueName: \"kubernetes.io/projected/61017217-5c58-404f-9156-7f84d6582f73-kube-api-access-z5s82\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992519 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-os-release\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.992565 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-hostroot\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-os-release\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992649 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-system-cni-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-etc-kubernetes\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992723 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzxk\" (UniqueName: \"kubernetes.io/projected/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-kube-api-access-fnzxk\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992759 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-kubelet\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992820 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed946ab-20a3-4fec-ad08-eff4c3d22642-konnectivity-ca\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.992891 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-netns\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993031 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-etc-kubernetes\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993046 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-os-release\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovn-node-metrics-cert\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-kubelet-config\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993131 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-hostroot\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:04.993138 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993188 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysconfig\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-run\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993277 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysconfig\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:04.993281 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:05.493233646 +0000 UTC m=+3.010128709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-run\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-tuned\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993356 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-socket-dir-parent\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-systemd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-ovn\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993466 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-log-socket\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993498 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-cnibin\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993511 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-socket-dir-parent\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed946ab-20a3-4fec-ad08-eff4c3d22642-agent-certs\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993555 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-device-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.993807 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993586 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-etc-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-bin\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993658 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-systemd\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-host\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993738 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-cnibin\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993759 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993818 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-host\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993833 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-device-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwh9\" (UniqueName: \"kubernetes.io/projected/782aebb8-4e5d-4a0c-ab00-607c8346add7-kube-api-access-ptwh9\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993833 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61017217-5c58-404f-9156-7f84d6582f73-tmp-dir\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993917 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-socket-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/782aebb8-4e5d-4a0c-ab00-607c8346add7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x982c\" (UniqueName: \"kubernetes.io/projected/491ec3c0-52e5-41b1-b467-329414f4bb42-kube-api-access-x982c\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5363779-23fc-49b7-bf64-caf7c771214c-serviceca\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.994508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-cni-binary-copy\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-netd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994081 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61017217-5c58-404f-9156-7f84d6582f73-hosts-file\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994277 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-var-lib-kubelet\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5363779-23fc-49b7-bf64-caf7c771214c-host\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994336 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c99\" (UniqueName: \"kubernetes.io/projected/c5363779-23fc-49b7-bf64-caf7c771214c-kube-api-access-k2c99\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994360 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5n67\" (UniqueName: \"kubernetes.io/projected/a9e16765-d35a-458b-90e2-8b8af35b72d4-kube-api-access-n5n67\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994417 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-host-slash\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994445 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994455 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-tmp\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-k8s-cni-cncf-io\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-multus-certs\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.993882 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-systemd\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-modprobe-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.995308 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-kubernetes\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994620 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61017217-5c58-404f-9156-7f84d6582f73-tmp-dir\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994629 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-conf\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5363779-23fc-49b7-bf64-caf7c771214c-serviceca\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994734 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61017217-5c58-404f-9156-7f84d6582f73-hosts-file\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994711 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-netns\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994760 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-socket-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994784 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-var-lib-kubelet\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-registration-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994833 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-multus-certs\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-slash\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.994994 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-kubernetes\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995081 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-cni-binary-copy\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995121 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-k8s-cni-cncf-io\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995124 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995124 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-conf\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995188 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5363779-23fc-49b7-bf64-caf7c771214c-host\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:04.996144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-sys\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995199 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-registration-dir\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995251 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-sys\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-run-netns\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-system-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995329 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-cnibin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-system-cni-dir\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995331 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-modprobe-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995396 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-cnibin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995413 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-dbus\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995454 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/782aebb8-4e5d-4a0c-ab00-607c8346add7-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995473 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnrl\" (UniqueName: \"kubernetes.io/projected/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-kube-api-access-bfnrl\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995501 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-daemon-config\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995538 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-sys-fs\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-sysctl-d\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.997130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-env-overrides\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-script-lib\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995618 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/491ec3c0-52e5-41b1-b467-329414f4bb42-sys-fs\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ss7\" (UniqueName: \"kubernetes.io/projected/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-kube-api-access-c7ss7\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995665 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-bin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995684 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-iptables-alerter-script\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995700 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-systemd-units\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995750 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9e16765-d35a-458b-90e2-8b8af35b72d4-host-var-lib-cni-bin\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.995986 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9e16765-d35a-458b-90e2-8b8af35b72d4-multus-daemon-config\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:04.998051 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.998035 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-etc-tuned\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.998524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.998059 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-tmp\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:04.998524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:04.998401 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed946ab-20a3-4fec-ad08-eff4c3d22642-agent-certs\") pod \"konnectivity-agent-r6w8p\" (UID: \"3ed946ab-20a3-4fec-ad08-eff4c3d22642\") " pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.007765 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.007806 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.007822 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.007896 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:05.507876482 +0000 UTC m=+3.024771539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.008986 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkxz\" (UniqueName: \"kubernetes.io/projected/b7d7f64d-333d-403e-816b-11a767b1ba2f-kube-api-access-qrkxz\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:05.011522 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.010249 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5s82\" (UniqueName: \"kubernetes.io/projected/61017217-5c58-404f-9156-7f84d6582f73-kube-api-access-z5s82\") pod \"node-resolver-kxdkv\" (UID: \"61017217-5c58-404f-9156-7f84d6582f73\") " pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:05.014854 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.014833 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x982c\" (UniqueName: \"kubernetes.io/projected/491ec3c0-52e5-41b1-b467-329414f4bb42-kube-api-access-x982c\") pod \"aws-ebs-csi-driver-node-flbqz\" (UID: \"491ec3c0-52e5-41b1-b467-329414f4bb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:05.015083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.015060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c99\" (UniqueName: \"kubernetes.io/projected/c5363779-23fc-49b7-bf64-caf7c771214c-kube-api-access-k2c99\") pod \"node-ca-6qn96\" (UID: \"c5363779-23fc-49b7-bf64-caf7c771214c\") " pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:05.015776 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.015755 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnrl\" (UniqueName: \"kubernetes.io/projected/958e6bda-3fcb-4cd0-a893-eba50d6d2c12-kube-api-access-bfnrl\") pod \"tuned-49w72\" (UID: \"958e6bda-3fcb-4cd0-a893-eba50d6d2c12\") " pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:05.036050 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.036021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5n67\" (UniqueName: \"kubernetes.io/projected/a9e16765-d35a-458b-90e2-8b8af35b72d4-kube-api-access-n5n67\") pod \"multus-29gw7\" (UID: \"a9e16765-d35a-458b-90e2-8b8af35b72d4\") " pod="openshift-multus/multus-29gw7" Jul 23 21:26:05.036780 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.036750 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwh9\" (UniqueName: \"kubernetes.io/projected/782aebb8-4e5d-4a0c-ab00-607c8346add7-kube-api-access-ptwh9\") pod \"multus-additional-cni-plugins-gpmnh\" (UID: \"782aebb8-4e5d-4a0c-ab00-607c8346add7\") " pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:05.074785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.074731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" event={"ID":"58b77fc7576202595728da24c1fb8b2a","Type":"ContainerStarted","Data":"288029b1e3ee97ea6b2a024ab74692e7fcfaa99155c9892d304bb755fe96522e"} Jul 23 21:26:05.075927 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.075899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" event={"ID":"8c5147dd0fddb2e4959f509033dbce18","Type":"ContainerStarted","Data":"12a6a9aa2ca71a8e586ac8ccb3af1098fad8be0efd100c8f45c8ed2546bd8b39"} Jul 23 21:26:05.096704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-slash\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-dbus\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-env-overrides\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-script-lib\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ss7\" (UniqueName: \"kubernetes.io/projected/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-kube-api-access-c7ss7\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.096816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096808 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-slash\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096821 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096818 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-iptables-alerter-script\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096871 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-systemd-units\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-var-lib-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096939 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-node-log\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.096962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-config\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzxk\" (UniqueName: \"kubernetes.io/projected/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-kube-api-access-fnzxk\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097032 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-kubelet\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-netns\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097084 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovn-node-metrics-cert\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097132 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-kubelet-config\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.097196 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-systemd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097224 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-ovn\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-log-socket\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097277 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-etc-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-bin\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097332 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097404 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-iptables-alerter-script\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097409 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-node-log\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097415 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-dbus\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097517 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097569 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-etc-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097609 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-log-socket\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097622 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-run-netns\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097630 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-kubelet\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097644 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-ovn\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.097707 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-netd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.097808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.097797 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:05.597754314 +0000 UTC m=+3.114649355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097825 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-systemd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-host-slash\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097867 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-netd\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-var-lib-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-host-slash\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097794 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-run-openvswitch\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097954 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-script-lib\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097967 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-systemd-units\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.097961 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-host-cni-bin\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.098003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovnkube-config\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.098014 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-kubelet-config\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.098553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.098137 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-env-overrides\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.100507 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.100483 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-ovn-node-metrics-cert\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.111199 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.111173 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzxk\" (UniqueName: \"kubernetes.io/projected/08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2-kube-api-access-fnzxk\") pod \"iptables-alerter-hnflf\" (UID: \"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2\") " pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.112420 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.112395 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ss7\" (UniqueName: \"kubernetes.io/projected/7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f-kube-api-access-c7ss7\") pod \"ovnkube-node-vczgs\" (UID: \"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.178348 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.178302 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49w72" Jul 23 21:26:05.187509 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.187476 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:05.197497 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.197471 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29gw7" Jul 23 21:26:05.204588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.204543 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" Jul 23 21:26:05.210691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.210531 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" Jul 23 21:26:05.217272 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.217248 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxdkv" Jul 23 21:26:05.224185 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.224150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qn96" Jul 23 21:26:05.233526 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.233465 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnflf" Jul 23 21:26:05.239496 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.239474 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:05.365151 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:05.365105 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958e6bda_3fcb_4cd0_a893_eba50d6d2c12.slice/crio-378179c89718d5b8e00591cf4b20cdefb0148712e0034233ed03395272200493 WatchSource:0}: Error finding container 378179c89718d5b8e00591cf4b20cdefb0148712e0034233ed03395272200493: Status 404 returned error can't find the container with id 378179c89718d5b8e00591cf4b20cdefb0148712e0034233ed03395272200493 Jul 23 21:26:05.367031 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:05.367000 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08fd94a5_46bf_4b12_a4a5_fcb7f3044bd2.slice/crio-72fe6c5e13d2282202e11cc371dd499d77182c0d8b126a37308db37acfc84a23 WatchSource:0}: Error finding container 72fe6c5e13d2282202e11cc371dd499d77182c0d8b126a37308db37acfc84a23: Status 404 returned error can't find the container with id 72fe6c5e13d2282202e11cc371dd499d77182c0d8b126a37308db37acfc84a23 Jul 23 21:26:05.372246 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:05.372220 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7844a2c8_3514_44f2_bd5a_ea2b04a5cb3f.slice/crio-4656e5ddf139ea226fd001a47b98895af14ae82f1ccc468dcb8fc74ba43e6c74 WatchSource:0}: Error finding container 4656e5ddf139ea226fd001a47b98895af14ae82f1ccc468dcb8fc74ba43e6c74: Status 404 returned error can't find the container with id 4656e5ddf139ea226fd001a47b98895af14ae82f1ccc468dcb8fc74ba43e6c74 Jul 23 21:26:05.375962 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:05.375597 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782aebb8_4e5d_4a0c_ab00_607c8346add7.slice/crio-8e6dc71580257d290493ce421e535b3b59c96fa93c04ae341bebf2bb7d32e151 WatchSource:0}: Error finding container 8e6dc71580257d290493ce421e535b3b59c96fa93c04ae341bebf2bb7d32e151: Status 404 returned error can't find the container with id 8e6dc71580257d290493ce421e535b3b59c96fa93c04ae341bebf2bb7d32e151 Jul 23 21:26:05.501767 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.501681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:05.501919 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.501884 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:05.502019 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.502004 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:06.501981074 +0000 UTC m=+4.018876118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:05.602763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.602725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:05.602763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.602771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:05.603015 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.602931 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:05.603015 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.602953 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:05.603015 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.602966 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.603015 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.603015 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:06.603001696 +0000 UTC m=+4.119896737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.603397 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.603378 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.603459 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:05.603429 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:06.603417207 +0000 UTC m=+4.120312246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.933837 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.933552 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:21:05 +0000 UTC" deadline="2028-02-10 10:31:53.365421524 +0000 UTC" Jul 23 21:26:05.933837 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:05.933605 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13597h5m47.431820434s" Jul 23 21:26:06.070828 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.070291 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:06.070828 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.070447 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:06.081573 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.081494 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6w8p" event={"ID":"3ed946ab-20a3-4fec-ad08-eff4c3d22642","Type":"ContainerStarted","Data":"b31d63111f80636bb7fe2ecb35d2cc31ff650e1d1adfa4570c0c5c081fab7486"} Jul 23 21:26:06.086287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.086251 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qn96" event={"ID":"c5363779-23fc-49b7-bf64-caf7c771214c","Type":"ContainerStarted","Data":"0c48a12e7ff510f112dba240e514d45e3e4f618d7fcb73a7fa4f10b37900dfa2"} Jul 23 21:26:06.090742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.090705 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerStarted","Data":"8e6dc71580257d290493ce421e535b3b59c96fa93c04ae341bebf2bb7d32e151"} Jul 23 21:26:06.094757 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.094731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" event={"ID":"491ec3c0-52e5-41b1-b467-329414f4bb42","Type":"ContainerStarted","Data":"9a297701b2b1a77627e6a6793d87ff245ff385ace7917b3d3941520fd6723ca5"} Jul 23 21:26:06.102142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.102070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29gw7" event={"ID":"a9e16765-d35a-458b-90e2-8b8af35b72d4","Type":"ContainerStarted","Data":"9cd8ed80153b168dedc429f19856f5367104f4da62b65eb6e7b4b0de1a9ac2dc"} Jul 23 21:26:06.110780 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.110749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxdkv" event={"ID":"61017217-5c58-404f-9156-7f84d6582f73","Type":"ContainerStarted","Data":"d65e8a9a88c67ac0a59d913dc4935355eda3de7abc89ace65929f8525373159d"} Jul 23 21:26:06.115460 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.115368 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"4656e5ddf139ea226fd001a47b98895af14ae82f1ccc468dcb8fc74ba43e6c74"} Jul 23 21:26:06.125974 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.125943 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49w72" event={"ID":"958e6bda-3fcb-4cd0-a893-eba50d6d2c12","Type":"ContainerStarted","Data":"378179c89718d5b8e00591cf4b20cdefb0148712e0034233ed03395272200493"} Jul 23 21:26:06.132699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.132667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" event={"ID":"58b77fc7576202595728da24c1fb8b2a","Type":"ContainerStarted","Data":"10358afad6e0737286e3334661068c85b5d1e8d9d782f94c7ed0360a4302ff7c"} Jul 23 21:26:06.136174 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.136091 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnflf" event={"ID":"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2","Type":"ContainerStarted","Data":"72fe6c5e13d2282202e11cc371dd499d77182c0d8b126a37308db37acfc84a23"} Jul 23 21:26:06.510639 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.509863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:06.510639 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.510055 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:06.510639 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.510144 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.510105227 +0000 UTC m=+6.027000283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:06.610851 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.610813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:06.610851 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.610865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:06.611143 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611040 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:06.611143 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611065 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:06.611143 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611079 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:06.611310 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611163 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.611141985 +0000 UTC m=+6.128037036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:06.611753 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611490 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:06.611753 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:06.611560 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.611542368 +0000 UTC m=+6.128437411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:06.933927 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.933794 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:21:05 +0000 UTC" deadline="2028-02-26 20:43:04.594937094 +0000 UTC" Jul 23 21:26:06.933927 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:06.933841 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13991h16m57.66110157s" Jul 23 21:26:07.072785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:07.072534 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:07.072959 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:07.072882 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:07.072959 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:07.072898 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:07.073110 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:07.073001 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:08.070233 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:08.070205 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:08.070625 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.070363 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:08.144560 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:08.144520 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" event={"ID":"8c5147dd0fddb2e4959f509033dbce18","Type":"ContainerStarted","Data":"dfa34b3e87e2c0587904af2460483611090d597480f09f65e666bc0ef1c29e9c"} Jul 23 21:26:08.529751 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:08.529652 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:08.529936 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.529851 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.529936 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.529920 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:12.529898411 +0000 UTC m=+10.046793453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:08.630293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:08.630351 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.630531 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.630552 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.630566 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.630631 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:12.630609153 +0000 UTC m=+10.147504202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.631051 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:08.631665 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:08.631113 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:12.631086914 +0000 UTC m=+10.147981956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:09.072886 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:09.072854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:09.073275 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:09.072991 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:09.073441 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:09.073425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:09.073530 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:09.073511 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:09.153195 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:09.152571 2569 generic.go:356] "Generic (PLEG): container finished" podID="8c5147dd0fddb2e4959f509033dbce18" containerID="dfa34b3e87e2c0587904af2460483611090d597480f09f65e666bc0ef1c29e9c" exitCode=0 Jul 23 21:26:09.153195 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:09.152625 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" event={"ID":"8c5147dd0fddb2e4959f509033dbce18","Type":"ContainerDied","Data":"dfa34b3e87e2c0587904af2460483611090d597480f09f65e666bc0ef1c29e9c"} Jul 23 21:26:09.168777 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:09.168719 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-103.ec2.internal" podStartSLOduration=5.168699942 podStartE2EDuration="5.168699942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:06.150138769 +0000 UTC m=+3.667033835" watchObservedRunningTime="2026-07-23 21:26:09.168699942 +0000 UTC m=+6.685595006" Jul 23 21:26:10.069926 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:10.069888 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:10.070144 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:10.070049 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:11.072846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:11.072759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:11.073524 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:11.072889 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:11.073524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:11.072954 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:11.073524 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:11.073031 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:12.070902 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:12.070390 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:12.070902 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.070567 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:12.566953 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:12.566863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:12.567410 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.566986 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:12.567410 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.567069 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:20.567045638 +0000 UTC m=+18.083940691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:12.668356 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:12.668317 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:12.668356 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:12.668360 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668464 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668490 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668506 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668520 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668534 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:20.668518788 +0000 UTC m=+18.185413827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:12.668585 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:12.668570 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:20.66855366 +0000 UTC m=+18.185448703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:13.072362 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:13.072333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:13.072548 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:13.072452 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:13.073287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:13.072838 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:13.073287 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:13.072928 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:14.069797 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:14.069760 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:14.070296 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:14.069915 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:15.071657 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:15.071623 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:15.072047 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:15.071742 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:15.072333 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:15.072171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:15.072333 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:15.072273 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:16.069528 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:16.069492 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:16.069673 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:16.069636 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:17.069694 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:17.069658 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:17.069694 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:17.069688 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:17.070222 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:17.069782 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:17.070222 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:17.069918 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:18.069577 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:18.069545 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:18.069731 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:18.069689 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:19.071014 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:19.069548 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:19.071014 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:19.069662 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:19.071014 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:19.069720 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:19.071014 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:19.069831 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:20.070057 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:20.070018 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:20.070247 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.070179 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:20.627145 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:20.627101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:20.627545 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.627251 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:20.627545 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.627330 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:26:36.627307673 +0000 UTC m=+34.144202727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:20.727790 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:20.727753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:20.727967 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:20.727802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:20.727967 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.727930 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:20.727967 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.727942 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:20.727967 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.727966 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:20.728208 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.727977 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:20.728208 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.728014 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:36.7279874 +0000 UTC m=+34.244882456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:20.728208 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:20.728034 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:36.728022674 +0000 UTC m=+34.244917711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:21.069830 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:21.069793 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:21.069985 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:21.069797 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:21.069985 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:21.069907 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:21.070131 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:21.069977 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:22.070089 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:22.070041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:22.070448 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:22.070171 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:23.071158 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:23.071119 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:23.071629 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:23.071214 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:23.071629 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:23.071298 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:23.071629 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:23.071376 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:24.069849 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:24.069813 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:24.070030 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:24.069946 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:25.070159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:25.069925 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:25.070159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:25.069965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:25.070159 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:25.070045 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:25.070159 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:25.070131 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:26.070791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.070440 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:26.071394 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:26.070913 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:26.190227 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.190184 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29gw7" event={"ID":"a9e16765-d35a-458b-90e2-8b8af35b72d4","Type":"ContainerStarted","Data":"f2a396cd74ce7fe9bba99208db8404468ae0920ca8615d649a07b9771e8fbcd8"} Jul 23 21:26:26.193687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.193653 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxdkv" event={"ID":"61017217-5c58-404f-9156-7f84d6582f73","Type":"ContainerStarted","Data":"9e3742ac0ed58d48fab674a11c30bdb311295f7d083619101fd6d5ad9b46582c"} Jul 23 21:26:26.196853 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.196824 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:26:26.197289 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197267 2569 generic.go:356] "Generic (PLEG): container finished" podID="7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f" containerID="0df54b6ae3bbcde1326f69f6867b0d12e00ee78f5381aa3d143b7ecb0b8fee27" exitCode=1 Jul 23 21:26:26.197384 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"a291c22dea05ea5be1d09d0ccfa124f77efc8012c3777c241e9f72525d4bda8b"} Jul 23 21:26:26.197442 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197390 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"5c69c875baf4e78ecb90aabddcb06dfde345121b5f35660683031b638665c2fd"} Jul 23 21:26:26.197442 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197432 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"b5ff30043314bc11286975082f2a491ea743d5590a41106d57602d6fef38200a"} Jul 23 21:26:26.197540 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"c88d22d1c340c96a02ded7b02c08c5b9376892d8c5d7af2815ac5bcf8f78c24b"} Jul 23 21:26:26.197540 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197509 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerDied","Data":"0df54b6ae3bbcde1326f69f6867b0d12e00ee78f5381aa3d143b7ecb0b8fee27"} Jul 23 21:26:26.197638 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.197552 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"72de57b750051185f0129383e6caef4f93f8250dc375da5fc6ce8a24dba993a9"} Jul 23 21:26:26.198942 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.198920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49w72" event={"ID":"958e6bda-3fcb-4cd0-a893-eba50d6d2c12","Type":"ContainerStarted","Data":"12bad691f92198a669dfd952b79302048aaad67efb6d1a59008c85704314e758"} Jul 23 21:26:26.200836 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.200817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" event={"ID":"8c5147dd0fddb2e4959f509033dbce18","Type":"ContainerStarted","Data":"91840af63d49d8403ecfe92116fadd434ccd3519df277a3bcc46d58ac191a527"} Jul 23 21:26:26.202261 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.202241 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6w8p" event={"ID":"3ed946ab-20a3-4fec-ad08-eff4c3d22642","Type":"ContainerStarted","Data":"c9724ab18bf210d780f2442c18861c3f8015f7bf2a28441f5a74b70ca32eaa1a"} Jul 23 21:26:26.203599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.203578 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qn96" event={"ID":"c5363779-23fc-49b7-bf64-caf7c771214c","Type":"ContainerStarted","Data":"7c7105786e08056bac96c4d2bab97247c285a26d53ca0f93285d6a91e83985d1"} Jul 23 21:26:26.204775 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.204756 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="9cf79a2df5007d899b9f0a11c6efa55e68bf4c0f1e137ddc25f0d0d6ae7a8d47" exitCode=0 Jul 23 21:26:26.204855 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.204836 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"9cf79a2df5007d899b9f0a11c6efa55e68bf4c0f1e137ddc25f0d0d6ae7a8d47"} Jul 23 21:26:26.206066 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.206047 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" event={"ID":"491ec3c0-52e5-41b1-b467-329414f4bb42","Type":"ContainerStarted","Data":"2ec0554561eaf7c11bdd95fb133a24f2c4e429679f0d16096013311eaf8d2ab9"} Jul 23 21:26:26.214615 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.214583 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-29gw7" podStartSLOduration=3.539071446 podStartE2EDuration="23.214572767s" totalImagesPullingTime="19.675501321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.214238955 +0000 UTC m=+23.731134014" watchObservedRunningTime="2026-07-23 21:26:26.214572767 +0000 UTC m=+23.731467825" Jul 23 21:26:26.240856 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.240816 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxdkv" podStartSLOduration=3.579653613 podStartE2EDuration="23.240802332s" totalImagesPullingTime="19.661148719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.22747573 +0000 UTC m=+23.744370810" watchObservedRunningTime="2026-07-23 21:26:26.240802332 +0000 UTC m=+23.757697387" Jul 23 21:26:26.240982 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.240886 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qn96" podStartSLOduration=3.56734671 podStartE2EDuration="23.240879592s" totalImagesPullingTime="19.673532882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.240450874 +0000 UTC m=+23.757345942" watchObservedRunningTime="2026-07-23 21:26:26.240879592 +0000 UTC m=+23.757774651" Jul 23 21:26:26.253647 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.253604 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-103.ec2.internal" podStartSLOduration=22.253593387 podStartE2EDuration="22.253593387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.253538683 +0000 UTC m=+23.770433741" watchObservedRunningTime="2026-07-23 21:26:26.253593387 +0000 UTC m=+23.770488446" Jul 23 21:26:26.268717 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.268680 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-49w72" podStartSLOduration=3.575801372 podStartE2EDuration="23.268667978s" totalImagesPullingTime="19.692866606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.268301665 +0000 UTC m=+23.785196737" watchObservedRunningTime="2026-07-23 21:26:26.268667978 +0000 UTC m=+23.785563037" Jul 23 21:26:26.283047 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.283009 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r6w8p" podStartSLOduration=12.012462794 podStartE2EDuration="23.282998469s" totalImagesPullingTime="11.270535675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:26.282541741 +0000 UTC m=+23.799436811" watchObservedRunningTime="2026-07-23 21:26:26.282998469 +0000 UTC m=+23.799893528" Jul 23 21:26:26.416615 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.416589 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 21:26:26.959160 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.959026 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T21:26:26.416612562Z","UUID":"26bc57d6-bd85-4643-ada7-59f04cc0f0dc","Handler":null,"Name":"","Endpoint":""} Jul 23 21:26:26.960937 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.960912 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 21:26:26.961063 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:26.960961 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 21:26:27.070169 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:27.070141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:27.070341 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:27.070271 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:27.070341 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:27.070289 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:27.070450 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:27.070389 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:27.210704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:27.210625 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" event={"ID":"491ec3c0-52e5-41b1-b467-329414f4bb42","Type":"ContainerStarted","Data":"68d4481c13bc2e5a140eaa14fab4420037be493fccbaceb4df116b95056fe684"} Jul 23 21:26:27.213068 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:27.212290 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnflf" event={"ID":"08fd94a5-46bf-4b12-a4a5-fcb7f3044bd2","Type":"ContainerStarted","Data":"12cbe5c89e058c166debf7cb9610c02877caf59562c0c19dc432cac124ca1490"} Jul 23 21:26:27.227929 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:27.227872 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnflf" podStartSLOduration=4.557442568 podStartE2EDuration="24.227852815s" totalImagesPullingTime="19.670410247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:27.227188193 +0000 UTC m=+24.744083455" watchObservedRunningTime="2026-07-23 21:26:27.227852815 +0000 UTC m=+24.744747875" Jul 23 21:26:28.006933 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.006881 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:28.007534 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.007511 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:28.069697 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.069668 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:28.069855 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:28.069812 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:28.217900 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.217815 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:26:28.218339 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.218273 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"fcc09e43f70650e593ee1ff1273378a608f6e23f6157c02f6fd04237207b0ad2"} Jul 23 21:26:28.220635 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.220572 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" event={"ID":"491ec3c0-52e5-41b1-b467-329414f4bb42","Type":"ContainerStarted","Data":"e19e9731e894f3d42ab7ac8d2f2c80518d147b6d989639673b645e1ff8f50587"} Jul 23 21:26:28.220805 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.220785 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:28.221518 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.221500 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r6w8p" Jul 23 21:26:28.256816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:28.256771 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-flbqz" podStartSLOduration=3.7746039959999997 podStartE2EDuration="25.256758611s" totalImagesPullingTime="21.482154615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:28.238611381 +0000 UTC m=+25.755506432" watchObservedRunningTime="2026-07-23 21:26:28.256758611 +0000 UTC m=+25.773653726" Jul 23 21:26:29.070397 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:29.070358 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:29.070568 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:29.070483 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:29.070568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:29.070544 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:29.070669 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:29.070629 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:30.070526 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:30.069821 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:30.070526 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:30.070158 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:31.069909 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.069877 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:31.070035 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:31.069994 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:31.070112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.070041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:31.070177 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:31.070147 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:31.229577 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.229394 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="2d95e1d443a94f48b47fa54a3d8248ad83fef723d4ca1db369f105650d1ffa93" exitCode=0 Jul 23 21:26:31.230300 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.229471 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"2d95e1d443a94f48b47fa54a3d8248ad83fef723d4ca1db369f105650d1ffa93"} Jul 23 21:26:31.233133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.233114 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:26:31.233471 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.233450 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"f0a563aa9485a849bb3e9d3b8bdc146d8424cc424cae20d3a41aa8106d1173a1"} Jul 23 21:26:31.233743 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.233708 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:31.233926 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.233883 2569 scope.go:117] "RemoveContainer" containerID="0df54b6ae3bbcde1326f69f6867b0d12e00ee78f5381aa3d143b7ecb0b8fee27" Jul 23 21:26:31.249656 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:31.249635 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:32.070013 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.069977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:32.070197 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:32.070149 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:32.238751 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.238730 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:26:32.239132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.239067 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" event={"ID":"7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f","Type":"ContainerStarted","Data":"0908a2090dd226fe988d55fdc164b3b0f54079c3c0639c1932732a856d2691d5"} Jul 23 21:26:32.239336 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.239318 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:32.239410 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.239398 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:32.254932 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.254912 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:26:32.275827 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.275782 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" podStartSLOduration=9.519499666 podStartE2EDuration="29.275769018s" totalImagesPullingTime="19.756269352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:32.274040551 +0000 UTC m=+29.790935612" watchObservedRunningTime="2026-07-23 21:26:32.275769018 +0000 UTC m=+29.792664077" Jul 23 21:26:32.976912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.976886 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47glr"] Jul 23 21:26:32.977068 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.977005 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:32.977175 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:32.977151 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:32.977502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.977481 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hnpw7"] Jul 23 21:26:32.977575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.977565 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:32.977659 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:32.977643 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:32.979496 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.979468 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-67t9z"] Jul 23 21:26:32.979632 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:32.979561 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:32.979682 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:32.979652 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:33.246221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:33.246186 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="f68d70820776bb33ad99e02ebf859d89ff3c7b26ae1bb39860e29d2cd23ef059" exitCode=0 Jul 23 21:26:33.246663 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:33.246280 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"f68d70820776bb33ad99e02ebf859d89ff3c7b26ae1bb39860e29d2cd23ef059"} Jul 23 21:26:34.070170 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:34.070141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:34.070355 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:34.070268 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:35.069940 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:35.069732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:35.070332 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:35.069793 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:35.070332 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:35.069956 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:35.070332 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:35.070057 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:35.253601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:35.253570 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="ab9c7c8bc7d32b4518c35d7f639fb51f4869b7066d63e4a6760194c96efd7755" exitCode=0 Jul 23 21:26:35.253601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:35.253606 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"ab9c7c8bc7d32b4518c35d7f639fb51f4869b7066d63e4a6760194c96efd7755"} Jul 23 21:26:36.070360 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:36.070329 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:36.070863 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.070450 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:36.639441 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:36.639406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:36.639614 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.639593 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:36.639691 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.639679 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:27:08.639657002 +0000 UTC m=+66.156552047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:36.740159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:36.740120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:36.740330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:36.740247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:36.740389 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740327 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:36.740389 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740341 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:36.740389 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740354 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:36.740389 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740369 2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9d for pod openshift-network-diagnostics/network-check-target-47glr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:36.740591 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740401 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret podName:b238b0a9-eae5-4093-b71b-f3d74e66a2d9 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:08.740382964 +0000 UTC m=+66.257278022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret") pod "global-pull-secret-syncer-hnpw7" (UID: "b238b0a9-eae5-4093-b71b-f3d74e66a2d9") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:36.740591 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:36.740426 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d podName:98998843-1e08-4665-a2d2-6f6a3ead0a21 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:08.740409244 +0000 UTC m=+66.257304306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9d" (UniqueName: "kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d") pod "network-check-target-47glr" (UID: "98998843-1e08-4665-a2d2-6f6a3ead0a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:37.070623 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:37.070172 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:37.070623 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:37.070187 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:37.070623 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:37.070296 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47glr" podUID="98998843-1e08-4665-a2d2-6f6a3ead0a21" Jul 23 21:26:37.070623 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:37.070430 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hnpw7" podUID="b238b0a9-eae5-4093-b71b-f3d74e66a2d9" Jul 23 21:26:38.069969 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.069895 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:38.070159 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:38.070009 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:26:38.291854 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.291826 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-103.ec2.internal" event="NodeReady" Jul 23 21:26:38.292400 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.291973 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 21:26:38.343031 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.342956 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7rfg5"] Jul 23 21:26:38.375260 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.375223 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jd6dq"] Jul 23 21:26:38.375422 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.375332 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.378117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.378092 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 21:26:38.378249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.378153 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:26:38.378680 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.378661 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 21:26:38.400581 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.400560 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rfg5"] Jul 23 21:26:38.400714 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.400597 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jd6dq"] Jul 23 21:26:38.400775 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.400711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.404019 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.403997 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqp97\"" Jul 23 21:26:38.404220 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.404204 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 21:26:38.404296 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.404253 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 21:26:38.404347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.404331 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 21:26:38.452017 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.451977 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2193f99-506e-4e9f-9d40-615f7b2aba37-config-volume\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.452221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.452032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.452221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.452094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2193f99-506e-4e9f-9d40-615f7b2aba37-tmp-dir\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.452221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.452141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m594w\" (UniqueName: \"kubernetes.io/projected/c2193f99-506e-4e9f-9d40-615f7b2aba37-kube-api-access-m594w\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.552676 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.552637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2193f99-506e-4e9f-9d40-615f7b2aba37-tmp-dir\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.552676 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.552680 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m594w\" (UniqueName: \"kubernetes.io/projected/c2193f99-506e-4e9f-9d40-615f7b2aba37-kube-api-access-m594w\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.553021 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2193f99-506e-4e9f-9d40-615f7b2aba37-tmp-dir\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.553109 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2193f99-506e-4e9f-9d40-615f7b2aba37-config-volume\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.553229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.553229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553165 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/793b7480-eba1-4622-b1bd-149a01f96a41-cert\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.553229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdsrh\" (UniqueName: \"kubernetes.io/projected/793b7480-eba1-4622-b1bd-149a01f96a41-kube-api-access-cdsrh\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.553385 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:38.553261 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:38.553385 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:38.553329 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:39.053307644 +0000 UTC m=+36.570202697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:26:38.553636 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.553610 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2193f99-506e-4e9f-9d40-615f7b2aba37-config-volume\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.564091 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.564051 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m594w\" (UniqueName: \"kubernetes.io/projected/c2193f99-506e-4e9f-9d40-615f7b2aba37-kube-api-access-m594w\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:38.654282 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.654197 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/793b7480-eba1-4622-b1bd-149a01f96a41-cert\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.654282 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.654255 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsrh\" (UniqueName: \"kubernetes.io/projected/793b7480-eba1-4622-b1bd-149a01f96a41-kube-api-access-cdsrh\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.657093 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.657030 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/793b7480-eba1-4622-b1bd-149a01f96a41-cert\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.663144 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.663121 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsrh\" (UniqueName: \"kubernetes.io/projected/793b7480-eba1-4622-b1bd-149a01f96a41-kube-api-access-cdsrh\") pod \"ingress-canary-jd6dq\" (UID: \"793b7480-eba1-4622-b1bd-149a01f96a41\") " pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:38.710174 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:38.710135 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jd6dq" Jul 23 21:26:39.058228 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.058174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:39.058403 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:39.058347 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:39.058460 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:39.058418 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:40.058398322 +0000 UTC m=+37.575293361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:26:39.075049 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.075021 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:26:39.075253 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.075235 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:26:39.077767 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.077737 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:26:39.078788 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.078766 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:26:39.078899 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.078768 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:26:39.079601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.079580 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:26:39.602238 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:39.602210 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jd6dq"] Jul 23 21:26:39.606091 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:26:39.605927 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793b7480_eba1_4622_b1bd_149a01f96a41.slice/crio-0bdc97e5256b833cfd0a68183e5240654534ff140c918330a010ee220255fc7c WatchSource:0}: Error finding container 0bdc97e5256b833cfd0a68183e5240654534ff140c918330a010ee220255fc7c: Status 404 returned error can't find the container with id 0bdc97e5256b833cfd0a68183e5240654534ff140c918330a010ee220255fc7c Jul 23 21:26:40.066858 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.066786 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:40.066989 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:40.066895 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:40.066989 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:40.066946 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:42.06693257 +0000 UTC m=+39.583827606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:26:40.069826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.069797 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:26:40.072403 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.072379 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:26:40.072504 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.072419 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:26:40.267110 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.267049 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jd6dq" event={"ID":"793b7480-eba1-4622-b1bd-149a01f96a41","Type":"ContainerStarted","Data":"0bdc97e5256b833cfd0a68183e5240654534ff140c918330a010ee220255fc7c"} Jul 23 21:26:40.270151 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.270123 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="9e0e6f8a8ef39451ca43e0a265b72dafed17da575132af2eebc44fa123eaebe4" exitCode=0 Jul 23 21:26:40.270256 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:40.270188 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"9e0e6f8a8ef39451ca43e0a265b72dafed17da575132af2eebc44fa123eaebe4"} Jul 23 21:26:41.275593 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:41.275561 2569 generic.go:356] "Generic (PLEG): container finished" podID="782aebb8-4e5d-4a0c-ab00-607c8346add7" containerID="d50f403e905878471700702a28dc00c70792b8ffd96d6f45b01f85055a8ef3e8" exitCode=0 Jul 23 21:26:41.275961 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:41.275599 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerDied","Data":"d50f403e905878471700702a28dc00c70792b8ffd96d6f45b01f85055a8ef3e8"} Jul 23 21:26:42.081910 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:42.081883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:42.082052 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:42.082022 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:42.082131 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:42.082102 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:46.082064073 +0000 UTC m=+43.598959109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:26:42.281705 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:42.281625 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" event={"ID":"782aebb8-4e5d-4a0c-ab00-607c8346add7","Type":"ContainerStarted","Data":"739d5d39ea58785517fdf169760c0280a42bfc6c1f281b3796ec5c89de2ba697"} Jul 23 21:26:42.307403 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:42.307354 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gpmnh" podStartSLOduration=8.401437315 podStartE2EDuration="39.307340601s" totalImagesPullingTime="30.905903286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:42.305381965 +0000 UTC m=+39.822277024" watchObservedRunningTime="2026-07-23 21:26:42.307340601 +0000 UTC m=+39.824235660" Jul 23 21:26:43.285702 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:43.285534 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jd6dq" event={"ID":"793b7480-eba1-4622-b1bd-149a01f96a41","Type":"ContainerStarted","Data":"f46b2c61df697590a76eedbadb83cbac045d0527059129f1117560ca2fdd4cab"} Jul 23 21:26:43.303421 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:43.303374 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jd6dq" podStartSLOduration=2.513330306 podStartE2EDuration="5.303358858s" totalImagesPullingTime="2.790028552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:43.302887747 +0000 UTC m=+40.819782807" watchObservedRunningTime="2026-07-23 21:26:43.303358858 +0000 UTC m=+40.820253958" Jul 23 21:26:46.111092 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:46.111040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:46.111573 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:46.111229 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:46.111573 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:46.111315 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:54.111293138 +0000 UTC m=+51.628188175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:26:54.164849 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:26:54.164807 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:26:54.165335 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:54.164932 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:54.165335 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:26:54.164991 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:10.164974338 +0000 UTC m=+67.681869379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:27:04.260063 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:04.260030 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vczgs" Jul 23 21:27:08.667387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.667350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:27:08.670059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.670039 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:27:08.678022 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:08.678001 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:27:08.678099 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:08.678085 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:28:12.678054308 +0000 UTC m=+130.194949345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : secret "metrics-daemon-secret" not found Jul 23 21:27:08.767948 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.767916 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:27:08.767948 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.767950 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:27:08.770886 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.770868 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:27:08.771034 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.771016 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:27:08.781409 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.781379 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:27:08.783042 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.783019 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b238b0a9-eae5-4093-b71b-f3d74e66a2d9-original-pull-secret\") pod \"global-pull-secret-syncer-hnpw7\" (UID: \"b238b0a9-eae5-4093-b71b-f3d74e66a2d9\") " pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:27:08.789575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.789556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hnpw7" Jul 23 21:27:08.791770 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.791754 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfx9d\" (UniqueName: \"kubernetes.io/projected/98998843-1e08-4665-a2d2-6f6a3ead0a21-kube-api-access-jfx9d\") pod \"network-check-target-47glr\" (UID: \"98998843-1e08-4665-a2d2-6f6a3ead0a21\") " pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:27:08.797877 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.797856 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:27:08.806422 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.806389 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:27:08.924574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.924548 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hnpw7"] Jul 23 21:27:08.938218 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:08.938192 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47glr"] Jul 23 21:27:08.940671 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:27:08.940649 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98998843_1e08_4665_a2d2_6f6a3ead0a21.slice/crio-b18922b3f6fa10f899325e4d708533ef3bddcc3cdb5e91b8f843346f209e9291 WatchSource:0}: Error finding container b18922b3f6fa10f899325e4d708533ef3bddcc3cdb5e91b8f843346f209e9291: Status 404 returned error can't find the container with id b18922b3f6fa10f899325e4d708533ef3bddcc3cdb5e91b8f843346f209e9291 Jul 23 21:27:09.343209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:09.343169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47glr" event={"ID":"98998843-1e08-4665-a2d2-6f6a3ead0a21","Type":"ContainerStarted","Data":"b18922b3f6fa10f899325e4d708533ef3bddcc3cdb5e91b8f843346f209e9291"} Jul 23 21:27:09.344289 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:09.344266 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hnpw7" event={"ID":"b238b0a9-eae5-4093-b71b-f3d74e66a2d9","Type":"ContainerStarted","Data":"fd5bbefc104028c6ffe5791703909bc00138bd77efbbbff4a73e15090acbca91"} Jul 23 21:27:10.176766 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:10.176728 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:27:10.177250 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:10.176884 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:27:10.177250 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:10.176961 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:42.17694079 +0000 UTC m=+99.693835850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:27:14.360409 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:14.360371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47glr" event={"ID":"98998843-1e08-4665-a2d2-6f6a3ead0a21","Type":"ContainerStarted","Data":"259a36496618e66f6bf010570613a8d338eb4d4a563291d5ecf0f05e33f7f2fa"} Jul 23 21:27:14.360834 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:14.360464 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:27:14.361764 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:14.361737 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hnpw7" event={"ID":"b238b0a9-eae5-4093-b71b-f3d74e66a2d9","Type":"ContainerStarted","Data":"ba34404ac2ab6d5eee16ed1b510b4d06374591acf227315e72c3fc3104c19db4"} Jul 23 21:27:14.375334 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:14.375292 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-47glr" podStartSLOduration=66.448591694 podStartE2EDuration="1m11.375279953s" totalImagesPullingTime="4.926688259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:27:14.3747015 +0000 UTC m=+71.891596559" watchObservedRunningTime="2026-07-23 21:27:14.375279953 +0000 UTC m=+71.892175011" Jul 23 21:27:14.388919 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:14.388881 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hnpw7" podStartSLOduration=66.440163168 podStartE2EDuration="1m11.388867106s" totalImagesPullingTime="4.948703938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:27:14.388440741 +0000 UTC m=+71.905335800" watchObservedRunningTime="2026-07-23 21:27:14.388867106 +0000 UTC m=+71.905762165" Jul 23 21:27:42.187595 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:42.187480 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:27:42.187595 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:42.187580 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:27:42.188146 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:27:42.187643 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:46.187628731 +0000 UTC m=+163.704523768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:27:45.366885 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:27:45.366859 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-47glr" Jul 23 21:28:12.685583 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:28:12.685526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:28:12.686058 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:12.685655 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:28:12.686058 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:12.685709 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs podName:b7d7f64d-333d-403e-816b-11a767b1ba2f nodeName:}" failed. No retries permitted until 2026-07-23 21:30:14.685694816 +0000 UTC m=+252.202589853 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs") pod "network-metrics-daemon-67t9z" (UID: "b7d7f64d-333d-403e-816b-11a767b1ba2f") : secret "metrics-daemon-secret" not found Jul 23 21:28:41.386451 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:41.386386 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7rfg5" podUID="c2193f99-506e-4e9f-9d40-615f7b2aba37" Jul 23 21:28:41.563720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:28:41.563692 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:28:43.078062 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:43.078028 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-67t9z" podUID="b7d7f64d-333d-403e-816b-11a767b1ba2f" Jul 23 21:28:46.204061 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:28:46.204024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:28:46.204441 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:46.204182 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:28:46.204441 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:28:46.204260 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls podName:c2193f99-506e-4e9f-9d40-615f7b2aba37 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:48.204244029 +0000 UTC m=+285.721139067 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls") pod "dns-default-7rfg5" (UID: "c2193f99-506e-4e9f-9d40-615f7b2aba37") : secret "dns-default-metrics-tls" not found Jul 23 21:28:55.069787 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:28:55.069702 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:29:48.460767 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.460738 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f"] Jul 23 21:29:48.462648 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.462633 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" Jul 23 21:29:48.463975 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.463950 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ppfbn"] Jul 23 21:29:48.465383 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.465366 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wbcdt\"" Jul 23 21:29:48.465660 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.465643 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.469908 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.469716 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.470449 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.470432 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 21:29:48.470691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.470549 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.472605 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.472294 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-swg4h\"" Jul 23 21:29:48.473035 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.472457 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 21:29:48.474480 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.474453 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7"] Jul 23 21:29:48.476816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.476796 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.477810 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.477790 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 21:29:48.480061 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.480043 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 21:29:48.480816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.480803 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mfxfr\"" Jul 23 21:29:48.481026 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.481011 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.481110 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.481088 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 21:29:48.481174 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.481123 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.486700 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.486633 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f"] Jul 23 21:29:48.487933 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.487910 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ppfbn"] Jul 23 21:29:48.488903 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.488882 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7"] Jul 23 21:29:48.512754 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-config\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.512866 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512768 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9q5z\" (UniqueName: \"kubernetes.io/projected/21d4c78f-0e47-4711-a384-804ba27f42c5-kube-api-access-c9q5z\") pod \"network-check-source-7bc5b6bf85-hjg8f\" (UID: \"21d4c78f-0e47-4711-a384-804ba27f42c5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" Jul 23 21:29:48.512866 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3278619c-e21d-4b61-b93f-29347c59da27-serving-cert\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.512866 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6vpg\" (UniqueName: \"kubernetes.io/projected/64d08acf-af16-4a1c-9158-20747578bc85-kube-api-access-d6vpg\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.512987 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512873 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64d08acf-af16-4a1c-9158-20747578bc85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.512987 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512944 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6tn\" (UniqueName: \"kubernetes.io/projected/3278619c-e21d-4b61-b93f-29347c59da27-kube-api-access-zl6tn\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.512987 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64d08acf-af16-4a1c-9158-20747578bc85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.513093 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.512996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-trusted-ca\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.562709 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.562684 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz"] Jul 23 21:29:48.564435 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.564411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.566691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.566670 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b98bc9bd8-8qf2h"] Jul 23 21:29:48.567601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.567581 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dk4v6\"" Jul 23 21:29:48.568512 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.568494 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.569481 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.569457 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 23 21:29:48.569481 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.569463 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.569607 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.569508 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.569607 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.569484 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 23 21:29:48.571626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571567 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 23 21:29:48.571626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571590 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5cbhp\"" Jul 23 21:29:48.571916 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571897 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.571999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571939 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 23 21:29:48.571999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571961 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 23 21:29:48.572139 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.571900 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.572139 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.572105 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 23 21:29:48.582938 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.582917 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz"] Jul 23 21:29:48.585743 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.585722 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b98bc9bd8-8qf2h"] Jul 23 21:29:48.614039 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614009 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-trusted-ca\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.614133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-default-certificate\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.614133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9vw\" (UniqueName: \"kubernetes.io/projected/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-kube-api-access-8x9vw\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.614230 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-config\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.614230 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9q5z\" (UniqueName: \"kubernetes.io/projected/21d4c78f-0e47-4711-a384-804ba27f42c5-kube-api-access-c9q5z\") pod \"network-check-source-7bc5b6bf85-hjg8f\" (UID: \"21d4c78f-0e47-4711-a384-804ba27f42c5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" Jul 23 21:29:48.614314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3278619c-e21d-4b61-b93f-29347c59da27-serving-cert\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.614314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614273 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vpg\" (UniqueName: \"kubernetes.io/projected/64d08acf-af16-4a1c-9158-20747578bc85-kube-api-access-d6vpg\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.614314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-stats-auth\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.614456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614322 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.614456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614344 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.614456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614366 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.614456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614393 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l45wv\" (UniqueName: \"kubernetes.io/projected/1efd1344-252e-49b2-8894-d6bb533078a7-kube-api-access-l45wv\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.614456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614416 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64d08acf-af16-4a1c-9158-20747578bc85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.614625 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614489 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6tn\" (UniqueName: \"kubernetes.io/projected/3278619c-e21d-4b61-b93f-29347c59da27-kube-api-access-zl6tn\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.614625 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614521 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64d08acf-af16-4a1c-9158-20747578bc85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.614625 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.614556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.615108 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.615063 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-trusted-ca\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.615262 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.615236 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64d08acf-af16-4a1c-9158-20747578bc85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.615561 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.615499 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3278619c-e21d-4b61-b93f-29347c59da27-config\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.616897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.616872 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64d08acf-af16-4a1c-9158-20747578bc85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.617139 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.617123 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3278619c-e21d-4b61-b93f-29347c59da27-serving-cert\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.627732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.627705 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6vpg\" (UniqueName: \"kubernetes.io/projected/64d08acf-af16-4a1c-9158-20747578bc85-kube-api-access-d6vpg\") pod \"kube-storage-version-migrator-operator-7658d9b749-24fh7\" (UID: \"64d08acf-af16-4a1c-9158-20747578bc85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.628133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.628065 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6tn\" (UniqueName: \"kubernetes.io/projected/3278619c-e21d-4b61-b93f-29347c59da27-kube-api-access-zl6tn\") pod \"console-operator-565b7b569d-ppfbn\" (UID: \"3278619c-e21d-4b61-b93f-29347c59da27\") " pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.628250 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.628231 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9q5z\" (UniqueName: \"kubernetes.io/projected/21d4c78f-0e47-4711-a384-804ba27f42c5-kube-api-access-c9q5z\") pod \"network-check-source-7bc5b6bf85-hjg8f\" (UID: \"21d4c78f-0e47-4711-a384-804ba27f42c5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" Jul 23 21:29:48.715330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-stats-auth\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.715330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715278 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.715330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.715330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l45wv\" (UniqueName: \"kubernetes.io/projected/1efd1344-252e-49b2-8894-d6bb533078a7-kube-api-access-l45wv\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:48.715397 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:48.715421 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:48.715466 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:49.215443877 +0000 UTC m=+226.732338914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : secret "router-metrics-certs-default" not found Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715401 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:48.715487 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:49.215475267 +0000 UTC m=+226.732370305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:48.715540 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:49.215512995 +0000 UTC m=+226.732408039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-default-certificate\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.715638 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.715621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9vw\" (UniqueName: \"kubernetes.io/projected/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-kube-api-access-8x9vw\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.716112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.716063 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.717929 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.717906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-stats-auth\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.718021 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.717936 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-default-certificate\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.723697 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.723675 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45wv\" (UniqueName: \"kubernetes.io/projected/1efd1344-252e-49b2-8894-d6bb533078a7-kube-api-access-l45wv\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:48.723790 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.723722 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9vw\" (UniqueName: \"kubernetes.io/projected/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-kube-api-access-8x9vw\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:48.773864 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.773829 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" Jul 23 21:29:48.780687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.780667 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:48.786483 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.786465 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" Jul 23 21:29:48.912438 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.912409 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f"] Jul 23 21:29:48.916541 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:29:48.916514 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d4c78f_0e47_4711_a384_804ba27f42c5.slice/crio-057dfd18e13604f68f0d73177fe50467fd994cf31c8e2a3ffadd0034b5ea8b3c WatchSource:0}: Error finding container 057dfd18e13604f68f0d73177fe50467fd994cf31c8e2a3ffadd0034b5ea8b3c: Status 404 returned error can't find the container with id 057dfd18e13604f68f0d73177fe50467fd994cf31c8e2a3ffadd0034b5ea8b3c Jul 23 21:29:48.926284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.926259 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ppfbn"] Jul 23 21:29:48.929014 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:29:48.928977 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3278619c_e21d_4b61_b93f_29347c59da27.slice/crio-937e922ff948a59b7156250b5e09db561984b83c03d9773c5b985bd780ff8ccb WatchSource:0}: Error finding container 937e922ff948a59b7156250b5e09db561984b83c03d9773c5b985bd780ff8ccb: Status 404 returned error can't find the container with id 937e922ff948a59b7156250b5e09db561984b83c03d9773c5b985bd780ff8ccb Jul 23 21:29:48.945589 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:48.945563 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7"] Jul 23 21:29:48.966121 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:29:48.966033 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d08acf_af16_4a1c_9158_20747578bc85.slice/crio-944367b749007cd65a441d2986690e47888de3c32ccdb39d9d044bb521518307 WatchSource:0}: Error finding container 944367b749007cd65a441d2986690e47888de3c32ccdb39d9d044bb521518307: Status 404 returned error can't find the container with id 944367b749007cd65a441d2986690e47888de3c32ccdb39d9d044bb521518307 Jul 23 21:29:49.219132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.219023 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:49.219132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.219130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.219157 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:49.219189 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:50.219172996 +0000 UTC m=+227.736068034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:49.219256 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:49.219267 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:49.219310 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:50.219295748 +0000 UTC m=+227.736190799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:49.219363 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:49.219329 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:50.219318915 +0000 UTC m=+227.736213952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : secret "router-metrics-certs-default" not found Jul 23 21:29:49.726865 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.726827 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" event={"ID":"64d08acf-af16-4a1c-9158-20747578bc85","Type":"ContainerStarted","Data":"944367b749007cd65a441d2986690e47888de3c32ccdb39d9d044bb521518307"} Jul 23 21:29:49.728214 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.728185 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" event={"ID":"3278619c-e21d-4b61-b93f-29347c59da27","Type":"ContainerStarted","Data":"937e922ff948a59b7156250b5e09db561984b83c03d9773c5b985bd780ff8ccb"} Jul 23 21:29:49.730951 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.730427 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" event={"ID":"21d4c78f-0e47-4711-a384-804ba27f42c5","Type":"ContainerStarted","Data":"455a0d49b4506c5629f2fb32b9a2f1c353065c49912a6019bf47b75f2d1a5400"} Jul 23 21:29:49.730951 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.730475 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" event={"ID":"21d4c78f-0e47-4711-a384-804ba27f42c5","Type":"ContainerStarted","Data":"057dfd18e13604f68f0d73177fe50467fd994cf31c8e2a3ffadd0034b5ea8b3c"} Jul 23 21:29:49.746950 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:49.746900 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hjg8f" podStartSLOduration=1.746881935 podStartE2EDuration="1.746881935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:49.745712273 +0000 UTC m=+227.262607342" watchObservedRunningTime="2026-07-23 21:29:49.746881935 +0000 UTC m=+227.263776996" Jul 23 21:29:50.231045 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:50.231004 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:50.231244 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:50.231052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:50.231244 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:50.231119 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:50.231244 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:50.231201 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 21:29:50.231402 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:50.231247 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:50.231402 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:50.231258 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:52.231240703 +0000 UTC m=+229.748135757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:29:50.231402 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:50.231317 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:52.231298308 +0000 UTC m=+229.748193349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : secret "router-metrics-certs-default" not found Jul 23 21:29:50.231402 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:50.231332 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:52.231323033 +0000 UTC m=+229.748218075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:51.738199 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.738108 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" event={"ID":"64d08acf-af16-4a1c-9158-20747578bc85","Type":"ContainerStarted","Data":"a7227e548b334d1fdd386d5db79eb7f3d70b05005dc230ddbf6318356e9a594e"} Jul 23 21:29:51.739737 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.739717 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/0.log" Jul 23 21:29:51.739831 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.739771 2569 generic.go:356] "Generic (PLEG): container finished" podID="3278619c-e21d-4b61-b93f-29347c59da27" containerID="c96b9fec248d664cc7fcba139b5b8676b63b8950ef1384717b6b1c80c66ac303" exitCode=255 Jul 23 21:29:51.739831 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.739811 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" event={"ID":"3278619c-e21d-4b61-b93f-29347c59da27","Type":"ContainerDied","Data":"c96b9fec248d664cc7fcba139b5b8676b63b8950ef1384717b6b1c80c66ac303"} Jul 23 21:29:51.739980 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.739965 2569 scope.go:117] "RemoveContainer" containerID="c96b9fec248d664cc7fcba139b5b8676b63b8950ef1384717b6b1c80c66ac303" Jul 23 21:29:51.757448 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:51.757399 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" podStartSLOduration=1.240080236 podStartE2EDuration="3.757380063s" totalImagesPullingTime="2.517299827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:51.756611671 +0000 UTC m=+229.273506731" watchObservedRunningTime="2026-07-23 21:29:51.757380063 +0000 UTC m=+229.274275123" Jul 23 21:29:52.248192 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.248161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:52.248374 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.248224 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:52.248374 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.248242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:52.248374 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.248319 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 21:29:52.248374 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.248320 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.248304165 +0000 UTC m=+233.765199202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:29:52.248593 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.248380 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.248367759 +0000 UTC m=+233.765262796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : secret "router-metrics-certs-default" not found Jul 23 21:29:52.248593 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.248320 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:52.248593 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.248408 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.248402555 +0000 UTC m=+233.765297593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:52.744145 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744055 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:29:52.744530 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744513 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/0.log" Jul 23 21:29:52.744577 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744557 2569 generic.go:356] "Generic (PLEG): container finished" podID="3278619c-e21d-4b61-b93f-29347c59da27" containerID="964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26" exitCode=255 Jul 23 21:29:52.744624 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744593 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" event={"ID":"3278619c-e21d-4b61-b93f-29347c59da27","Type":"ContainerDied","Data":"964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26"} Jul 23 21:29:52.744691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744679 2569 scope.go:117] "RemoveContainer" containerID="c96b9fec248d664cc7fcba139b5b8676b63b8950ef1384717b6b1c80c66ac303" Jul 23 21:29:52.744900 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:52.744880 2569 scope.go:117] "RemoveContainer" containerID="964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26" Jul 23 21:29:52.745107 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:52.745065 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ppfbn_openshift-console-operator(3278619c-e21d-4b61-b93f-29347c59da27)\"" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" podUID="3278619c-e21d-4b61-b93f-29347c59da27" Jul 23 21:29:53.145389 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.145352 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fgght"] Jul 23 21:29:53.148037 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.148015 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.150765 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.150743 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 21:29:53.150883 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.150776 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 21:29:53.150883 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.150747 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 21:29:53.150883 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.150789 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l265n\"" Jul 23 21:29:53.151035 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.150792 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 21:29:53.157647 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.157619 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fgght"] Jul 23 21:29:53.255149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.255118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/713c6710-f99d-472c-8ab6-9e12d72ab651-data-volume\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.255149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.255147 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/713c6710-f99d-472c-8ab6-9e12d72ab651-crio-socket\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.255369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.255192 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.255369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.255302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.255369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.255341 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wh8\" (UniqueName: \"kubernetes.io/projected/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-api-access-56wh8\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.355952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.355909 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.355952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.355959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wh8\" (UniqueName: \"kubernetes.io/projected/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-api-access-56wh8\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.355983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/713c6710-f99d-472c-8ab6-9e12d72ab651-data-volume\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.356003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/713c6710-f99d-472c-8ab6-9e12d72ab651-crio-socket\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356149 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.356031 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.356149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.356066 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/713c6710-f99d-472c-8ab6-9e12d72ab651-crio-socket\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356149 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.356139 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.856118223 +0000 UTC m=+231.373013260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.356343 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.356206 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356343 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.356285 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/713c6710-f99d-472c-8ab6-9e12d72ab651-data-volume\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.356343 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.356328 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.356462 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.356394 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.85638349 +0000 UTC m=+231.373278526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.365768 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.365750 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wh8\" (UniqueName: \"kubernetes.io/projected/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-api-access-56wh8\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.749354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.749326 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:29:53.749727 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.749632 2569 scope.go:117] "RemoveContainer" containerID="964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26" Jul 23 21:29:53.749787 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.749770 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ppfbn_openshift-console-operator(3278619c-e21d-4b61-b93f-29347c59da27)\"" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" podUID="3278619c-e21d-4b61-b93f-29347c59da27" Jul 23 21:29:53.860914 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.860864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.861613 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:53.860993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:53.861613 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.861439 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.861613 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.861511 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.861613 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.861540 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.861505688 +0000 UTC m=+232.378400726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.861613 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:53.861580 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.861554958 +0000 UTC m=+232.378450012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.809407 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.809377 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-j5256"] Jul 23 21:29:54.811324 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.811309 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.814029 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.814008 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 23 21:29:54.814029 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.814018 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5xwfj\"" Jul 23 21:29:54.814216 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.814015 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 23 21:29:54.815300 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.815281 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 23 21:29:54.815395 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.815281 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 23 21:29:54.822245 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.822223 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-j5256"] Jul 23 21:29:54.868671 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.868640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qnn\" (UniqueName: \"kubernetes.io/projected/15358358-1e15-49ca-a5c8-a04a2a351e9d-kube-api-access-f4qnn\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.868785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.868678 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-cabundle\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.868785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.868751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:54.868855 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.868821 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-key\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.868888 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:54.868823 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.868916 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.868885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:54.868947 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:54.868938 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.868919451 +0000 UTC m=+234.385814491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.868996 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:54.868965 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:54.869044 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:54.869033 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.869020678 +0000 UTC m=+234.385915718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : configmap "kube-rbac-proxy" not found Jul 23 21:29:54.933593 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.933573 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxdkv_61017217-5c58-404f-9156-7f84d6582f73/dns-node-resolver/0.log" Jul 23 21:29:54.969483 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.969461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-key\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.969554 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.969543 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qnn\" (UniqueName: \"kubernetes.io/projected/15358358-1e15-49ca-a5c8-a04a2a351e9d-kube-api-access-f4qnn\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.969612 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.969581 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-cabundle\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.970276 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.970256 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-cabundle\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.971911 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.971896 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15358358-1e15-49ca-a5c8-a04a2a351e9d-signing-key\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:54.977297 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:54.977278 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qnn\" (UniqueName: \"kubernetes.io/projected/15358358-1e15-49ca-a5c8-a04a2a351e9d-kube-api-access-f4qnn\") pod \"service-ca-58598695f7-j5256\" (UID: \"15358358-1e15-49ca-a5c8-a04a2a351e9d\") " pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:55.120738 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:55.120667 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-j5256" Jul 23 21:29:55.238804 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:55.238777 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-j5256"] Jul 23 21:29:55.242020 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:29:55.241996 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15358358_1e15_49ca_a5c8_a04a2a351e9d.slice/crio-576dfdfe8a7724552a0d0d390b1ae2d90928f73414425ada02c8b8f1a1922c89 WatchSource:0}: Error finding container 576dfdfe8a7724552a0d0d390b1ae2d90928f73414425ada02c8b8f1a1922c89: Status 404 returned error can't find the container with id 576dfdfe8a7724552a0d0d390b1ae2d90928f73414425ada02c8b8f1a1922c89 Jul 23 21:29:55.755452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:55.755417 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-j5256" event={"ID":"15358358-1e15-49ca-a5c8-a04a2a351e9d","Type":"ContainerStarted","Data":"576dfdfe8a7724552a0d0d390b1ae2d90928f73414425ada02c8b8f1a1922c89"} Jul 23 21:29:55.935172 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:55.935142 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qn96_c5363779-23fc-49b7-bf64-caf7c771214c/node-ca/0.log" Jul 23 21:29:56.280397 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.280364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:29:56.280570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.280448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:56.280570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.280496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:29:56.280570 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.280529 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:56.280735 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.280612 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:04.280590765 +0000 UTC m=+241.797485825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:29:56.280735 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.280620 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 21:29:56.280735 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.280631 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:04.280622428 +0000 UTC m=+241.797517470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:29:56.280735 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.280664 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:04.280649634 +0000 UTC m=+241.797544670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : secret "router-metrics-certs-default" not found Jul 23 21:29:56.886132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.886101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:56.886338 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.886223 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:29:56.886338 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.886250 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:56.886338 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.886334 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.886310914 +0000 UTC m=+238.403205963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : configmap "kube-rbac-proxy" not found Jul 23 21:29:56.886500 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.886366 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:56.886500 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:56.886421 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.886407071 +0000 UTC m=+238.403302123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:56.933421 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:56.933383 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jd6dq_793b7480-eba1-4622-b1bd-149a01f96a41/serve-healthcheck-canary/0.log" Jul 23 21:29:57.763845 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:57.763812 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-j5256" event={"ID":"15358358-1e15-49ca-a5c8-a04a2a351e9d","Type":"ContainerStarted","Data":"67cef09b3e7bac5fea0b97a2171760c8f43c2183929652f0571a5ba45ea3baf7"} Jul 23 21:29:57.780284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:57.780237 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-j5256" podStartSLOduration=1.8940068810000001 podStartE2EDuration="3.780222249s" totalImagesPullingTime="1.886215368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:57.778340757 +0000 UTC m=+235.295235837" watchObservedRunningTime="2026-07-23 21:29:57.780222249 +0000 UTC m=+235.297117334" Jul 23 21:29:58.781246 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:58.781221 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:58.781690 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:58.781291 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:29:58.781690 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:29:58.781559 2569 scope.go:117] "RemoveContainer" containerID="964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26" Jul 23 21:29:58.781789 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:29:58.781686 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ppfbn_openshift-console-operator(3278619c-e21d-4b61-b93f-29347c59da27)\"" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" podUID="3278619c-e21d-4b61-b93f-29347c59da27" Jul 23 21:30:00.920629 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:00.920594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:00.920992 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:00.920659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:00.920992 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:00.920720 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:30:00.920992 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:00.920737 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:30:00.920992 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:00.920771 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.920756648 +0000 UTC m=+246.437651686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : configmap "kube-rbac-proxy" not found Jul 23 21:30:00.920992 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:00.920788 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls podName:713c6710-f99d-472c-8ab6-9e12d72ab651 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.920775367 +0000 UTC m=+246.437670406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fgght" (UID: "713c6710-f99d-472c-8ab6-9e12d72ab651") : secret "insights-runtime-extractor-tls" not found Jul 23 21:30:04.350047 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:04.350005 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:30:04.350525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:04.350110 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:04.350525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:04.350158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:04.350525 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:04.350162 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 21:30:04.350525 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:04.350220 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls podName:112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:20.350205616 +0000 UTC m=+257.867100653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-bfkxz" (UID: "112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1") : secret "cluster-monitoring-operator-tls" not found Jul 23 21:30:04.350525 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:04.350270 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle podName:1efd1344-252e-49b2-8894-d6bb533078a7 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:20.350249899 +0000 UTC m=+257.867144936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle") pod "router-default-b98bc9bd8-8qf2h" (UID: "1efd1344-252e-49b2-8894-d6bb533078a7") : configmap references non-existent config key: service-ca.crt Jul 23 21:30:04.352611 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:04.352589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1efd1344-252e-49b2-8894-d6bb533078a7-metrics-certs\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:08.984289 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:08.984256 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:08.984748 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:08.984320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:08.984907 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:08.984885 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/713c6710-f99d-472c-8ab6-9e12d72ab651-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:08.986646 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:08.986629 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/713c6710-f99d-472c-8ab6-9e12d72ab651-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgght\" (UID: \"713c6710-f99d-472c-8ab6-9e12d72ab651\") " pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:09.059519 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:09.059486 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l265n\"" Jul 23 21:30:09.067572 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:09.067549 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fgght" Jul 23 21:30:09.194284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:09.194241 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fgght"] Jul 23 21:30:09.198031 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:09.198001 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713c6710_f99d_472c_8ab6_9e12d72ab651.slice/crio-22a0606d95539fd20fd37fcdb90735c0509b07bbd1be6c624d10a86f5618c514 WatchSource:0}: Error finding container 22a0606d95539fd20fd37fcdb90735c0509b07bbd1be6c624d10a86f5618c514: Status 404 returned error can't find the container with id 22a0606d95539fd20fd37fcdb90735c0509b07bbd1be6c624d10a86f5618c514 Jul 23 21:30:09.803879 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:09.803834 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgght" event={"ID":"713c6710-f99d-472c-8ab6-9e12d72ab651","Type":"ContainerStarted","Data":"22a0606d95539fd20fd37fcdb90735c0509b07bbd1be6c624d10a86f5618c514"} Jul 23 21:30:13.072451 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:13.072381 2569 scope.go:117] "RemoveContainer" containerID="964357e7bd33ca0e4598cfc25fc2f2d0e83a7ce8c0115ceb4aa27d59404adc26" Jul 23 21:30:14.736906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.736870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:30:14.739872 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.739774 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d7f64d-333d-403e-816b-11a767b1ba2f-metrics-certs\") pod \"network-metrics-daemon-67t9z\" (UID: \"b7d7f64d-333d-403e-816b-11a767b1ba2f\") " pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:30:14.822415 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.822374 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgght" event={"ID":"713c6710-f99d-472c-8ab6-9e12d72ab651","Type":"ContainerStarted","Data":"b391a01904a188d3c3f230c84981ffd23447c5a6a85065824c3011232159cc77"} Jul 23 21:30:14.824613 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.824424 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:30:14.824613 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.824487 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" event={"ID":"3278619c-e21d-4b61-b93f-29347c59da27","Type":"ContainerStarted","Data":"f69f454b9347a5c50b6bfd18ead0bf9ade8923423281c9f4ecf487a4ff8360e0"} Jul 23 21:30:14.825098 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.825035 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:30:14.843491 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.843432 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" podStartSLOduration=24.290506805 podStartE2EDuration="26.843413233s" totalImagesPullingTime="2.552906428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:14.841249307 +0000 UTC m=+252.358144392" watchObservedRunningTime="2026-07-23 21:30:14.843413233 +0000 UTC m=+252.360308287" Jul 23 21:30:14.847871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.847844 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-ppfbn" Jul 23 21:30:14.872771 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.872550 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:30:14.883391 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:14.882035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67t9z" Jul 23 21:30:15.050295 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:15.050263 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-67t9z"] Jul 23 21:30:15.054524 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:15.054490 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d7f64d_333d_403e_816b_11a767b1ba2f.slice/crio-21b9c9a901f376f7a6e4b184f8f0e4a1822482b43a6df809bf77de1d8471daf9 WatchSource:0}: Error finding container 21b9c9a901f376f7a6e4b184f8f0e4a1822482b43a6df809bf77de1d8471daf9: Status 404 returned error can't find the container with id 21b9c9a901f376f7a6e4b184f8f0e4a1822482b43a6df809bf77de1d8471daf9 Jul 23 21:30:15.829495 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:15.829463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67t9z" event={"ID":"b7d7f64d-333d-403e-816b-11a767b1ba2f","Type":"ContainerStarted","Data":"21b9c9a901f376f7a6e4b184f8f0e4a1822482b43a6df809bf77de1d8471daf9"} Jul 23 21:30:16.642943 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.642909 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-56bsk"] Jul 23 21:30:16.656937 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.656913 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:16.657128 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.657106 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-56bsk"] Jul 23 21:30:16.659902 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.659807 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 21:30:16.660041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.659912 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9fllb\"" Jul 23 21:30:16.660468 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.660192 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 21:30:16.757792 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.757747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5sgf\" (UniqueName: \"kubernetes.io/projected/455d1fd7-23a7-4f0e-a923-3a569e285da6-kube-api-access-k5sgf\") pod \"downloads-5bc67dcd46-56bsk\" (UID: \"455d1fd7-23a7-4f0e-a923-3a569e285da6\") " pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:16.859148 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.859106 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5sgf\" (UniqueName: \"kubernetes.io/projected/455d1fd7-23a7-4f0e-a923-3a569e285da6-kube-api-access-k5sgf\") pod \"downloads-5bc67dcd46-56bsk\" (UID: \"455d1fd7-23a7-4f0e-a923-3a569e285da6\") " pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:16.869665 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.869635 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5sgf\" (UniqueName: \"kubernetes.io/projected/455d1fd7-23a7-4f0e-a923-3a569e285da6-kube-api-access-k5sgf\") pod \"downloads-5bc67dcd46-56bsk\" (UID: \"455d1fd7-23a7-4f0e-a923-3a569e285da6\") " pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:16.968310 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:16.968237 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:18.080030 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.079993 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-56bsk"] Jul 23 21:30:18.084007 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:18.083973 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455d1fd7_23a7_4f0e_a923_3a569e285da6.slice/crio-7a86c4b8a26875242372f54c61ffea8b4d47934b786f5e12356d3145ea11e78d WatchSource:0}: Error finding container 7a86c4b8a26875242372f54c61ffea8b4d47934b786f5e12356d3145ea11e78d: Status 404 returned error can't find the container with id 7a86c4b8a26875242372f54c61ffea8b4d47934b786f5e12356d3145ea11e78d Jul 23 21:30:18.844557 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.844479 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgght" event={"ID":"713c6710-f99d-472c-8ab6-9e12d72ab651","Type":"ContainerStarted","Data":"284f28eb14faada63a1ab936f36c9b13af324e1f27eea1b51c2ae09f5c827a10"} Jul 23 21:30:18.846977 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.846765 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67t9z" event={"ID":"b7d7f64d-333d-403e-816b-11a767b1ba2f","Type":"ContainerStarted","Data":"1919fe5c37ad64a5cfe7fca69b9967044958fcd6f750ca829886ff8c6ca1d26b"} Jul 23 21:30:18.846977 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.846811 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67t9z" event={"ID":"b7d7f64d-333d-403e-816b-11a767b1ba2f","Type":"ContainerStarted","Data":"727e78b20e8f1a1e3d0d149a70bdabce73c4ad5008fc5183a93687a3ca988a55"} Jul 23 21:30:18.848157 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.848123 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-56bsk" event={"ID":"455d1fd7-23a7-4f0e-a923-3a569e285da6","Type":"ContainerStarted","Data":"7a86c4b8a26875242372f54c61ffea8b4d47934b786f5e12356d3145ea11e78d"} Jul 23 21:30:18.862904 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:18.862856 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-67t9z" podStartSLOduration=252.978674879 podStartE2EDuration="4m15.862839408s" totalImagesPullingTime="2.884164529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:18.862572844 +0000 UTC m=+256.379467917" watchObservedRunningTime="2026-07-23 21:30:18.862839408 +0000 UTC m=+256.379734485" Jul 23 21:30:20.388057 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.388014 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:30:20.388681 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.388130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:20.388860 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.388801 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1efd1344-252e-49b2-8894-d6bb533078a7-service-ca-bundle\") pod \"router-default-b98bc9bd8-8qf2h\" (UID: \"1efd1344-252e-49b2-8894-d6bb533078a7\") " pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:20.391091 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.391053 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-bfkxz\" (UID: \"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:30:20.677759 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.677603 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dk4v6\"" Jul 23 21:30:20.682138 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.682059 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5cbhp\"" Jul 23 21:30:20.685118 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.685089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" Jul 23 21:30:20.690447 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:20.690418 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:22.030617 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.030590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b98bc9bd8-8qf2h"] Jul 23 21:30:22.032914 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:22.032886 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efd1344_252e_49b2_8894_d6bb533078a7.slice/crio-186af590c94197360bb96eaf68d77d574d14de15cb3224ddb8dd010ff05efc16 WatchSource:0}: Error finding container 186af590c94197360bb96eaf68d77d574d14de15cb3224ddb8dd010ff05efc16: Status 404 returned error can't find the container with id 186af590c94197360bb96eaf68d77d574d14de15cb3224ddb8dd010ff05efc16 Jul 23 21:30:22.046335 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.046310 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz"] Jul 23 21:30:22.048754 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:22.048728 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112b6c2f_e3f9_4c4d_ba6a_baca6a0625e1.slice/crio-1e2845e892196c8c337f9517874e1a7aa01f4d7394d3a7990003154cf69e2e8a WatchSource:0}: Error finding container 1e2845e892196c8c337f9517874e1a7aa01f4d7394d3a7990003154cf69e2e8a: Status 404 returned error can't find the container with id 1e2845e892196c8c337f9517874e1a7aa01f4d7394d3a7990003154cf69e2e8a Jul 23 21:30:22.867029 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.866859 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" event={"ID":"1efd1344-252e-49b2-8894-d6bb533078a7","Type":"ContainerStarted","Data":"a67d63a907c848331b12e932d2b812321ae7313f60e82bcc2d52b7ef6b650b3b"} Jul 23 21:30:22.867029 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.866923 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" event={"ID":"1efd1344-252e-49b2-8894-d6bb533078a7","Type":"ContainerStarted","Data":"186af590c94197360bb96eaf68d77d574d14de15cb3224ddb8dd010ff05efc16"} Jul 23 21:30:22.870254 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.870110 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgght" event={"ID":"713c6710-f99d-472c-8ab6-9e12d72ab651","Type":"ContainerStarted","Data":"245e4f04ac9fa109ab3b80c165d2da48bdab0309d5750902b9e770fd6b5bfd3c"} Jul 23 21:30:22.871700 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.871671 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" event={"ID":"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1","Type":"ContainerStarted","Data":"1e2845e892196c8c337f9517874e1a7aa01f4d7394d3a7990003154cf69e2e8a"} Jul 23 21:30:22.887675 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.887629 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" podStartSLOduration=34.887615772 podStartE2EDuration="34.887615772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:22.886768761 +0000 UTC m=+260.403663819" watchObservedRunningTime="2026-07-23 21:30:22.887615772 +0000 UTC m=+260.404510830" Jul 23 21:30:22.906117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:22.906053 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fgght" podStartSLOduration=17.281602328 podStartE2EDuration="29.906036012s" totalImagesPullingTime="12.624433684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:29:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:22.905561886 +0000 UTC m=+260.422456958" watchObservedRunningTime="2026-07-23 21:30:22.906036012 +0000 UTC m=+260.422931069" Jul 23 21:30:23.691226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:23.691189 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:23.694352 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:23.694325 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:23.877026 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:23.876603 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:23.877814 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:23.877790 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b98bc9bd8-8qf2h" Jul 23 21:30:24.455135 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.455100 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6"] Jul 23 21:30:24.458284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.458262 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:24.461223 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.461002 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 21:30:24.461223 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.461020 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qlsnr\"" Jul 23 21:30:24.467007 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.466633 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6"] Jul 23 21:30:24.525752 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.525726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xstt6\" (UID: \"e243b107-bebf-45a9-9d35-4dbe631f9447\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:24.626402 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.626364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xstt6\" (UID: \"e243b107-bebf-45a9-9d35-4dbe631f9447\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:24.626582 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:24.626508 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 21:30:24.626582 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:24.626578 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates podName:e243b107-bebf-45a9-9d35-4dbe631f9447 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:25.126556198 +0000 UTC m=+262.643451258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-xstt6" (UID: "e243b107-bebf-45a9-9d35-4dbe631f9447") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 21:30:24.888626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.888593 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" event={"ID":"112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1","Type":"ContainerStarted","Data":"b883ca6fe1db1c157f28a5492343df9fa3fcd892007680a1963e61d3b4fac06c"} Jul 23 21:30:24.905042 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:24.904985 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-bfkxz" podStartSLOduration=35.009869529 podStartE2EDuration="36.904968892s" totalImagesPullingTime="1.895099363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:24.904280908 +0000 UTC m=+262.421175992" watchObservedRunningTime="2026-07-23 21:30:24.904968892 +0000 UTC m=+262.421863950" Jul 23 21:30:25.130642 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:25.130598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xstt6\" (UID: \"e243b107-bebf-45a9-9d35-4dbe631f9447\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:25.133535 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:25.133504 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e243b107-bebf-45a9-9d35-4dbe631f9447-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xstt6\" (UID: \"e243b107-bebf-45a9-9d35-4dbe631f9447\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:25.369184 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:25.369154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:25.510906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:25.510862 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6"] Jul 23 21:30:25.513804 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:25.513777 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode243b107_bebf_45a9_9d35_4dbe631f9447.slice/crio-09330fe26916d96c61eb813b88f59f1fbd56cd7d8e7093f9c5b7f112db2df0f6 WatchSource:0}: Error finding container 09330fe26916d96c61eb813b88f59f1fbd56cd7d8e7093f9c5b7f112db2df0f6: Status 404 returned error can't find the container with id 09330fe26916d96c61eb813b88f59f1fbd56cd7d8e7093f9c5b7f112db2df0f6 Jul 23 21:30:25.893620 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:25.893582 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" event={"ID":"e243b107-bebf-45a9-9d35-4dbe631f9447","Type":"ContainerStarted","Data":"09330fe26916d96c61eb813b88f59f1fbd56cd7d8e7093f9c5b7f112db2df0f6"} Jul 23 21:30:26.899527 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.899471 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" event={"ID":"e243b107-bebf-45a9-9d35-4dbe631f9447","Type":"ContainerStarted","Data":"5824ca78a7d1a3a04b05eddf46756239f7232817e82b567b5051794443da6bf0"} Jul 23 21:30:26.899968 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.899685 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:26.905293 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.905267 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" Jul 23 21:30:26.932178 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.932057 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xstt6" podStartSLOduration=1.770154993 podStartE2EDuration="2.932041501s" totalImagesPullingTime="1.161886508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:26.913966002 +0000 UTC m=+264.430861062" watchObservedRunningTime="2026-07-23 21:30:26.932041501 +0000 UTC m=+264.448936564" Jul 23 21:30:26.959477 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.957387 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:30:26.963407 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.962835 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:30:26.963407 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.962944 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:26.966651 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.966288 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p6r62\"" Jul 23 21:30:26.966651 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.966527 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 21:30:26.968023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.967009 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 21:30:26.968023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.967256 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 21:30:26.968023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.967370 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 21:30:26.968317 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:26.968121 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 21:30:27.056360 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056328 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.056360 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.056574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.056574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056539 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.056574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056564 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpxsb\" (UniqueName: \"kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.056780 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.056602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157150 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157113 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157322 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157322 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157229 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157322 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.157502 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.157420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpxsb\" (UniqueName: \"kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.158034 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.158005 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.158237 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.158010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.158316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.158296 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.160239 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.160211 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.160691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.160672 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.165991 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.165969 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpxsb\" (UniqueName: \"kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb\") pod \"console-6f897cb67c-v96h2\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.275915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.275885 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:27.420105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.420058 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:30:27.422576 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:27.422551 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265c7efb_3f59_4b41_86a1_3a7128ed1e19.slice/crio-ffca865be6f40ebba7b2b0d1648b57494bd5efc4db9999f678873055cb671ad4 WatchSource:0}: Error finding container ffca865be6f40ebba7b2b0d1648b57494bd5efc4db9999f678873055cb671ad4: Status 404 returned error can't find the container with id ffca865be6f40ebba7b2b0d1648b57494bd5efc4db9999f678873055cb671ad4 Jul 23 21:30:27.904601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:27.904560 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f897cb67c-v96h2" event={"ID":"265c7efb-3f59-4b41-86a1-3a7128ed1e19","Type":"ContainerStarted","Data":"ffca865be6f40ebba7b2b0d1648b57494bd5efc4db9999f678873055cb671ad4"} Jul 23 21:30:31.873024 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.872991 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78578"] Jul 23 21:30:31.878380 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.878343 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.884059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.883394 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 21:30:31.884059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.883616 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ztrrh\"" Jul 23 21:30:31.884059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.883790 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 21:30:31.884059 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.883832 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 21:30:31.890112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.890049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.890237 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.890217 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.890618 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.890557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3aa517d-aa1d-413a-82cc-16c3b1449a74-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.891000 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.890937 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m25s\" (UniqueName: \"kubernetes.io/projected/e3aa517d-aa1d-413a-82cc-16c3b1449a74-kube-api-access-2m25s\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.894133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.894096 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78578"] Jul 23 21:30:31.894668 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.894173 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5g66p"] Jul 23 21:30:31.897770 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.897749 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.901200 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.901181 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-6b5x8"] Jul 23 21:30:31.901571 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.901548 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tbsf8\"" Jul 23 21:30:31.901678 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.901599 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 21:30:31.901737 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.901548 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 21:30:31.904130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.903927 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 21:30:31.905773 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.905753 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.910560 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.910527 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xk6fc\"" Jul 23 21:30:31.910695 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.910668 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 21:30:31.910785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.910766 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 21:30:31.910865 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.910851 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 21:30:31.921568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.921547 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-6b5x8"] Jul 23 21:30:31.991651 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991614 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-textfile\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.991802 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-tls\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.991802 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991720 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/726aca89-eea9-4006-9501-93f60d7d9444-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.991802 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991756 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.991802 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrqr\" (UniqueName: \"kubernetes.io/projected/726aca89-eea9-4006-9501-93f60d7d9444-kube-api-access-bjrqr\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.992005 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-metrics-client-ca\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992005 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992005 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-sys\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992005 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.992005 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.991981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3aa517d-aa1d-413a-82cc-16c3b1449a74-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m25s\" (UniqueName: \"kubernetes.io/projected/e3aa517d-aa1d-413a-82cc-16c3b1449a74-kube-api-access-2m25s\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992124 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-wtmp\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992177 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-root\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992232 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdprs\" (UniqueName: \"kubernetes.io/projected/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-kube-api-access-mdprs\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:31.992715 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:31.992394 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 21:30:31.992715 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:31.992463 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls podName:e3aa517d-aa1d-413a-82cc-16c3b1449a74 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:32.492441295 +0000 UTC m=+270.009336332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-78578" (UID: "e3aa517d-aa1d-413a-82cc-16c3b1449a74") : secret "openshift-state-metrics-tls" not found Jul 23 21:30:31.992971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.992945 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3aa517d-aa1d-413a-82cc-16c3b1449a74-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:31.995366 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:31.995327 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:32.004817 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.004780 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m25s\" (UniqueName: \"kubernetes.io/projected/e3aa517d-aa1d-413a-82cc-16c3b1449a74-kube-api-access-2m25s\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:32.093065 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-tls\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093098 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/726aca89-eea9-4006-9501-93f60d7d9444-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093156 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrqr\" (UniqueName: \"kubernetes.io/projected/726aca89-eea9-4006-9501-93f60d7d9444-kube-api-access-bjrqr\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093188 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-metrics-client-ca\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093216 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-sys\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-wtmp\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093392 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-root\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdprs\" (UniqueName: \"kubernetes.io/projected/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-kube-api-access-mdprs\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093520 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-textfile\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093547 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/726aca89-eea9-4006-9501-93f60d7d9444-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093613 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-sys\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:32.093643 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-wtmp\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:32.093698 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls podName:726aca89-eea9-4006-9501-93f60d7d9444 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:32.593680021 +0000 UTC m=+270.110575058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-6b5x8" (UID: "726aca89-eea9-4006-9501-93f60d7d9444") : secret "kube-state-metrics-tls" not found Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093795 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-textfile\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093817 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-metrics-client-ca\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.093917 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.093863 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-root\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.094620 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.094573 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.095560 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.094986 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.095849 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.095768 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726aca89-eea9-4006-9501-93f60d7d9444-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.096722 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.096699 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-tls\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.097240 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.097198 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.097732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.097712 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.111799 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.111769 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdprs\" (UniqueName: \"kubernetes.io/projected/9a69f45f-33fc-43e9-9e6b-1a680b9a245e-kube-api-access-mdprs\") pod \"node-exporter-5g66p\" (UID: \"9a69f45f-33fc-43e9-9e6b-1a680b9a245e\") " pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.113622 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.113600 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrqr\" (UniqueName: \"kubernetes.io/projected/726aca89-eea9-4006-9501-93f60d7d9444-kube-api-access-bjrqr\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.212248 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.212167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5g66p" Jul 23 21:30:32.496556 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.496526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:32.499631 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.499601 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3aa517d-aa1d-413a-82cc-16c3b1449a74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78578\" (UID: \"e3aa517d-aa1d-413a-82cc-16c3b1449a74\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:32.597188 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.597139 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:32.597359 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:32.597305 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 21:30:32.597416 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:32.597381 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls podName:726aca89-eea9-4006-9501-93f60d7d9444 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:33.597360507 +0000 UTC m=+271.114255559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-6b5x8" (UID: "726aca89-eea9-4006-9501-93f60d7d9444") : secret "kube-state-metrics-tls" not found Jul 23 21:30:32.792373 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.792292 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" Jul 23 21:30:32.934885 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.934799 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:30:32.938491 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.938466 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:32.952514 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.950276 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:30:32.958496 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.958475 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 21:30:32.959279 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.959260 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:30:32.959533 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.959484 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:32.966725 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966709 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966857 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966897 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5rdd5\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966903 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966957 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966991 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.966998 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.967032 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.967043 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 21:30:32.968111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.967107 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 21:30:32.989091 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:32.987281 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:30:33.000401 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000274 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000401 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.000401 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000343 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000427 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000471 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000572 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000605 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.000644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000670 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmv6d\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000750 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4f9\" (UniqueName: \"kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000795 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.001105 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.000845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001449 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.001282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.001449 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.001312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102603 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.102699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.102699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmv6d\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102934 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4f9\" (UniqueName: \"kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.102962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102956 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.102981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103007 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103043 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103188 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.103473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.103246 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.105704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.104787 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.105704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.105399 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.108202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.106551 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.108202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.107450 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.108202 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:33.107550 2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 23 21:30:33.108202 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:33.107613 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls podName:a3126954-6a2d-4c29-ae44-288ee84a1811 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:33.607595214 +0000 UTC m=+271.124490257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811") : secret "alertmanager-main-tls" not found Jul 23 21:30:33.108202 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:33.107895 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle podName:a3126954-6a2d-4c29-ae44-288ee84a1811 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:33.60788201 +0000 UTC m=+271.124777053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811") : configmap references non-existent config key: ca-bundle.crt Jul 23 21:30:33.109461 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.109434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.110013 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.109990 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.110013 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.110004 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.111477 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.111415 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.112122 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.112032 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.113002 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.112687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.114574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.114510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4f9\" (UniqueName: \"kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9\") pod \"console-54cddfd594-tmqv6\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.115127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.115056 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmv6d\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.118934 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.119342 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.119486 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.119523 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.120029 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.120614 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.120496 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.252729 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.252695 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:33.607899 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.607858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:33.608064 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.607912 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.608064 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.607962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.609306 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.609254 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.611932 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.611631 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:33.611932 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.611889 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/726aca89-eea9-4006-9501-93f60d7d9444-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-6b5x8\" (UID: \"726aca89-eea9-4006-9501-93f60d7d9444\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:33.719365 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.719088 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" Jul 23 21:30:33.874773 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:33.874691 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:30:35.860713 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.860636 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d69574b6-69gv4"] Jul 23 21:30:35.926291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.926257 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d69574b6-69gv4"] Jul 23 21:30:35.926450 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.926350 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929761 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8fdhp09v5sobi\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929771 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929812 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929872 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929761 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929815 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 21:30:35.930044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:35.929761 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zgrfp\"" Jul 23 21:30:36.032791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032755 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b56c626b-fb3d-492b-8e88-ca8cd43b648b-metrics-client-ca\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.032791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-grpc-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjrd\" (UniqueName: \"kubernetes.io/projected/b56c626b-fb3d-492b-8e88-ca8cd43b648b-kube-api-access-jxjrd\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032939 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.032987 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.033149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.033015 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.133999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.133887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b56c626b-fb3d-492b-8e88-ca8cd43b648b-metrics-client-ca\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.133999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.133946 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.133999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.133998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-grpc-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134111 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjrd\" (UniqueName: \"kubernetes.io/projected/b56c626b-fb3d-492b-8e88-ca8cd43b648b-kube-api-access-jxjrd\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134157 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134180 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134207 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.134906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.134702 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b56c626b-fb3d-492b-8e88-ca8cd43b648b-metrics-client-ca\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.137302 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.137255 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.137599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.137537 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.137599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.137548 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.137761 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.137719 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-grpc-tls\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.137823 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.137778 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.138384 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.138361 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b56c626b-fb3d-492b-8e88-ca8cd43b648b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.141646 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.141622 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjrd\" (UniqueName: \"kubernetes.io/projected/b56c626b-fb3d-492b-8e88-ca8cd43b648b-kube-api-access-jxjrd\") pod \"thanos-querier-5d69574b6-69gv4\" (UID: \"b56c626b-fb3d-492b-8e88-ca8cd43b648b\") " pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:36.237372 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:36.237337 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:37.145984 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.145950 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:30:37.177314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.177281 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:30:37.242260 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.242215 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:30:37.242460 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.242342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.343778 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.343956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.343956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343879 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsb5n\" (UniqueName: \"kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.343956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343925 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.343956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.344208 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.343994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.344208 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.344024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445312 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445239 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445312 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445279 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsb5n\" (UniqueName: \"kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445312 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445312 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445771 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445771 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445349 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.445771 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.445429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.446195 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.446061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.446195 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.446179 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.446195 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.446187 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.446396 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.446251 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.447821 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.447799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.447987 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.447968 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.455322 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.455301 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsb5n\" (UniqueName: \"kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n\") pod \"console-688cb44c59-6nh7q\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.553649 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.553619 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:37.963615 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.963517 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5g66p" event={"ID":"9a69f45f-33fc-43e9-9e6b-1a680b9a245e","Type":"ContainerStarted","Data":"ea2408d76e1ba0eef5f9a047375e49d1d61fe9e59ffa0bbedba6543aaf88d1c4"} Jul 23 21:30:37.967885 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.967143 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f897cb67c-v96h2" event={"ID":"265c7efb-3f59-4b41-86a1-3a7128ed1e19","Type":"ContainerStarted","Data":"4af336d37ef0e6da0681b8e8990c03d96a95e7f11e88fdda1ce9f9a62436340b"} Jul 23 21:30:37.992987 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.991743 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f897cb67c-v96h2" podStartSLOduration=1.635586236 podStartE2EDuration="11.991720562s" totalImagesPullingTime="10.356134326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:37.990614908 +0000 UTC m=+275.507509969" watchObservedRunningTime="2026-07-23 21:30:37.991720562 +0000 UTC m=+275.508615623" Jul 23 21:30:37.999235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:37.999213 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:30:38.034915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.034885 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d69574b6-69gv4"] Jul 23 21:30:38.041831 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.041764 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78578"] Jul 23 21:30:38.046984 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:38.046945 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56c626b_fb3d_492b_8e88_ca8cd43b648b.slice/crio-f28f2b4ccbd04379fa8841f285170a844833a93bdf60cb7a23be2b5ce7f0464f WatchSource:0}: Error finding container f28f2b4ccbd04379fa8841f285170a844833a93bdf60cb7a23be2b5ce7f0464f: Status 404 returned error can't find the container with id f28f2b4ccbd04379fa8841f285170a844833a93bdf60cb7a23be2b5ce7f0464f Jul 23 21:30:38.050792 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.050152 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:30:38.050792 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:38.047905 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3aa517d_aa1d_413a_82cc_16c3b1449a74.slice/crio-cbeba5476e7ccb91977d529459a415c343d3e9d67e4d99575ce985fb29c5c593 WatchSource:0}: Error finding container cbeba5476e7ccb91977d529459a415c343d3e9d67e4d99575ce985fb29c5c593: Status 404 returned error can't find the container with id cbeba5476e7ccb91977d529459a415c343d3e9d67e4d99575ce985fb29c5c593 Jul 23 21:30:38.056265 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:38.055798 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3126954_6a2d_4c29_ae44_288ee84a1811.slice/crio-da7a6fa9a597244b6a5e94292a090902240d240460efeb2e7d7132d2fda9ff47 WatchSource:0}: Error finding container da7a6fa9a597244b6a5e94292a090902240d240460efeb2e7d7132d2fda9ff47: Status 404 returned error can't find the container with id da7a6fa9a597244b6a5e94292a090902240d240460efeb2e7d7132d2fda9ff47 Jul 23 21:30:38.290804 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.290731 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-6b5x8"] Jul 23 21:30:38.292757 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.292712 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:30:38.981930 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.979263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-56bsk" event={"ID":"455d1fd7-23a7-4f0e-a923-3a569e285da6","Type":"ContainerStarted","Data":"998c9a6b097b92f1c8446e819e73db1795fbcde5c8a5c527321d44966793b288"} Jul 23 21:30:38.981930 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.980258 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:38.982360 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.982336 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"f28f2b4ccbd04379fa8841f285170a844833a93bdf60cb7a23be2b5ce7f0464f"} Jul 23 21:30:38.985182 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.985050 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" event={"ID":"e3aa517d-aa1d-413a-82cc-16c3b1449a74","Type":"ContainerStarted","Data":"01ee7c6f5eba728b13979ff6fd26fdb07d3547302effe8d3890c1c17324f6a9a"} Jul 23 21:30:38.985182 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.985118 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" event={"ID":"e3aa517d-aa1d-413a-82cc-16c3b1449a74","Type":"ContainerStarted","Data":"607b3db979650e647162c2eef43a81024fba50c3bd15344d3ec84a0892c893eb"} Jul 23 21:30:38.985182 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.985147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" event={"ID":"e3aa517d-aa1d-413a-82cc-16c3b1449a74","Type":"ContainerStarted","Data":"cbeba5476e7ccb91977d529459a415c343d3e9d67e4d99575ce985fb29c5c593"} Jul 23 21:30:38.987040 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.987016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cddfd594-tmqv6" event={"ID":"3b992829-5f61-4399-8804-3872a31c3a5c","Type":"ContainerStarted","Data":"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8"} Jul 23 21:30:38.987160 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.987058 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cddfd594-tmqv6" event={"ID":"3b992829-5f61-4399-8804-3872a31c3a5c","Type":"ContainerStarted","Data":"bcd14d1895400c07dfde240488d2276a6ffa3f66903b8a56995994a680eca5f8"} Jul 23 21:30:38.989101 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.988935 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cb44c59-6nh7q" event={"ID":"a2f72d67-27d0-413e-872e-be772e36690c","Type":"ContainerStarted","Data":"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e"} Jul 23 21:30:38.989101 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.989042 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cb44c59-6nh7q" event={"ID":"a2f72d67-27d0-413e-872e-be772e36690c","Type":"ContainerStarted","Data":"d75c101b44b3263ff630c9921c915fb5d7d3682f4edf75d1afc3380fdec0dc45"} Jul 23 21:30:38.991953 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.991670 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"da7a6fa9a597244b6a5e94292a090902240d240460efeb2e7d7132d2fda9ff47"} Jul 23 21:30:38.992201 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.992185 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-56bsk" Jul 23 21:30:38.993130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.993109 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" event={"ID":"726aca89-eea9-4006-9501-93f60d7d9444","Type":"ContainerStarted","Data":"407216cb3a974a4106873735519a355c339cdcfee89097d81d064644789c9a5e"} Jul 23 21:30:38.997988 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:38.997938 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-56bsk" podStartSLOduration=3.283935199 podStartE2EDuration="22.997921271s" totalImagesPullingTime="19.713986072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:38.997424601 +0000 UTC m=+276.514319654" watchObservedRunningTime="2026-07-23 21:30:38.997921271 +0000 UTC m=+276.514816334" Jul 23 21:30:39.033889 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:39.033830 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688cb44c59-6nh7q" podStartSLOduration=2.033812332 podStartE2EDuration="2.033812332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:39.014862467 +0000 UTC m=+276.531757538" watchObservedRunningTime="2026-07-23 21:30:39.033812332 +0000 UTC m=+276.550707370" Jul 23 21:30:39.035183 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:39.035141 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54cddfd594-tmqv6" podStartSLOduration=7.035131433 podStartE2EDuration="7.035131433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:39.033067686 +0000 UTC m=+276.549962756" watchObservedRunningTime="2026-07-23 21:30:39.035131433 +0000 UTC m=+276.552026493" Jul 23 21:30:43.034004 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.033807 2569 generic.go:356] "Generic (PLEG): container finished" podID="9a69f45f-33fc-43e9-9e6b-1a680b9a245e" containerID="6db74fb7f7a2790d7869a0f8b7a0497a97fe15bfa185b40c909e2c51d0fc21c4" exitCode=0 Jul 23 21:30:43.034004 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.033926 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5g66p" event={"ID":"9a69f45f-33fc-43e9-9e6b-1a680b9a245e","Type":"ContainerDied","Data":"6db74fb7f7a2790d7869a0f8b7a0497a97fe15bfa185b40c909e2c51d0fc21c4"} Jul 23 21:30:43.038724 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.038685 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"0ced39391a68c4777d34bd4bd3d6f405eb3659fa59866f79563dce2d9982889f"} Jul 23 21:30:43.038820 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.038773 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"87ab59b64c547df04a5ba99bc93b451a4e56d425f384395f28903fea56c1256c"} Jul 23 21:30:43.043912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.043198 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" event={"ID":"e3aa517d-aa1d-413a-82cc-16c3b1449a74","Type":"ContainerStarted","Data":"9c6cf3ab671f45dea9599c70d6718d416200bfa714753da9c87a173c4fb17338"} Jul 23 21:30:43.046815 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.046666 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="3da6ed666247cefa600cbc08312c77c48df98a9b159ce36b5aba424032b7fb16" exitCode=0 Jul 23 21:30:43.046815 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.046743 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"3da6ed666247cefa600cbc08312c77c48df98a9b159ce36b5aba424032b7fb16"} Jul 23 21:30:43.051202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.050563 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" event={"ID":"726aca89-eea9-4006-9501-93f60d7d9444","Type":"ContainerStarted","Data":"b6b471436976d7c6de40ce3072d949aab244db10889ac1e0e1d44e8deb2796c0"} Jul 23 21:30:43.051202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.050620 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" event={"ID":"726aca89-eea9-4006-9501-93f60d7d9444","Type":"ContainerStarted","Data":"6007138cb481406d4b7a89899b246d7b3b520d453c038403fe5e270caf72ddcd"} Jul 23 21:30:43.051202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.050651 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" event={"ID":"726aca89-eea9-4006-9501-93f60d7d9444","Type":"ContainerStarted","Data":"5df1469c61ef4f9591a65987721de0d192a14b88caf13f77606c36058af36dbf"} Jul 23 21:30:43.082950 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.082893 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78578" podStartSLOduration=7.787787497 podStartE2EDuration="12.082873392s" totalImagesPullingTime="4.295085895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:43.080580736 +0000 UTC m=+280.597475796" watchObservedRunningTime="2026-07-23 21:30:43.082873392 +0000 UTC m=+280.599768454" Jul 23 21:30:43.104255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.104201 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-6b5x8" podStartSLOduration=7.876632043 podStartE2EDuration="12.104180483s" totalImagesPullingTime="4.22754844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:43.101607603 +0000 UTC m=+280.618502664" watchObservedRunningTime="2026-07-23 21:30:43.104180483 +0000 UTC m=+280.621075550" Jul 23 21:30:43.253179 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.253141 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:43.253339 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.253204 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:43.254488 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.254385 2569 patch_prober.go:28] interesting pod/console-54cddfd594-tmqv6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 23 21:30:43.254488 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:43.254431 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54cddfd594-tmqv6" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 23 21:30:44.059415 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:44.059373 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5g66p" event={"ID":"9a69f45f-33fc-43e9-9e6b-1a680b9a245e","Type":"ContainerStarted","Data":"91a1d387b240f5cc8c45cab460c59e2bb7178d60458cfdac6b0adde10bfa51b0"} Jul 23 21:30:44.059923 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:44.059443 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5g66p" event={"ID":"9a69f45f-33fc-43e9-9e6b-1a680b9a245e","Type":"ContainerStarted","Data":"be7135454575f934e6fa17b035c8bf57c39f430e4000a0046ebaee7d0b3fc4fa"} Jul 23 21:30:44.067608 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:44.067575 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"682122d31c50445ee8520bde220e6984aa41cb6b7c272d0f4e2d327aeb534ec9"} Jul 23 21:30:44.082779 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:44.082712 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5g66p" podStartSLOduration=8.24609159 podStartE2EDuration="13.082693768s" totalImagesPullingTime="4.700562007s" totalInitContainerRuntime="136.040171ms" isStatefulPod=true podCreationTimestamp="2026-07-23 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:44.081033845 +0000 UTC m=+281.597928907" watchObservedRunningTime="2026-07-23 21:30:44.082693768 +0000 UTC m=+281.599588830" Jul 23 21:30:44.564894 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:30:44.564854 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7rfg5" podUID="c2193f99-506e-4e9f-9d40-615f7b2aba37" Jul 23 21:30:45.080683 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:45.080587 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"6d15fb53d6bcba4896b67c17ac6fdc38acf0d885bc0eae8e0928a5e9f30a4770"} Jul 23 21:30:45.080683 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:45.080680 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"99643160a3aa882dda4c92e14a305ac48f718ff1383f17b918d1500d0ebef3b3"} Jul 23 21:30:45.081188 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:45.080966 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:30:46.088973 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.088932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" event={"ID":"b56c626b-fb3d-492b-8e88-ca8cd43b648b","Type":"ContainerStarted","Data":"50ac6cdd6dafe3d67159e1df5a4210c3b6d3524025d6b923338d3ffd3a96edf2"} Jul 23 21:30:46.089419 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.089149 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:46.092811 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.092775 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"50aac4de6918028a178a4c71c08efa1fd8b80a7d8dacf5d14973133ffdcb792a"} Jul 23 21:30:46.092915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.092850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"a6693cfa3d04cc34963bb99b3737657ba59a1399a943e63a8431c2409bbee00a"} Jul 23 21:30:46.092915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.092893 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"187ea339acf921b25924690eda2608ccea6a7caddfdf4e0a898849d80843f89c"} Jul 23 21:30:46.116142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:46.116061 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" podStartSLOduration=5.026684053 podStartE2EDuration="11.116042565s" totalImagesPullingTime="6.089358512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:46.113643846 +0000 UTC m=+283.630538908" watchObservedRunningTime="2026-07-23 21:30:46.116042565 +0000 UTC m=+283.632937628" Jul 23 21:30:47.099890 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.099854 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"556942ec1a77e170711f3ddc121fbe7621b8efb6d95e7705c0b02fe190805dee"} Jul 23 21:30:47.100546 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.099928 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"31ba25c34aa1a9a60f5234337ff1cb89b130596898f98afbc56dcbbcf888b4a3"} Jul 23 21:30:47.100546 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.099965 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerStarted","Data":"61d83781d4e86f6133029390cd6973599fed37443e0bd2c62599ebff3572d196"} Jul 23 21:30:47.105444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.105424 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d69574b6-69gv4" Jul 23 21:30:47.138364 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.138264 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.148819247 podStartE2EDuration="15.138244569s" totalImagesPullingTime="6.974781351s" totalInitContainerRuntime="14.643971ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:47.136892381 +0000 UTC m=+284.653787433" watchObservedRunningTime="2026-07-23 21:30:47.138244569 +0000 UTC m=+284.655139629" Jul 23 21:30:47.276210 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.276180 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:30:47.554047 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.554012 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:47.554240 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.554192 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:47.555633 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.555608 2569 patch_prober.go:28] interesting pod/console-688cb44c59-6nh7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jul 23 21:30:47.555748 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:47.555648 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-688cb44c59-6nh7q" podUID="a2f72d67-27d0-413e-872e-be772e36690c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jul 23 21:30:48.263327 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:48.263289 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:30:48.265934 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:48.265906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2193f99-506e-4e9f-9d40-615f7b2aba37-metrics-tls\") pod \"dns-default-7rfg5\" (UID: \"c2193f99-506e-4e9f-9d40-615f7b2aba37\") " pod="openshift-dns/dns-default-7rfg5" Jul 23 21:30:48.384257 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:48.384224 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:30:48.392304 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:48.392258 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:30:48.577159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:48.577116 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rfg5"] Jul 23 21:30:48.580986 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:30:48.580956 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2193f99_506e_4e9f_9d40_615f7b2aba37.slice/crio-5b129813224ce49448bce88791857ad0b15cace2a003bd9e71012a7bbb0e107c WatchSource:0}: Error finding container 5b129813224ce49448bce88791857ad0b15cace2a003bd9e71012a7bbb0e107c: Status 404 returned error can't find the container with id 5b129813224ce49448bce88791857ad0b15cace2a003bd9e71012a7bbb0e107c Jul 23 21:30:49.111246 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:49.111205 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rfg5" event={"ID":"c2193f99-506e-4e9f-9d40-615f7b2aba37","Type":"ContainerStarted","Data":"5b129813224ce49448bce88791857ad0b15cace2a003bd9e71012a7bbb0e107c"} Jul 23 21:30:51.121929 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:51.121884 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rfg5" event={"ID":"c2193f99-506e-4e9f-9d40-615f7b2aba37","Type":"ContainerStarted","Data":"ddac4b90ca205e197992b1868c78f1d9c43d51461a06392463e1d299dcebc53d"} Jul 23 21:30:51.122339 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:51.121945 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rfg5" event={"ID":"c2193f99-506e-4e9f-9d40-615f7b2aba37","Type":"ContainerStarted","Data":"fff040843780b796f804525963ee6473e5e8b35c23dc3df4b577d6057a94a486"} Jul 23 21:30:51.122339 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:51.121994 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:30:51.140300 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:51.140257 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7rfg5" podStartSLOduration=250.991885755 podStartE2EDuration="4m13.14024127s" totalImagesPullingTime="2.148355515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:51.138749963 +0000 UTC m=+288.655645016" watchObservedRunningTime="2026-07-23 21:30:51.14024127 +0000 UTC m=+288.657136329" Jul 23 21:30:53.256941 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:53.256912 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:53.260867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:53.260847 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:30:57.558140 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:57.558113 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:57.561760 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:57.561741 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:30:57.623498 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:30:57.623460 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:31:01.128524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:01.128492 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7rfg5" Jul 23 21:31:02.906963 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:02.906934 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:31:02.907457 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:02.907442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:31:02.914278 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:02.914255 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:31:02.914918 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:02.914897 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:31:02.917338 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:02.917322 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 21:31:03.001770 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.001722 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f897cb67c-v96h2" podUID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" containerName="console" containerID="cri-o://4af336d37ef0e6da0681b8e8990c03d96a95e7f11e88fdda1ce9f9a62436340b" gracePeriod=15 Jul 23 21:31:03.244404 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.176877 2569 generic.go:356] "Generic (PLEG): container finished" podID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" containerID="4af336d37ef0e6da0681b8e8990c03d96a95e7f11e88fdda1ce9f9a62436340b" exitCode=0 Jul 23 21:31:03.244404 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.176942 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f897cb67c-v96h2" event={"ID":"265c7efb-3f59-4b41-86a1-3a7128ed1e19","Type":"ContainerDied","Data":"4af336d37ef0e6da0681b8e8990c03d96a95e7f11e88fdda1ce9f9a62436340b"} Jul 23 21:31:03.269731 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.269709 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:31:03.392646 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392613 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.392826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392673 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.392826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392698 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.392826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392718 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.392826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392757 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.392826 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.392778 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpxsb\" (UniqueName: \"kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb\") pod \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\" (UID: \"265c7efb-3f59-4b41-86a1-3a7128ed1e19\") " Jul 23 21:31:03.393130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.393102 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:03.393216 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.393177 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca" (OuterVolumeSpecName: "service-ca") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:03.393216 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.393183 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config" (OuterVolumeSpecName: "console-config") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:03.395190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.395160 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:03.395293 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.395234 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb" (OuterVolumeSpecName: "kube-api-access-xpxsb") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "kube-api-access-xpxsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:03.395457 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.395426 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "265c7efb-3f59-4b41-86a1-3a7128ed1e19" (UID: "265c7efb-3f59-4b41-86a1-3a7128ed1e19"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:03.493654 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493627 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-oauth-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:03.493654 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493654 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-service-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:03.493654 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493662 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-oauth-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:03.493867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493671 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:03.493867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493681 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c7efb-3f59-4b41-86a1-3a7128ed1e19-console-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:03.493867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:03.493689 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpxsb\" (UniqueName: \"kubernetes.io/projected/265c7efb-3f59-4b41-86a1-3a7128ed1e19-kube-api-access-xpxsb\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:04.182763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:04.182730 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f897cb67c-v96h2" event={"ID":"265c7efb-3f59-4b41-86a1-3a7128ed1e19","Type":"ContainerDied","Data":"ffca865be6f40ebba7b2b0d1648b57494bd5efc4db9999f678873055cb671ad4"} Jul 23 21:31:04.182763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:04.182758 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f897cb67c-v96h2" Jul 23 21:31:04.183239 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:04.182786 2569 scope.go:117] "RemoveContainer" containerID="4af336d37ef0e6da0681b8e8990c03d96a95e7f11e88fdda1ce9f9a62436340b" Jul 23 21:31:04.204869 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:04.204847 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:31:04.209588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:04.209565 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f897cb67c-v96h2"] Jul 23 21:31:05.075310 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:05.075279 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" path="/var/lib/kubelet/pods/265c7efb-3f59-4b41-86a1-3a7128ed1e19/volumes" Jul 23 21:31:08.200568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:08.200536 2569 generic.go:356] "Generic (PLEG): container finished" podID="64d08acf-af16-4a1c-9158-20747578bc85" containerID="a7227e548b334d1fdd386d5db79eb7f3d70b05005dc230ddbf6318356e9a594e" exitCode=0 Jul 23 21:31:08.200919 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:08.200588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" event={"ID":"64d08acf-af16-4a1c-9158-20747578bc85","Type":"ContainerDied","Data":"a7227e548b334d1fdd386d5db79eb7f3d70b05005dc230ddbf6318356e9a594e"} Jul 23 21:31:08.200919 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:08.200910 2569 scope.go:117] "RemoveContainer" containerID="a7227e548b334d1fdd386d5db79eb7f3d70b05005dc230ddbf6318356e9a594e" Jul 23 21:31:09.207069 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:09.207038 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-24fh7" event={"ID":"64d08acf-af16-4a1c-9158-20747578bc85","Type":"ContainerStarted","Data":"bc7ad82598de054a890cda160a8d7fec6ac89ecbfb319eadb5148bfc0f305953"} Jul 23 21:31:09.426739 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:09.426707 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rfg5_c2193f99-506e-4e9f-9d40-615f7b2aba37/dns/0.log" Jul 23 21:31:09.626897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:09.626867 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rfg5_c2193f99-506e-4e9f-9d40-615f7b2aba37/kube-rbac-proxy/0.log" Jul 23 21:31:10.226880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:10.226833 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxdkv_61017217-5c58-404f-9156-7f84d6582f73/dns-node-resolver/0.log" Jul 23 21:31:10.827273 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:10.827240 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b98bc9bd8-8qf2h_1efd1344-252e-49b2-8894-d6bb533078a7/router/0.log" Jul 23 21:31:11.227050 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:11.226969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jd6dq_793b7480-eba1-4622-b1bd-149a01f96a41/serve-healthcheck-canary/0.log" Jul 23 21:31:22.662426 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:22.662345 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54cddfd594-tmqv6" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" containerName="console" containerID="cri-o://a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8" gracePeriod=15 Jul 23 21:31:22.971539 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:22.971503 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:31:23.060377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.060339 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.060642 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.060624 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs4f9\" (UniqueName: \"kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.060790 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.060775 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.060912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.060897 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.061048 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.061033 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.061241 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.061226 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.061384 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.061370 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config\") pod \"3b992829-5f61-4399-8804-3872a31c3a5c\" (UID: \"3b992829-5f61-4399-8804-3872a31c3a5c\") " Jul 23 21:31:23.062054 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.062031 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config" (OuterVolumeSpecName: "console-config") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:23.062971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.062441 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:23.062971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.062709 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:23.063703 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.063676 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:23.070092 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.070033 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9" (OuterVolumeSpecName: "kube-api-access-rs4f9") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "kube-api-access-rs4f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:23.070485 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.070459 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:23.070733 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.070712 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b992829-5f61-4399-8804-3872a31c3a5c" (UID: "3b992829-5f61-4399-8804-3872a31c3a5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:23.162962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.162923 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-service-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.162962 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.162962 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-oauth-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.163229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.162977 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-console-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.163229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.162994 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-trusted-ca-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.163229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.163008 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs4f9\" (UniqueName: \"kubernetes.io/projected/3b992829-5f61-4399-8804-3872a31c3a5c-kube-api-access-rs4f9\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.163229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.163024 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b992829-5f61-4399-8804-3872a31c3a5c-oauth-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.163229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.163037 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b992829-5f61-4399-8804-3872a31c3a5c-console-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:23.263893 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.263854 2569 generic.go:356] "Generic (PLEG): container finished" podID="3b992829-5f61-4399-8804-3872a31c3a5c" containerID="a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8" exitCode=0 Jul 23 21:31:23.264112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.263950 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cddfd594-tmqv6" Jul 23 21:31:23.264112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.263963 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cddfd594-tmqv6" event={"ID":"3b992829-5f61-4399-8804-3872a31c3a5c","Type":"ContainerDied","Data":"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8"} Jul 23 21:31:23.264112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.264012 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cddfd594-tmqv6" event={"ID":"3b992829-5f61-4399-8804-3872a31c3a5c","Type":"ContainerDied","Data":"bcd14d1895400c07dfde240488d2276a6ffa3f66903b8a56995994a680eca5f8"} Jul 23 21:31:23.264112 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.264039 2569 scope.go:117] "RemoveContainer" containerID="a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8" Jul 23 21:31:23.273651 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.273631 2569 scope.go:117] "RemoveContainer" containerID="a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8" Jul 23 21:31:23.274255 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:31:23.274161 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8\": container with ID starting with a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8 not found: ID does not exist" containerID="a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8" Jul 23 21:31:23.274255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.274203 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8"} err="failed to get container status \"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8\": rpc error: code = NotFound desc = could not find container \"a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8\": container with ID starting with a991d2bbbe0f2bda03aad810c30bed25a05c63fd265c2d0eb493db0b5ee7e8f8 not found: ID does not exist" Jul 23 21:31:23.283375 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.283346 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:31:23.286404 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:23.286378 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54cddfd594-tmqv6"] Jul 23 21:31:25.075369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:25.075339 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" path="/var/lib/kubelet/pods/3b992829-5f61-4399-8804-3872a31c3a5c/volumes" Jul 23 21:31:52.248778 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.248743 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:52.249287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249032 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="alertmanager" containerID="cri-o://187ea339acf921b25924690eda2608ccea6a7caddfdf4e0a898849d80843f89c" gracePeriod=120 Jul 23 21:31:52.249287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249101 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-metric" containerID="cri-o://31ba25c34aa1a9a60f5234337ff1cb89b130596898f98afbc56dcbbcf888b4a3" gracePeriod=120 Jul 23 21:31:52.249287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249142 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-web" containerID="cri-o://50aac4de6918028a178a4c71c08efa1fd8b80a7d8dacf5d14973133ffdcb792a" gracePeriod=120 Jul 23 21:31:52.249287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249192 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="config-reloader" containerID="cri-o://a6693cfa3d04cc34963bb99b3737657ba59a1399a943e63a8431c2409bbee00a" gracePeriod=120 Jul 23 21:31:52.249510 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249210 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy" containerID="cri-o://61d83781d4e86f6133029390cd6973599fed37443e0bd2c62599ebff3572d196" gracePeriod=120 Jul 23 21:31:52.249510 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.249287 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="prom-label-proxy" containerID="cri-o://556942ec1a77e170711f3ddc121fbe7621b8efb6d95e7705c0b02fe190805dee" gracePeriod=120 Jul 23 21:31:52.385124 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385099 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="556942ec1a77e170711f3ddc121fbe7621b8efb6d95e7705c0b02fe190805dee" exitCode=0 Jul 23 21:31:52.385124 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385121 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="31ba25c34aa1a9a60f5234337ff1cb89b130596898f98afbc56dcbbcf888b4a3" exitCode=0 Jul 23 21:31:52.385124 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385127 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="61d83781d4e86f6133029390cd6973599fed37443e0bd2c62599ebff3572d196" exitCode=0 Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385132 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="a6693cfa3d04cc34963bb99b3737657ba59a1399a943e63a8431c2409bbee00a" exitCode=0 Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385137 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="187ea339acf921b25924690eda2608ccea6a7caddfdf4e0a898849d80843f89c" exitCode=0 Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385160 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"556942ec1a77e170711f3ddc121fbe7621b8efb6d95e7705c0b02fe190805dee"} Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"31ba25c34aa1a9a60f5234337ff1cb89b130596898f98afbc56dcbbcf888b4a3"} Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385237 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"61d83781d4e86f6133029390cd6973599fed37443e0bd2c62599ebff3572d196"} Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385261 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"a6693cfa3d04cc34963bb99b3737657ba59a1399a943e63a8431c2409bbee00a"} Jul 23 21:31:52.385287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:52.385285 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"187ea339acf921b25924690eda2608ccea6a7caddfdf4e0a898849d80843f89c"} Jul 23 21:31:53.397983 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.397947 2569 generic.go:356] "Generic (PLEG): container finished" podID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerID="50aac4de6918028a178a4c71c08efa1fd8b80a7d8dacf5d14973133ffdcb792a" exitCode=0 Jul 23 21:31:53.398341 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.398016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"50aac4de6918028a178a4c71c08efa1fd8b80a7d8dacf5d14973133ffdcb792a"} Jul 23 21:31:53.495170 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.495150 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:53.611943 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.611867 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.611943 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.611902 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.611943 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.611927 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.611963 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.611982 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612023 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612052 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612107 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612134 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612160 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612200 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612230 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612262 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmv6d\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d\") pod \"a3126954-6a2d-4c29-ae44-288ee84a1811\" (UID: \"a3126954-6a2d-4c29-ae44-288ee84a1811\") " Jul 23 21:31:53.612846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.612468 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:53.613529 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.613267 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:31:53.613745 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.613716 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:53.616171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616124 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:53.616277 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616245 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.616277 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616256 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d" (OuterVolumeSpecName: "kube-api-access-lmv6d") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "kube-api-access-lmv6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:53.616394 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616281 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume" (OuterVolumeSpecName: "config-volume") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.616394 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616297 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.616503 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616466 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.616687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616653 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.616914 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.616891 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out" (OuterVolumeSpecName: "config-out") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:31:53.620130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.620063 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.626554 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.626533 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config" (OuterVolumeSpecName: "web-config") pod "a3126954-6a2d-4c29-ae44-288ee84a1811" (UID: "a3126954-6a2d-4c29-ae44-288ee84a1811"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:53.712945 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712916 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-metrics-client-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.712945 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712942 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712958 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-config-volume\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712970 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-cluster-tls-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712984 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-main-tls\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.712995 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-main-db\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713007 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3126954-6a2d-4c29-ae44-288ee84a1811-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713020 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmv6d\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-kube-api-access-lmv6d\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713057 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-web-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713094 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713110 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3126954-6a2d-4c29-ae44-288ee84a1811-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713122 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3126954-6a2d-4c29-ae44-288ee84a1811-config-out\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:53.713171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:53.713134 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3126954-6a2d-4c29-ae44-288ee84a1811-tls-assets\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:31:54.405494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.405464 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3126954-6a2d-4c29-ae44-288ee84a1811","Type":"ContainerDied","Data":"da7a6fa9a597244b6a5e94292a090902240d240460efeb2e7d7132d2fda9ff47"} Jul 23 21:31:54.405494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.405483 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.405931 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.405536 2569 scope.go:117] "RemoveContainer" containerID="556942ec1a77e170711f3ddc121fbe7621b8efb6d95e7705c0b02fe190805dee" Jul 23 21:31:54.413913 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.413895 2569 scope.go:117] "RemoveContainer" containerID="31ba25c34aa1a9a60f5234337ff1cb89b130596898f98afbc56dcbbcf888b4a3" Jul 23 21:31:54.421268 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.421250 2569 scope.go:117] "RemoveContainer" containerID="61d83781d4e86f6133029390cd6973599fed37443e0bd2c62599ebff3572d196" Jul 23 21:31:54.428409 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.428387 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:54.428904 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.428890 2569 scope.go:117] "RemoveContainer" containerID="50aac4de6918028a178a4c71c08efa1fd8b80a7d8dacf5d14973133ffdcb792a" Jul 23 21:31:54.434120 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.434098 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:54.436187 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.436144 2569 scope.go:117] "RemoveContainer" containerID="a6693cfa3d04cc34963bb99b3737657ba59a1399a943e63a8431c2409bbee00a" Jul 23 21:31:54.442910 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.442892 2569 scope.go:117] "RemoveContainer" containerID="187ea339acf921b25924690eda2608ccea6a7caddfdf4e0a898849d80843f89c" Jul 23 21:31:54.450220 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.450203 2569 scope.go:117] "RemoveContainer" containerID="3da6ed666247cefa600cbc08312c77c48df98a9b159ce36b5aba424032b7fb16" Jul 23 21:31:54.457818 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.457800 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:54.458126 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458113 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="config-reloader" Jul 23 21:31:54.458126 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458127 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="config-reloader" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458139 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" containerName="console" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458145 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" containerName="console" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458151 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" containerName="console" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458156 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" containerName="console" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458164 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="alertmanager" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458169 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="alertmanager" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458174 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-web" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458179 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-web" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458184 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="prom-label-proxy" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458189 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="prom-label-proxy" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458200 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="init-config-reloader" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458205 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="init-config-reloader" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458215 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-metric" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458219 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-metric" Jul 23 21:31:54.458224 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458228 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458233 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458275 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="config-reloader" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458282 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-web" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458289 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="prom-label-proxy" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458295 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="265c7efb-3f59-4b41-86a1-3a7128ed1e19" containerName="console" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458300 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="alertmanager" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458307 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b992829-5f61-4399-8804-3872a31c3a5c" containerName="console" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458313 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy-metric" Jul 23 21:31:54.458720 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.458319 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" containerName="kube-rbac-proxy" Jul 23 21:31:54.461891 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.461876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.464610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.464591 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 21:31:54.464721 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.464628 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 21:31:54.464854 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.464838 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 21:31:54.464906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.464850 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 21:31:54.464983 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.464846 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 21:31:54.465067 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.465051 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 21:31:54.465151 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.465096 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 21:31:54.465200 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.465123 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 21:31:54.465387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.465370 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5rdd5\"" Jul 23 21:31:54.469980 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.469958 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 21:31:54.474956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.474934 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:54.620364 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvdk\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-kube-api-access-khvdk\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620364 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620364 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620344 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620364 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-web-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620396 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-out\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620598 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620582 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.620865 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.620616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721702 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721804 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvdk\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-kube-api-access-khvdk\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721804 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721754 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721804 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-web-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.721952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721850 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.721989 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-out\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722275 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722275 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722157 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722275 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722548 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.722820 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.722658 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.723097 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.723054 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725340 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-web-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725368 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725591 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725453 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725591 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725464 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.725763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.725747 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-config-out\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.726030 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.726011 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.727297 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.727282 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.729394 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.729378 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvdk\" (UniqueName: \"kubernetes.io/projected/7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6-kube-api-access-khvdk\") pod \"alertmanager-main-0\" (UID: \"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.771365 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.771344 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:31:54.904086 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:54.904047 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:31:54.906242 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:31:54.906217 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7644c3e5_1ebf_492c_bbf0_e0fc7c2a7ef6.slice/crio-9a015f9aae442469fb1e55fcd6b33908ed6e587b76a5efea2b003a41c27b912c WatchSource:0}: Error finding container 9a015f9aae442469fb1e55fcd6b33908ed6e587b76a5efea2b003a41c27b912c: Status 404 returned error can't find the container with id 9a015f9aae442469fb1e55fcd6b33908ed6e587b76a5efea2b003a41c27b912c Jul 23 21:31:55.075449 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:55.075415 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3126954-6a2d-4c29-ae44-288ee84a1811" path="/var/lib/kubelet/pods/a3126954-6a2d-4c29-ae44-288ee84a1811/volumes" Jul 23 21:31:55.412140 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:55.412109 2569 generic.go:356] "Generic (PLEG): container finished" podID="7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6" containerID="11013a6adc8557a49355a067f9068746bb1a785e5d509eff792b0ead2e536ead" exitCode=0 Jul 23 21:31:55.412503 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:55.412168 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerDied","Data":"11013a6adc8557a49355a067f9068746bb1a785e5d509eff792b0ead2e536ead"} Jul 23 21:31:55.412503 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:55.412228 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"9a015f9aae442469fb1e55fcd6b33908ed6e587b76a5efea2b003a41c27b912c"} Jul 23 21:31:56.272434 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.272393 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b6954f5f6-6d755"] Jul 23 21:31:56.275501 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.275479 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.278606 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.278576 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2l52t\"" Jul 23 21:31:56.278778 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.278737 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 21:31:56.279137 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.279103 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 21:31:56.279243 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.279150 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 21:31:56.279243 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.279157 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 21:31:56.279375 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.279265 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 21:31:56.284607 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.284590 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 21:31:56.291867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.291845 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b6954f5f6-6d755"] Jul 23 21:31:56.420172 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420136 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"03fc0d75f9f746ee456f8ec175ab97a1f9b13f7c18853b972617e5f0bb6a7f44"} Jul 23 21:31:56.420566 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420217 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"4439ac6a11e18f1f357994b42e3b989d210225e16152d8a61170f1a8f6c7282c"} Jul 23 21:31:56.420566 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420261 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"1f921f00f04e208dff0dd373092d909eda16b4f3504f7439fb0a0b3127569ecd"} Jul 23 21:31:56.420566 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420296 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"61f84c21eadfc4345cb99540e255943c16c74d2dd5c5769186c6ddc8ecc61a24"} Jul 23 21:31:56.420566 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420332 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"0d13c40f972fe26f97300394b413f1aa401b21dcbe99f3540f8904e94c106d0a"} Jul 23 21:31:56.420566 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.420375 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6","Type":"ContainerStarted","Data":"7972a82a5a80f2d08a8f75a0055431bcceeaf4e41460d6295230a157a8925455"} Jul 23 21:31:56.437423 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437426 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437463 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgggg\" (UniqueName: \"kubernetes.io/projected/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-kube-api-access-wgggg\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-serving-certs-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437524 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437515 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437536 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-federate-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437587 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.437691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.437604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-metrics-client-ca\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.446437 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.446394 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.43173566 podStartE2EDuration="2.446380161s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.644501ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:31:56.443883938 +0000 UTC m=+353.960778998" watchObservedRunningTime="2026-07-23 21:31:56.446380161 +0000 UTC m=+353.963275219" Jul 23 21:31:56.538233 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538233 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538534 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538512 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgggg\" (UniqueName: \"kubernetes.io/projected/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-kube-api-access-wgggg\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538604 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538574 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-serving-certs-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538661 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538712 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-federate-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538764 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.538819 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.538767 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-metrics-client-ca\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.539440 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.539414 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-serving-certs-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.539555 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.539421 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.539810 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.539781 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-metrics-client-ca\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.540982 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.540962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-telemeter-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.541455 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.541432 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.541543 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.541498 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-secret-telemeter-client\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.541582 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.541543 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-federate-client-tls\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.546910 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.546888 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgggg\" (UniqueName: \"kubernetes.io/projected/de25a059-9050-4a6b-91b1-4f9c5d5c19a2-kube-api-access-wgggg\") pod \"telemeter-client-5b6954f5f6-6d755\" (UID: \"de25a059-9050-4a6b-91b1-4f9c5d5c19a2\") " pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.584946 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.584911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" Jul 23 21:31:56.718830 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.718806 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b6954f5f6-6d755"] Jul 23 21:31:56.720738 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:31:56.720713 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde25a059_9050_4a6b_91b1_4f9c5d5c19a2.slice/crio-e6a902890aac4b11f767b0f32faeb12db9b24d549deed7226d81e0d674ec3e8a WatchSource:0}: Error finding container e6a902890aac4b11f767b0f32faeb12db9b24d549deed7226d81e0d674ec3e8a: Status 404 returned error can't find the container with id e6a902890aac4b11f767b0f32faeb12db9b24d549deed7226d81e0d674ec3e8a Jul 23 21:31:56.722574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:56.722559 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:31:57.429490 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:57.429452 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" event={"ID":"de25a059-9050-4a6b-91b1-4f9c5d5c19a2","Type":"ContainerStarted","Data":"e6a902890aac4b11f767b0f32faeb12db9b24d549deed7226d81e0d674ec3e8a"} Jul 23 21:31:59.441498 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:59.441460 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" event={"ID":"de25a059-9050-4a6b-91b1-4f9c5d5c19a2","Type":"ContainerStarted","Data":"d6e9f8b81e59e05e465202e2b910dfc9b5849c71f6e976da91cb8359a1228d3c"} Jul 23 21:31:59.441912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:59.441538 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" event={"ID":"de25a059-9050-4a6b-91b1-4f9c5d5c19a2","Type":"ContainerStarted","Data":"275cb04819ded1807e1962d05b724797de44d40a260f2f6c3fbafccff9658e60"} Jul 23 21:31:59.441912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:59.441570 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" event={"ID":"de25a059-9050-4a6b-91b1-4f9c5d5c19a2","Type":"ContainerStarted","Data":"691ac0ef229e8b7278d564b3fac503ee5ac41eaf579071fd7110cf8caf95da35"} Jul 23 21:31:59.465041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:31:59.464998 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b6954f5f6-6d755" podStartSLOduration=1.329796688 podStartE2EDuration="3.464984241s" totalImagesPullingTime="2.135187553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:31:59.462633928 +0000 UTC m=+356.979528986" watchObservedRunningTime="2026-07-23 21:31:59.464984241 +0000 UTC m=+356.981879345" Jul 23 21:32:00.282690 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.282656 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:32:00.285508 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.285486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.299044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.299013 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:32:00.372362 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372327 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372362 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372364 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372387 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372405 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv42t\" (UniqueName: \"kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.372570 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.372476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.473603 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473572 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.473603 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473604 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473676 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473699 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474041 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.473749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv42t\" (UniqueName: \"kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474538 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.474512 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474605 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.474542 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474605 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.474512 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.474717 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.474639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.476227 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.476208 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.476318 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.476208 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.481699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.481677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv42t\" (UniqueName: \"kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t\") pod \"console-5f879c68d9-97zb9\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.596684 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.596613 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:00.725423 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:00.725397 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:32:00.727551 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:32:00.727520 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6924af62_fc41_4aa8_a408_49f1497dae0f.slice/crio-c5990ecd153d0fb54d8ba62be6a0f34cff6a9cedf75c60e9a1e77ab95927d1b6 WatchSource:0}: Error finding container c5990ecd153d0fb54d8ba62be6a0f34cff6a9cedf75c60e9a1e77ab95927d1b6: Status 404 returned error can't find the container with id c5990ecd153d0fb54d8ba62be6a0f34cff6a9cedf75c60e9a1e77ab95927d1b6 Jul 23 21:32:01.451477 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:01.451435 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f879c68d9-97zb9" event={"ID":"6924af62-fc41-4aa8-a408-49f1497dae0f","Type":"ContainerStarted","Data":"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8"} Jul 23 21:32:01.451644 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:01.451534 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f879c68d9-97zb9" event={"ID":"6924af62-fc41-4aa8-a408-49f1497dae0f","Type":"ContainerStarted","Data":"c5990ecd153d0fb54d8ba62be6a0f34cff6a9cedf75c60e9a1e77ab95927d1b6"} Jul 23 21:32:01.471561 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:01.471517 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f879c68d9-97zb9" podStartSLOduration=1.471501912 podStartE2EDuration="1.471501912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:32:01.470237932 +0000 UTC m=+358.987133002" watchObservedRunningTime="2026-07-23 21:32:01.471501912 +0000 UTC m=+358.988396972" Jul 23 21:32:10.596797 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:10.596772 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:10.597182 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:10.596819 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:10.601600 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:10.601579 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:11.496035 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:11.496008 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:32:11.539939 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:11.539907 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:32:36.564045 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.564006 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-688cb44c59-6nh7q" podUID="a2f72d67-27d0-413e-872e-be772e36690c" containerName="console" containerID="cri-o://84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e" gracePeriod=15 Jul 23 21:32:36.801692 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.801672 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:32:36.867016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.866947 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.866996 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867014 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867292 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867029 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867292 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867063 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867292 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867102 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsb5n\" (UniqueName: \"kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867292 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867123 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert\") pod \"a2f72d67-27d0-413e-872e-be772e36690c\" (UID: \"a2f72d67-27d0-413e-872e-be772e36690c\") " Jul 23 21:32:36.867578 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867535 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config" (OuterVolumeSpecName: "console-config") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:32:36.867653 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867598 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:32:36.867653 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867608 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:32:36.867735 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.867704 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:32:36.869373 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.869351 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:32:36.869436 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.869402 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n" (OuterVolumeSpecName: "kube-api-access-dsb5n") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "kube-api-access-dsb5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:32:36.869471 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.869427 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2f72d67-27d0-413e-872e-be772e36690c" (UID: "a2f72d67-27d0-413e-872e-be772e36690c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:32:36.968588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968550 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsb5n\" (UniqueName: \"kubernetes.io/projected/a2f72d67-27d0-413e-872e-be772e36690c-kube-api-access-dsb5n\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968584 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-oauth-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968593 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968602 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-console-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968611 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2f72d67-27d0-413e-872e-be772e36690c-console-oauth-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968619 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-trusted-ca-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:36.968785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:36.968627 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f72d67-27d0-413e-872e-be772e36690c-service-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:32:37.599329 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.599291 2569 generic.go:356] "Generic (PLEG): container finished" podID="a2f72d67-27d0-413e-872e-be772e36690c" containerID="84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e" exitCode=0 Jul 23 21:32:37.599719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.599349 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cb44c59-6nh7q" Jul 23 21:32:37.599719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.599358 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cb44c59-6nh7q" event={"ID":"a2f72d67-27d0-413e-872e-be772e36690c","Type":"ContainerDied","Data":"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e"} Jul 23 21:32:37.599719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.599405 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cb44c59-6nh7q" event={"ID":"a2f72d67-27d0-413e-872e-be772e36690c","Type":"ContainerDied","Data":"d75c101b44b3263ff630c9921c915fb5d7d3682f4edf75d1afc3380fdec0dc45"} Jul 23 21:32:37.599719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.599430 2569 scope.go:117] "RemoveContainer" containerID="84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e" Jul 23 21:32:37.608057 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.608029 2569 scope.go:117] "RemoveContainer" containerID="84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e" Jul 23 21:32:37.608302 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:32:37.608278 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e\": container with ID starting with 84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e not found: ID does not exist" containerID="84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e" Jul 23 21:32:37.608366 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.608311 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e"} err="failed to get container status \"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e\": rpc error: code = NotFound desc = could not find container \"84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e\": container with ID starting with 84e7e244e91e2375385a2bdefdcc85e6c268695524ef022a2ba94d0bba71698e not found: ID does not exist" Jul 23 21:32:37.615664 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.615644 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:32:37.619419 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:37.619401 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688cb44c59-6nh7q"] Jul 23 21:32:39.075354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:32:39.075323 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f72d67-27d0-413e-872e-be772e36690c" path="/var/lib/kubelet/pods/a2f72d67-27d0-413e-872e-be772e36690c/volumes" Jul 23 21:33:11.518727 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.518692 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:33:11.519348 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.519191 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f72d67-27d0-413e-872e-be772e36690c" containerName="console" Jul 23 21:33:11.519348 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.519210 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f72d67-27d0-413e-872e-be772e36690c" containerName="console" Jul 23 21:33:11.519348 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.519346 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f72d67-27d0-413e-872e-be772e36690c" containerName="console" Jul 23 21:33:11.522529 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.522506 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.534730 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.534704 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:33:11.552133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552067 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm8x\" (UniqueName: \"kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552165 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552239 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552304 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.552417 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.552367 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653567 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653567 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653570 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm8x\" (UniqueName: \"kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653809 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653809 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653809 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653641 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653809 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653666 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.653809 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.653702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.654553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.654479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.654553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.654479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.654553 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.654584 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.654854 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.654622 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.656357 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.656335 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.656447 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.656383 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.661369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.661347 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm8x\" (UniqueName: \"kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x\") pod \"console-c776d85-7xtdr\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.832813 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.832727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:11.965373 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:11.965352 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:33:11.967923 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:33:11.967887 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd04cda_08c9_4124_a17b_ab7da321293c.slice/crio-54d2869ed02d4960126aec750dc47fa008e06fe1d168c167772d1e4084a6df89 WatchSource:0}: Error finding container 54d2869ed02d4960126aec750dc47fa008e06fe1d168c167772d1e4084a6df89: Status 404 returned error can't find the container with id 54d2869ed02d4960126aec750dc47fa008e06fe1d168c167772d1e4084a6df89 Jul 23 21:33:12.742701 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:12.742666 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c776d85-7xtdr" event={"ID":"ecd04cda-08c9-4124-a17b-ab7da321293c","Type":"ContainerStarted","Data":"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e"} Jul 23 21:33:12.743052 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:12.742712 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c776d85-7xtdr" event={"ID":"ecd04cda-08c9-4124-a17b-ab7da321293c","Type":"ContainerStarted","Data":"54d2869ed02d4960126aec750dc47fa008e06fe1d168c167772d1e4084a6df89"} Jul 23 21:33:12.761828 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:12.761773 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c776d85-7xtdr" podStartSLOduration=1.7617568810000002 podStartE2EDuration="1.761756881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:33:12.760286725 +0000 UTC m=+430.277181805" watchObservedRunningTime="2026-07-23 21:33:12.761756881 +0000 UTC m=+430.278651941" Jul 23 21:33:21.833374 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:21.833324 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:21.833805 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:21.833394 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:21.838049 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:21.838029 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:22.788188 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:22.788155 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:33:22.831433 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:22.831403 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:33:47.857742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:47.857695 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f879c68d9-97zb9" podUID="6924af62-fc41-4aa8-a408-49f1497dae0f" containerName="console" containerID="cri-o://90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8" gracePeriod=15 Jul 23 21:33:48.100200 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.100176 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:33:48.268169 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268140 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268197 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268228 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268286 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268310 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268360 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv42t\" (UniqueName: \"kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268388 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle\") pod \"6924af62-fc41-4aa8-a408-49f1497dae0f\" (UID: \"6924af62-fc41-4aa8-a408-49f1497dae0f\") " Jul 23 21:33:48.268665 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268644 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:33:48.268717 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268684 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:33:48.268824 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268793 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config" (OuterVolumeSpecName: "console-config") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:33:48.268931 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.268914 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:33:48.270704 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.270676 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t" (OuterVolumeSpecName: "kube-api-access-lv42t") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "kube-api-access-lv42t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:33:48.271022 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.270994 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:33:48.271022 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.271012 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6924af62-fc41-4aa8-a408-49f1497dae0f" (UID: "6924af62-fc41-4aa8-a408-49f1497dae0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:33:48.369495 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369460 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-trusted-ca-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369495 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369490 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369495 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369499 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-oauth-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369750 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369508 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6924af62-fc41-4aa8-a408-49f1497dae0f-console-oauth-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369750 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369516 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-service-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369750 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369525 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6924af62-fc41-4aa8-a408-49f1497dae0f-console-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.369750 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.369533 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv42t\" (UniqueName: \"kubernetes.io/projected/6924af62-fc41-4aa8-a408-49f1497dae0f-kube-api-access-lv42t\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:33:48.896110 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.896059 2569 generic.go:356] "Generic (PLEG): container finished" podID="6924af62-fc41-4aa8-a408-49f1497dae0f" containerID="90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8" exitCode=0 Jul 23 21:33:48.896586 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.896129 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f879c68d9-97zb9" Jul 23 21:33:48.896586 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.896153 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f879c68d9-97zb9" event={"ID":"6924af62-fc41-4aa8-a408-49f1497dae0f","Type":"ContainerDied","Data":"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8"} Jul 23 21:33:48.896586 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.896210 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f879c68d9-97zb9" event={"ID":"6924af62-fc41-4aa8-a408-49f1497dae0f","Type":"ContainerDied","Data":"c5990ecd153d0fb54d8ba62be6a0f34cff6a9cedf75c60e9a1e77ab95927d1b6"} Jul 23 21:33:48.896586 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.896231 2569 scope.go:117] "RemoveContainer" containerID="90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8" Jul 23 21:33:48.905029 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.905015 2569 scope.go:117] "RemoveContainer" containerID="90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8" Jul 23 21:33:48.905297 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:33:48.905276 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8\": container with ID starting with 90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8 not found: ID does not exist" containerID="90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8" Jul 23 21:33:48.905402 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.905301 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8"} err="failed to get container status \"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8\": rpc error: code = NotFound desc = could not find container \"90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8\": container with ID starting with 90ce51f05a4327ef34ca386a4ed64636788621f4dab39270136fb9b82d5784a8 not found: ID does not exist" Jul 23 21:33:48.917032 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.917008 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:33:48.920761 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:48.920739 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f879c68d9-97zb9"] Jul 23 21:33:49.075092 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:33:49.075053 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6924af62-fc41-4aa8-a408-49f1497dae0f" path="/var/lib/kubelet/pods/6924af62-fc41-4aa8-a408-49f1497dae0f/volumes" Jul 23 21:34:20.082675 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.082639 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk"] Jul 23 21:34:20.083106 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.082980 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6924af62-fc41-4aa8-a408-49f1497dae0f" containerName="console" Jul 23 21:34:20.083106 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.082990 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6924af62-fc41-4aa8-a408-49f1497dae0f" containerName="console" Jul 23 21:34:20.083106 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.083038 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6924af62-fc41-4aa8-a408-49f1497dae0f" containerName="console" Jul 23 21:34:20.086874 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.086859 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.091330 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.091309 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dkvzj\"" Jul 23 21:34:20.091575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.091557 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 21:34:20.092477 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.092460 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 21:34:20.104746 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.104723 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk"] Jul 23 21:34:20.119023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.118989 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.119209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.119173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmvk\" (UniqueName: \"kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.119307 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.119288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.220714 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.220658 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.220915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.220750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmvk\" (UniqueName: \"kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.220915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.220808 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.221159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.221029 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.221218 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.221186 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.232149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.232122 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmvk\" (UniqueName: \"kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.396296 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.396214 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:20.530228 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:20.530204 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk"] Jul 23 21:34:20.532235 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:34:20.532205 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f140b8e_c682_465b_8046_7c659e911afd.slice/crio-1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd WatchSource:0}: Error finding container 1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd: Status 404 returned error can't find the container with id 1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd Jul 23 21:34:21.023250 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:21.023214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" event={"ID":"0f140b8e-c682-465b-8046-7c659e911afd","Type":"ContainerStarted","Data":"1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd"} Jul 23 21:34:27.058007 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:27.057973 2569 generic.go:356] "Generic (PLEG): container finished" podID="0f140b8e-c682-465b-8046-7c659e911afd" containerID="37b6f9ac5da32945105ac91808a6e7fd92aae46f5481629653ec1aab0f93536f" exitCode=0 Jul 23 21:34:27.058470 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:27.058067 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" event={"ID":"0f140b8e-c682-465b-8046-7c659e911afd","Type":"ContainerDied","Data":"37b6f9ac5da32945105ac91808a6e7fd92aae46f5481629653ec1aab0f93536f"} Jul 23 21:34:30.073256 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:30.073220 2569 generic.go:356] "Generic (PLEG): container finished" podID="0f140b8e-c682-465b-8046-7c659e911afd" containerID="c940c0eedbc3bb9654e689025c3ff98c045b2f673be881e2cc9a27f380711773" exitCode=0 Jul 23 21:34:30.073787 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:30.073321 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" event={"ID":"0f140b8e-c682-465b-8046-7c659e911afd","Type":"ContainerDied","Data":"c940c0eedbc3bb9654e689025c3ff98c045b2f673be881e2cc9a27f380711773"} Jul 23 21:34:37.105552 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:37.105519 2569 generic.go:356] "Generic (PLEG): container finished" podID="0f140b8e-c682-465b-8046-7c659e911afd" containerID="4dcb00b82cd09002de2b37651cf16313584bf41a209810dae89d2a2388937e0b" exitCode=0 Jul 23 21:34:37.105908 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:37.105599 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" event={"ID":"0f140b8e-c682-465b-8046-7c659e911afd","Type":"ContainerDied","Data":"4dcb00b82cd09002de2b37651cf16313584bf41a209810dae89d2a2388937e0b"} Jul 23 21:34:38.232672 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.232649 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:38.383900 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.383818 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util\") pod \"0f140b8e-c682-465b-8046-7c659e911afd\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " Jul 23 21:34:38.383900 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.383867 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle\") pod \"0f140b8e-c682-465b-8046-7c659e911afd\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " Jul 23 21:34:38.384098 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.383920 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvmvk\" (UniqueName: \"kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk\") pod \"0f140b8e-c682-465b-8046-7c659e911afd\" (UID: \"0f140b8e-c682-465b-8046-7c659e911afd\") " Jul 23 21:34:38.384563 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.384532 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle" (OuterVolumeSpecName: "bundle") pod "0f140b8e-c682-465b-8046-7c659e911afd" (UID: "0f140b8e-c682-465b-8046-7c659e911afd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:34:38.386220 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.386199 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk" (OuterVolumeSpecName: "kube-api-access-rvmvk") pod "0f140b8e-c682-465b-8046-7c659e911afd" (UID: "0f140b8e-c682-465b-8046-7c659e911afd"). InnerVolumeSpecName "kube-api-access-rvmvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:34:38.389711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.389681 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util" (OuterVolumeSpecName: "util") pod "0f140b8e-c682-465b-8046-7c659e911afd" (UID: "0f140b8e-c682-465b-8046-7c659e911afd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:34:38.485513 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.485476 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvmvk\" (UniqueName: \"kubernetes.io/projected/0f140b8e-c682-465b-8046-7c659e911afd-kube-api-access-rvmvk\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:38.485513 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.485509 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:38.485513 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:38.485519 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f140b8e-c682-465b-8046-7c659e911afd-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:39.115857 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:39.115832 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" Jul 23 21:34:39.116008 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:39.115814 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409kwmk" event={"ID":"0f140b8e-c682-465b-8046-7c659e911afd","Type":"ContainerDied","Data":"1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd"} Jul 23 21:34:39.116008 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:39.115958 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e4b70f0d4f521aa22b1731624bb41c6df29effc74b73d999e448b90dcab2bfd" Jul 23 21:34:43.239616 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239583 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl"] Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239948 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="pull" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239962 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="pull" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239973 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="util" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239978 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="util" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239986 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="extract" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.239990 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="extract" Jul 23 21:34:43.240083 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.240059 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f140b8e-c682-465b-8046-7c659e911afd" containerName="extract" Jul 23 21:34:43.282909 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.282885 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl"] Jul 23 21:34:43.283054 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.282971 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.286424 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.286400 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 23 21:34:43.286558 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.286445 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kjgcr\"" Jul 23 21:34:43.286716 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.286701 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:34:43.429192 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.429163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8b7a90-3615-42a7-87ff-471131a1b63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.429192 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.429205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74vs\" (UniqueName: \"kubernetes.io/projected/da8b7a90-3615-42a7-87ff-471131a1b63e-kube-api-access-f74vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.529949 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.529923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8b7a90-3615-42a7-87ff-471131a1b63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.530135 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.529965 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74vs\" (UniqueName: \"kubernetes.io/projected/da8b7a90-3615-42a7-87ff-471131a1b63e-kube-api-access-f74vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.530327 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.530308 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8b7a90-3615-42a7-87ff-471131a1b63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.538452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.538430 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74vs\" (UniqueName: \"kubernetes.io/projected/da8b7a90-3615-42a7-87ff-471131a1b63e-kube-api-access-f74vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rlwl\" (UID: \"da8b7a90-3615-42a7-87ff-471131a1b63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.592346 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.592323 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" Jul 23 21:34:43.725440 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:43.725407 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl"] Jul 23 21:34:43.728960 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:34:43.728936 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b7a90_3615_42a7_87ff_471131a1b63e.slice/crio-0e3205199af04e38833c34046e8ef0fd1df22a721522f987e28928fe5895e903 WatchSource:0}: Error finding container 0e3205199af04e38833c34046e8ef0fd1df22a721522f987e28928fe5895e903: Status 404 returned error can't find the container with id 0e3205199af04e38833c34046e8ef0fd1df22a721522f987e28928fe5895e903 Jul 23 21:34:44.144455 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:44.144420 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" event={"ID":"da8b7a90-3615-42a7-87ff-471131a1b63e","Type":"ContainerStarted","Data":"0e3205199af04e38833c34046e8ef0fd1df22a721522f987e28928fe5895e903"} Jul 23 21:34:45.151808 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:45.151772 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" event={"ID":"da8b7a90-3615-42a7-87ff-471131a1b63e","Type":"ContainerStarted","Data":"9bcb70f3418cbd9c8da097e0b73ba95fec4dbb39906cbe10ee8e69a4fe89b31e"} Jul 23 21:34:45.179902 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:45.179842 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rlwl" podStartSLOduration=0.838123997 podStartE2EDuration="2.179825953s" totalImagesPullingTime="1.341701956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:34:45.177479523 +0000 UTC m=+522.694374583" watchObservedRunningTime="2026-07-23 21:34:45.179825953 +0000 UTC m=+522.696721017" Jul 23 21:34:46.476504 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.476470 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7"] Jul 23 21:34:46.479053 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.479037 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.481628 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.481601 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dkvzj\"" Jul 23 21:34:46.481628 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.481619 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 21:34:46.482738 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.482720 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 21:34:46.495107 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.495084 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7"] Jul 23 21:34:46.657909 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.657870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.658117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.657926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bdg\" (UniqueName: \"kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.658117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.657972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.758798 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.758765 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.758965 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.758820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bdg\" (UniqueName: \"kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.758965 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.758863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.759183 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.759163 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.759255 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.759229 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.768606 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.768583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bdg\" (UniqueName: \"kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.788412 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.788390 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:46.930013 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:46.929984 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7"] Jul 23 21:34:46.931608 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:34:46.931583 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f02d45_c662_4526_a5d4_ff2a922216d5.slice/crio-698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee WatchSource:0}: Error finding container 698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee: Status 404 returned error can't find the container with id 698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee Jul 23 21:34:47.035909 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.035885 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xw76d"] Jul 23 21:34:47.038082 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.038056 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.040853 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.040832 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 21:34:47.040965 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.040954 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wl7gk\"" Jul 23 21:34:47.040965 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.040960 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 21:34:47.051171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.051145 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xw76d"] Jul 23 21:34:47.161609 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.161573 2569 generic.go:356] "Generic (PLEG): container finished" podID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerID="a04f523c80aab9b9f24ce249b7889fae416235d9e50fd4831d3b8f072c3e9632" exitCode=0 Jul 23 21:34:47.161766 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.161636 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" event={"ID":"e2f02d45-c662-4526-a5d4-ff2a922216d5","Type":"ContainerDied","Data":"a04f523c80aab9b9f24ce249b7889fae416235d9e50fd4831d3b8f072c3e9632"} Jul 23 21:34:47.161766 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.161677 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" event={"ID":"e2f02d45-c662-4526-a5d4-ff2a922216d5","Type":"ContainerStarted","Data":"698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee"} Jul 23 21:34:47.162497 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.162387 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.162497 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.162447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9qw\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-kube-api-access-zb9qw\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.263686 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.263655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.263870 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.263706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9qw\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-kube-api-access-zb9qw\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.272448 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.272416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.272569 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.272526 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9qw\" (UniqueName: \"kubernetes.io/projected/190cc3cd-3c48-49b8-821e-68257adf059a-kube-api-access-zb9qw\") pod \"cert-manager-webhook-6486ffd997-xw76d\" (UID: \"190cc3cd-3c48-49b8-821e-68257adf059a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.410108 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.410003 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:47.543971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:47.543945 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xw76d"] Jul 23 21:34:47.544991 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:34:47.544968 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod190cc3cd_3c48_49b8_821e_68257adf059a.slice/crio-04ec1e6d20e7dae25c9abb709bf9c88248bb1dc97cee6747001f581197f6f864 WatchSource:0}: Error finding container 04ec1e6d20e7dae25c9abb709bf9c88248bb1dc97cee6747001f581197f6f864: Status 404 returned error can't find the container with id 04ec1e6d20e7dae25c9abb709bf9c88248bb1dc97cee6747001f581197f6f864 Jul 23 21:34:48.168719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:48.168640 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" event={"ID":"190cc3cd-3c48-49b8-821e-68257adf059a","Type":"ContainerStarted","Data":"04ec1e6d20e7dae25c9abb709bf9c88248bb1dc97cee6747001f581197f6f864"} Jul 23 21:34:50.181089 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:50.181050 2569 generic.go:356] "Generic (PLEG): container finished" podID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerID="7c33e51d1825e4f5db4f26113f4a2a4a3c8be774868a158fb9d3ea4cc8b7fae0" exitCode=0 Jul 23 21:34:50.181588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:50.181144 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" event={"ID":"e2f02d45-c662-4526-a5d4-ff2a922216d5","Type":"ContainerDied","Data":"7c33e51d1825e4f5db4f26113f4a2a4a3c8be774868a158fb9d3ea4cc8b7fae0"} Jul 23 21:34:51.188411 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:51.188382 2569 generic.go:356] "Generic (PLEG): container finished" podID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerID="a3e61c9a0811c3d7d5ed79f0314fd84b7cf1256282d69fb0471bfc431c12a4af" exitCode=0 Jul 23 21:34:51.188824 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:51.188467 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" event={"ID":"e2f02d45-c662-4526-a5d4-ff2a922216d5","Type":"ContainerDied","Data":"a3e61c9a0811c3d7d5ed79f0314fd84b7cf1256282d69fb0471bfc431c12a4af"} Jul 23 21:34:51.189903 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:51.189880 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" event={"ID":"190cc3cd-3c48-49b8-821e-68257adf059a","Type":"ContainerStarted","Data":"547088d676b446d6a60e9a0dc0b736786dac31381c0936674b59bf99ac86df9e"} Jul 23 21:34:51.190013 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:51.190002 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:51.227257 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:51.227213 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" podStartSLOduration=1.483475799 podStartE2EDuration="4.227198767s" totalImagesPullingTime="2.743722968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:34:51.225483169 +0000 UTC m=+528.742378231" watchObservedRunningTime="2026-07-23 21:34:51.227198767 +0000 UTC m=+528.744093826" Jul 23 21:34:52.323458 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.323432 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:52.406418 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.406387 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util\") pod \"e2f02d45-c662-4526-a5d4-ff2a922216d5\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " Jul 23 21:34:52.406568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.406454 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7bdg\" (UniqueName: \"kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg\") pod \"e2f02d45-c662-4526-a5d4-ff2a922216d5\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " Jul 23 21:34:52.406568 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.406497 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle\") pod \"e2f02d45-c662-4526-a5d4-ff2a922216d5\" (UID: \"e2f02d45-c662-4526-a5d4-ff2a922216d5\") " Jul 23 21:34:52.406899 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.406875 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle" (OuterVolumeSpecName: "bundle") pod "e2f02d45-c662-4526-a5d4-ff2a922216d5" (UID: "e2f02d45-c662-4526-a5d4-ff2a922216d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:34:52.408672 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.408648 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg" (OuterVolumeSpecName: "kube-api-access-g7bdg") pod "e2f02d45-c662-4526-a5d4-ff2a922216d5" (UID: "e2f02d45-c662-4526-a5d4-ff2a922216d5"). InnerVolumeSpecName "kube-api-access-g7bdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:34:52.410697 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.410668 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util" (OuterVolumeSpecName: "util") pod "e2f02d45-c662-4526-a5d4-ff2a922216d5" (UID: "e2f02d45-c662-4526-a5d4-ff2a922216d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:34:52.507660 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.507629 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7bdg\" (UniqueName: \"kubernetes.io/projected/e2f02d45-c662-4526-a5d4-ff2a922216d5-kube-api-access-g7bdg\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:52.507660 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.507659 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:52.507844 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:52.507669 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2f02d45-c662-4526-a5d4-ff2a922216d5-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:34:53.200688 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:53.200656 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" Jul 23 21:34:53.200688 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:53.200668 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsgm7" event={"ID":"e2f02d45-c662-4526-a5d4-ff2a922216d5","Type":"ContainerDied","Data":"698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee"} Jul 23 21:34:53.200880 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:53.200716 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="698182d472ebd5bf9848485e6984376646f2a55534895d6afd923c4666a1cfee" Jul 23 21:34:57.197123 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:57.197096 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xw76d" Jul 23 21:34:59.472790 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.472756 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn"] Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473107 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="extract" Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473118 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="extract" Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473130 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="util" Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473136 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="util" Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473142 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="pull" Jul 23 21:34:59.473171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473147 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="pull" Jul 23 21:34:59.473349 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.473228 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f02d45-c662-4526-a5d4-ff2a922216d5" containerName="extract" Jul 23 21:34:59.475384 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.475364 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.478474 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.478446 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qkvbg\"" Jul 23 21:34:59.478588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.478518 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 21:34:59.479622 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.479606 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:34:59.486159 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.486138 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn"] Jul 23 21:34:59.564271 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.564228 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88j4v\" (UniqueName: \"kubernetes.io/projected/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-kube-api-access-88j4v\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.564450 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.564294 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.665007 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.664973 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88j4v\" (UniqueName: \"kubernetes.io/projected/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-kube-api-access-88j4v\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.665191 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.665023 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.665375 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.665358 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.673875 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.673853 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88j4v\" (UniqueName: \"kubernetes.io/projected/7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0-kube-api-access-88j4v\") pod \"openshift-lws-operator-fd8ccff4c-gfkjn\" (UID: \"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.785389 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.785356 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" Jul 23 21:34:59.919574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:34:59.919544 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn"] Jul 23 21:34:59.922883 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:34:59.922856 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fb03f7b_2c2e_4f67_9c3a_187d237bc9e0.slice/crio-6739850d9e0bdf4aaf0a001b4975702cb75ec4fa818fea2d42ea39d8a14c5465 WatchSource:0}: Error finding container 6739850d9e0bdf4aaf0a001b4975702cb75ec4fa818fea2d42ea39d8a14c5465: Status 404 returned error can't find the container with id 6739850d9e0bdf4aaf0a001b4975702cb75ec4fa818fea2d42ea39d8a14c5465 Jul 23 21:35:00.235021 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:00.234935 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" event={"ID":"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0","Type":"ContainerStarted","Data":"6739850d9e0bdf4aaf0a001b4975702cb75ec4fa818fea2d42ea39d8a14c5465"} Jul 23 21:35:02.249226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:02.249187 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" event={"ID":"7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0","Type":"ContainerStarted","Data":"eb714ad09c437148c093f181f8acda4413ad061ebddcbcff006592e439a25bce"} Jul 23 21:35:02.267421 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:02.267379 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gfkjn" podStartSLOduration=1.492676161 podStartE2EDuration="3.267364519s" totalImagesPullingTime="1.774688358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:02.265801833 +0000 UTC m=+539.782696891" watchObservedRunningTime="2026-07-23 21:35:02.267364519 +0000 UTC m=+539.784259577" Jul 23 21:35:07.330025 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.326710 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb"] Jul 23 21:35:07.332346 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.332318 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.335387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.335321 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dkvzj\"" Jul 23 21:35:07.335669 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.335655 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 21:35:07.336551 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.336527 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 21:35:07.336658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.336594 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb"] Jul 23 21:35:07.432993 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.432966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.433168 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.433014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.433168 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.433041 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gklm\" (UniqueName: \"kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.534087 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.534054 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.534219 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.534128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gklm\" (UniqueName: \"kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.534219 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.534185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.534390 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.534373 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.534521 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.534505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.543578 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.543552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gklm\" (UniqueName: \"kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.642752 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.642685 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:07.774117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:07.774092 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb"] Jul 23 21:35:07.776048 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:07.776016 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49991e09_ad76_4dd2_8291_3759d081d966.slice/crio-97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1 WatchSource:0}: Error finding container 97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1: Status 404 returned error can't find the container with id 97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1 Jul 23 21:35:08.278359 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:08.278324 2569 generic.go:356] "Generic (PLEG): container finished" podID="49991e09-ad76-4dd2-8291-3759d081d966" containerID="86878fb3795abd18e6461134dec0ab056cb9f2e823ac89a2984753a9b4671f56" exitCode=0 Jul 23 21:35:08.278557 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:08.278406 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" event={"ID":"49991e09-ad76-4dd2-8291-3759d081d966","Type":"ContainerDied","Data":"86878fb3795abd18e6461134dec0ab056cb9f2e823ac89a2984753a9b4671f56"} Jul 23 21:35:08.278557 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:08.278455 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" event={"ID":"49991e09-ad76-4dd2-8291-3759d081d966","Type":"ContainerStarted","Data":"97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1"} Jul 23 21:35:09.285410 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:09.285374 2569 generic.go:356] "Generic (PLEG): container finished" podID="49991e09-ad76-4dd2-8291-3759d081d966" containerID="88e530e2037286b30be3a2409a9a4e511affac702cf04e5c0a4c337183b9dee2" exitCode=0 Jul 23 21:35:09.285835 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:09.285416 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" event={"ID":"49991e09-ad76-4dd2-8291-3759d081d966","Type":"ContainerDied","Data":"88e530e2037286b30be3a2409a9a4e511affac702cf04e5c0a4c337183b9dee2"} Jul 23 21:35:10.292744 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:10.292710 2569 generic.go:356] "Generic (PLEG): container finished" podID="49991e09-ad76-4dd2-8291-3759d081d966" containerID="9089c9903a9d805d2f0346f08c48762a99125086a21ffde133a9e2a2aee38c5e" exitCode=0 Jul 23 21:35:10.293138 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:10.292796 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" event={"ID":"49991e09-ad76-4dd2-8291-3759d081d966","Type":"ContainerDied","Data":"9089c9903a9d805d2f0346f08c48762a99125086a21ffde133a9e2a2aee38c5e"} Jul 23 21:35:11.448507 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.448477 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:11.571912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.571825 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util\") pod \"49991e09-ad76-4dd2-8291-3759d081d966\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " Jul 23 21:35:11.571912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.571888 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle\") pod \"49991e09-ad76-4dd2-8291-3759d081d966\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " Jul 23 21:35:11.571912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.571906 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gklm\" (UniqueName: \"kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm\") pod \"49991e09-ad76-4dd2-8291-3759d081d966\" (UID: \"49991e09-ad76-4dd2-8291-3759d081d966\") " Jul 23 21:35:11.572673 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.572635 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle" (OuterVolumeSpecName: "bundle") pod "49991e09-ad76-4dd2-8291-3759d081d966" (UID: "49991e09-ad76-4dd2-8291-3759d081d966"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:35:11.574124 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.574101 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm" (OuterVolumeSpecName: "kube-api-access-9gklm") pod "49991e09-ad76-4dd2-8291-3759d081d966" (UID: "49991e09-ad76-4dd2-8291-3759d081d966"). InnerVolumeSpecName "kube-api-access-9gklm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:35:11.577719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.577686 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util" (OuterVolumeSpecName: "util") pod "49991e09-ad76-4dd2-8291-3759d081d966" (UID: "49991e09-ad76-4dd2-8291-3759d081d966"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:35:11.672452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.672417 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:35:11.672452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.672445 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gklm\" (UniqueName: \"kubernetes.io/projected/49991e09-ad76-4dd2-8291-3759d081d966-kube-api-access-9gklm\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:35:11.672452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:11.672457 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49991e09-ad76-4dd2-8291-3759d081d966-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:35:12.304575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:12.304547 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" event={"ID":"49991e09-ad76-4dd2-8291-3759d081d966","Type":"ContainerDied","Data":"97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1"} Jul 23 21:35:12.304742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:12.304591 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97a6a63153836c8ebb195af29945f0abc0dffa44e427c15c84ce17e874f7d2d1" Jul 23 21:35:12.304742 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:12.304598 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff9tgb" Jul 23 21:35:20.605430 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605398 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw"] Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605741 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="pull" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605752 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="pull" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605766 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="util" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605770 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="util" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605777 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="extract" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605783 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="extract" Jul 23 21:35:20.605876 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.605843 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="49991e09-ad76-4dd2-8291-3759d081d966" containerName="extract" Jul 23 21:35:20.611709 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.611685 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.615726 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.615700 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 21:35:20.615726 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.615711 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 21:35:20.616755 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.616737 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 21:35:20.616873 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.616760 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlkxg\"" Jul 23 21:35:20.616873 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.616856 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 21:35:20.635057 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.635029 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw"] Jul 23 21:35:20.745550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.745516 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkkm\" (UniqueName: \"kubernetes.io/projected/0826338c-b9d4-4c8c-b669-5bcca902060c-kube-api-access-ljkkm\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.745550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.745553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.745744 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.745584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.745744 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.745644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.745744 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.745673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.846479 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.846448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.846658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.846494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkkm\" (UniqueName: \"kubernetes.io/projected/0826338c-b9d4-4c8c-b669-5bcca902060c-kube-api-access-ljkkm\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.846658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.846514 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.846658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.846539 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.846658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.846577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.847100 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.847036 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.848893 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.848865 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0826338c-b9d4-4c8c-b669-5bcca902060c-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.849209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.849191 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.849209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.849200 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0826338c-b9d4-4c8c-b669-5bcca902060c-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.858819 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.858766 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkkm\" (UniqueName: \"kubernetes.io/projected/0826338c-b9d4-4c8c-b669-5bcca902060c-kube-api-access-ljkkm\") pod \"opendatahub-operator-controller-manager-75db77d775-56xlw\" (UID: \"0826338c-b9d4-4c8c-b669-5bcca902060c\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:20.922591 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:20.922568 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:21.072402 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:21.072360 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0826338c_b9d4_4c8c_b669_5bcca902060c.slice/crio-502fad27323564c51fe8393c6cbf2c89f1846a67c8a2263839c8f2dea1d43602 WatchSource:0}: Error finding container 502fad27323564c51fe8393c6cbf2c89f1846a67c8a2263839c8f2dea1d43602: Status 404 returned error can't find the container with id 502fad27323564c51fe8393c6cbf2c89f1846a67c8a2263839c8f2dea1d43602 Jul 23 21:35:21.076277 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:21.076257 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw"] Jul 23 21:35:21.346645 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:21.346611 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" event={"ID":"0826338c-b9d4-4c8c-b669-5bcca902060c","Type":"ContainerStarted","Data":"502fad27323564c51fe8393c6cbf2c89f1846a67c8a2263839c8f2dea1d43602"} Jul 23 21:35:25.369528 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:25.369486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" event={"ID":"0826338c-b9d4-4c8c-b669-5bcca902060c","Type":"ContainerStarted","Data":"1392c7c4475d542b329129f5b60675d8c5f84b23c7fd7e38a7272a25fb0c0629"} Jul 23 21:35:26.376356 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:26.376307 2569 generic.go:356] "Generic (PLEG): container finished" podID="0826338c-b9d4-4c8c-b669-5bcca902060c" containerID="1392c7c4475d542b329129f5b60675d8c5f84b23c7fd7e38a7272a25fb0c0629" exitCode=0 Jul 23 21:35:26.376728 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:26.376392 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" event={"ID":"0826338c-b9d4-4c8c-b669-5bcca902060c","Type":"ContainerDied","Data":"1392c7c4475d542b329129f5b60675d8c5f84b23c7fd7e38a7272a25fb0c0629"} Jul 23 21:35:27.382940 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:27.382905 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" event={"ID":"0826338c-b9d4-4c8c-b669-5bcca902060c","Type":"ContainerStarted","Data":"87a9ebb6315b1052e3b2752b7832a8a313d30c7ed1392161761e679062dad182"} Jul 23 21:35:27.383336 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:27.383048 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:27.410209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:27.410160 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" podStartSLOduration=2.7079540079999997 podStartE2EDuration="7.410144845s" totalImagesPullingTime="3.660136176s" totalInitContainerRuntime="1.042054661s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:27.407781343 +0000 UTC m=+564.924676416" watchObservedRunningTime="2026-07-23 21:35:27.410144845 +0000 UTC m=+564.927039904" Jul 23 21:35:38.390382 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.390356 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-56xlw" Jul 23 21:35:38.400688 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.400665 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm"] Jul 23 21:35:38.408893 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.408873 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.412941 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.412922 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 21:35:38.413026 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.412993 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 21:35:38.413068 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.413017 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hbfs9\"" Jul 23 21:35:38.413131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.413099 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 21:35:38.418444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.418421 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm"] Jul 23 21:35:38.505426 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.505386 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46b8b42-2677-478a-8c22-805554082dde-manager-config\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.505579 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.505533 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbkt\" (UniqueName: \"kubernetes.io/projected/f46b8b42-2677-478a-8c22-805554082dde-kube-api-access-skbkt\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.505619 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.505584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.505657 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.505641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-metrics-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.606575 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.606540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-metrics-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.606712 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.606636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46b8b42-2677-478a-8c22-805554082dde-manager-config\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.606712 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.606653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skbkt\" (UniqueName: \"kubernetes.io/projected/f46b8b42-2677-478a-8c22-805554082dde-kube-api-access-skbkt\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.606712 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.606684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.607351 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.607327 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46b8b42-2677-478a-8c22-805554082dde-manager-config\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.609293 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.609265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-metrics-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.609374 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.609309 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46b8b42-2677-478a-8c22-805554082dde-cert\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.615260 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.615242 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbkt\" (UniqueName: \"kubernetes.io/projected/f46b8b42-2677-478a-8c22-805554082dde-kube-api-access-skbkt\") pod \"lws-controller-manager-746c6b6887-8jvvm\" (UID: \"f46b8b42-2677-478a-8c22-805554082dde\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.718556 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.718490 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:38.854408 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:38.854368 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm"] Jul 23 21:35:38.858219 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:38.858194 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46b8b42_2677_478a_8c22_805554082dde.slice/crio-517b12b88f8048eac28e1df2129582c44537416f050e91ab0f6b0999b78f623a WatchSource:0}: Error finding container 517b12b88f8048eac28e1df2129582c44537416f050e91ab0f6b0999b78f623a: Status 404 returned error can't find the container with id 517b12b88f8048eac28e1df2129582c44537416f050e91ab0f6b0999b78f623a Jul 23 21:35:39.442026 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:39.441994 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" event={"ID":"f46b8b42-2677-478a-8c22-805554082dde","Type":"ContainerStarted","Data":"517b12b88f8048eac28e1df2129582c44537416f050e91ab0f6b0999b78f623a"} Jul 23 21:35:48.215017 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.214985 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv"] Jul 23 21:35:48.219881 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.219855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.222711 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.222692 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-v6wz9\"" Jul 23 21:35:48.222799 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.222691 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 21:35:48.232525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.232500 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv"] Jul 23 21:35:48.294683 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294719 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23f78a53-824c-44d0-8413-4b528d3b5018-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294753 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7t6b\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-kube-api-access-t7t6b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294847 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.294871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23f78a53-824c-44d0-8413-4b528d3b5018-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.295261 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.294912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396418 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396376 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7t6b\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-kube-api-access-t7t6b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396587 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396485 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396587 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396587 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396543 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396737 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23f78a53-824c-44d0-8413-4b528d3b5018-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396793 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396760 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396804 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396901 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396867 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396901 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23f78a53-824c-44d0-8413-4b528d3b5018-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.396999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.396961 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.397185 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.397160 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.397360 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.397214 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.397605 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.397586 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23f78a53-824c-44d0-8413-4b528d3b5018-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.399818 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.399793 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23f78a53-824c-44d0-8413-4b528d3b5018-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.400037 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.400019 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23f78a53-824c-44d0-8413-4b528d3b5018-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.417392 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.417366 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.424619 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.424594 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7t6b\" (UniqueName: \"kubernetes.io/projected/23f78a53-824c-44d0-8413-4b528d3b5018-kube-api-access-t7t6b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9lbv\" (UID: \"23f78a53-824c-44d0-8413-4b528d3b5018\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.530398 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.530368 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:48.670983 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:48.670954 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv"] Jul 23 21:35:48.673700 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:48.673671 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f78a53_824c_44d0_8413_4b528d3b5018.slice/crio-ab248b488e6b8e4d6e4b84f78d3c6d1506af318c1d140242a57f13aa62c43585 WatchSource:0}: Error finding container ab248b488e6b8e4d6e4b84f78d3c6d1506af318c1d140242a57f13aa62c43585: Status 404 returned error can't find the container with id ab248b488e6b8e4d6e4b84f78d3c6d1506af318c1d140242a57f13aa62c43585 Jul 23 21:35:49.493863 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:49.493824 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" event={"ID":"23f78a53-824c-44d0-8413-4b528d3b5018","Type":"ContainerStarted","Data":"ab248b488e6b8e4d6e4b84f78d3c6d1506af318c1d140242a57f13aa62c43585"} Jul 23 21:35:51.223469 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.223413 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 21:35:51.223747 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.223505 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 21:35:51.223747 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.223534 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 21:35:51.509333 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.509246 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" event={"ID":"23f78a53-824c-44d0-8413-4b528d3b5018","Type":"ContainerStarted","Data":"f8229e4081f23ea45435de8afeee544fd8e5dd36a68680bdf6b50c4d98772bd9"} Jul 23 21:35:51.531433 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.531401 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:51.544961 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:51.544839 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" podStartSLOduration=0.997199145 podStartE2EDuration="3.544817627s" totalImagesPullingTime="2.547618482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:51.544114652 +0000 UTC m=+589.061009708" watchObservedRunningTime="2026-07-23 21:35:51.544817627 +0000 UTC m=+589.061712667" Jul 23 21:35:52.521248 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.521207 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" event={"ID":"f46b8b42-2677-478a-8c22-805554082dde","Type":"ContainerStarted","Data":"5c748143c973f3c04ff05200ea4ee1e7727383ef970bca2979d56aada6dab916"} Jul 23 21:35:52.536641 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.536614 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:52.540546 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.540492 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" podStartSLOduration=1.2189440089999999 podStartE2EDuration="14.540476933s" totalImagesPullingTime="13.321532924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:52.53943862 +0000 UTC m=+590.056333684" watchObservedRunningTime="2026-07-23 21:35:52.540476933 +0000 UTC m=+590.057371985" Jul 23 21:35:52.570905 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.570872 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxljn"] Jul 23 21:35:52.574949 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.574922 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:52.577404 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.577378 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c"] Jul 23 21:35:52.577526 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.577512 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 23 21:35:52.577687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.577672 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mj8d8\"" Jul 23 21:35:52.580705 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.580687 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.584751 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.584723 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 23 21:35:52.585102 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.584980 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7w2b6\"" Jul 23 21:35:52.588295 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.588271 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxljn"] Jul 23 21:35:52.602958 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.602932 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c"] Jul 23 21:35:52.643043 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.643012 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:52.643043 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.643046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.643284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.643097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmxpn\" (UniqueName: \"kubernetes.io/projected/3ade8af3-ab84-4349-82d9-6b26fe99928b-kube-api-access-hmxpn\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.643284 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.643253 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9jq\" (UniqueName: \"kubernetes.io/projected/b4131d71-5625-4c54-88bb-72d284226976-kube-api-access-rn9jq\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:52.744439 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.744399 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9jq\" (UniqueName: \"kubernetes.io/projected/b4131d71-5625-4c54-88bb-72d284226976-kube-api-access-rn9jq\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:52.744610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.744501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:52.744610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.744526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.744610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.744551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmxpn\" (UniqueName: \"kubernetes.io/projected/3ade8af3-ab84-4349-82d9-6b26fe99928b-kube-api-access-hmxpn\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.744768 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:35:52.744635 2569 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 23 21:35:52.744768 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:35:52.744677 2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 23 21:35:52.744768 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:35:52.744724 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert podName:b4131d71-5625-4c54-88bb-72d284226976 nodeName:}" failed. No retries permitted until 2026-07-23 21:35:53.244702032 +0000 UTC m=+590.761597068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert") pod "kserve-controller-manager-d6f4b65b8-rxljn" (UID: "b4131d71-5625-4c54-88bb-72d284226976") : secret "kserve-webhook-server-cert" not found Jul 23 21:35:52.744768 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:35:52.744751 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert podName:3ade8af3-ab84-4349-82d9-6b26fe99928b nodeName:}" failed. No retries permitted until 2026-07-23 21:35:53.244732453 +0000 UTC m=+590.761627513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert") pod "llmisvc-controller-manager-777c6bd7d5-tqq7c" (UID: "3ade8af3-ab84-4349-82d9-6b26fe99928b") : secret "llmisvc-webhook-server-cert" not found Jul 23 21:35:52.768945 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.768915 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmxpn\" (UniqueName: \"kubernetes.io/projected/3ade8af3-ab84-4349-82d9-6b26fe99928b-kube-api-access-hmxpn\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:52.771793 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:52.771729 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9jq\" (UniqueName: \"kubernetes.io/projected/b4131d71-5625-4c54-88bb-72d284226976-kube-api-access-rn9jq\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:53.248671 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.248642 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:53.248671 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.248674 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:53.251421 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.251392 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4131d71-5625-4c54-88bb-72d284226976-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxljn\" (UID: \"b4131d71-5625-4c54-88bb-72d284226976\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:53.251538 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.251437 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ade8af3-ab84-4349-82d9-6b26fe99928b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tqq7c\" (UID: \"3ade8af3-ab84-4349-82d9-6b26fe99928b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:53.493597 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.493546 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:53.506612 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.506585 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:53.528327 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.528302 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:35:53.528722 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.528359 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:53.530814 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.529639 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9lbv" Jul 23 21:35:53.659766 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.659720 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxljn"] Jul 23 21:35:53.661557 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:53.661515 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4131d71_5625_4c54_88bb_72d284226976.slice/crio-baae32382a1c80fc0e093b929b7ade37ed8a79ec57ddede8dd8de92bdc2361c7 WatchSource:0}: Error finding container baae32382a1c80fc0e093b929b7ade37ed8a79ec57ddede8dd8de92bdc2361c7: Status 404 returned error can't find the container with id baae32382a1c80fc0e093b929b7ade37ed8a79ec57ddede8dd8de92bdc2361c7 Jul 23 21:35:53.689435 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:53.689410 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c"] Jul 23 21:35:53.691235 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:35:53.691201 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ade8af3_ab84_4349_82d9_6b26fe99928b.slice/crio-0924069d01946ab912aa4aa7104547bad1ceedb069c9b582f83200a38d05db63 WatchSource:0}: Error finding container 0924069d01946ab912aa4aa7104547bad1ceedb069c9b582f83200a38d05db63: Status 404 returned error can't find the container with id 0924069d01946ab912aa4aa7104547bad1ceedb069c9b582f83200a38d05db63 Jul 23 21:35:54.551399 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:54.551328 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" event={"ID":"3ade8af3-ab84-4349-82d9-6b26fe99928b","Type":"ContainerStarted","Data":"0924069d01946ab912aa4aa7104547bad1ceedb069c9b582f83200a38d05db63"} Jul 23 21:35:54.553002 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:54.552968 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" event={"ID":"b4131d71-5625-4c54-88bb-72d284226976","Type":"ContainerStarted","Data":"baae32382a1c80fc0e093b929b7ade37ed8a79ec57ddede8dd8de92bdc2361c7"} Jul 23 21:35:56.568594 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:56.568512 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" event={"ID":"b4131d71-5625-4c54-88bb-72d284226976","Type":"ContainerStarted","Data":"e8da7888abaa7cb601a54c764fca4ec3fa91e1934bf357107ba19037cb2ad7ef"} Jul 23 21:35:56.569023 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:56.568659 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:35:56.608060 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:56.607997 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" podStartSLOduration=2.263457281 podStartE2EDuration="4.607975068s" totalImagesPullingTime="2.344517787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:56.606355332 +0000 UTC m=+594.123250391" watchObservedRunningTime="2026-07-23 21:35:56.607975068 +0000 UTC m=+594.124870128" Jul 23 21:35:57.575449 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:57.575404 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" event={"ID":"3ade8af3-ab84-4349-82d9-6b26fe99928b","Type":"ContainerStarted","Data":"58a113c5a01a48f13e550785828dc1398606682cb01fbd5d0506bd2c99af9c48"} Jul 23 21:35:57.575841 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:57.575659 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:35:57.596114 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:35:57.596034 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" podStartSLOduration=2.226303361 podStartE2EDuration="5.59601537s" totalImagesPullingTime="3.369712009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:57.59490641 +0000 UTC m=+595.111801481" watchObservedRunningTime="2026-07-23 21:35:57.59601537 +0000 UTC m=+595.112910430" Jul 23 21:36:02.943612 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:02.943584 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:36:02.944145 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:02.943584 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:36:02.950116 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:02.950096 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:36:02.950236 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:02.950170 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:36:04.558488 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:04.558460 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-8jvvm" Jul 23 21:36:27.580457 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:27.580382 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxljn" Jul 23 21:36:28.582631 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:28.582597 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tqq7c" Jul 23 21:36:57.813299 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.813267 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk"] Jul 23 21:36:57.816257 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.816240 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:57.822829 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.822780 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 21:36:57.822829 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.822810 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-846n7\"" Jul 23 21:36:57.823781 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.823760 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 21:36:57.828601 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.828575 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk"] Jul 23 21:36:57.912975 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.912943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:57.913206 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.912982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt2qs\" (UniqueName: \"kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:57.913206 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:57.913133 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.013645 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.013613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.013819 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.013689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.013819 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.013718 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2qs\" (UniqueName: \"kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.014205 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.014177 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.014282 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.014183 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.022355 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.022329 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt2qs\" (UniqueName: \"kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.125877 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.125789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:36:58.280525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.280487 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk"] Jul 23 21:36:58.281615 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:36:58.281591 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695cf79a_65ff_4f35_8aad_b459956f53b9.slice/crio-3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e WatchSource:0}: Error finding container 3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e: Status 404 returned error can't find the container with id 3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e Jul 23 21:36:58.428719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.428688 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj"] Jul 23 21:36:58.432011 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.431992 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.443705 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.443682 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj"] Jul 23 21:36:58.518957 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.518923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.519133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.519008 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.519133 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.519052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzcs\" (UniqueName: \"kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.620266 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.620227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.620431 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.620284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzcs\" (UniqueName: \"kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.620431 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.620314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.620621 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.620604 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.620658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.620639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.631945 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.631923 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzcs\" (UniqueName: \"kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.754229 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.754199 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:36:58.889135 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.889097 2569 generic.go:356] "Generic (PLEG): container finished" podID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerID="aaca74064092609df481865485b241d4051075e7441040a6fb8e6512624a6d7b" exitCode=0 Jul 23 21:36:58.890610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.889503 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" event={"ID":"695cf79a-65ff-4f35-8aad-b459956f53b9","Type":"ContainerDied","Data":"aaca74064092609df481865485b241d4051075e7441040a6fb8e6512624a6d7b"} Jul 23 21:36:58.890610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.889562 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" event={"ID":"695cf79a-65ff-4f35-8aad-b459956f53b9","Type":"ContainerStarted","Data":"3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e"} Jul 23 21:36:58.890610 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.889797 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:36:58.892650 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:58.892630 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj"] Jul 23 21:36:58.894652 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:36:58.894624 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541d142f_3796_444c_8afb_9ee79df47b18.slice/crio-fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43 WatchSource:0}: Error finding container fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43: Status 404 returned error can't find the container with id fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43 Jul 23 21:36:59.019016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.018982 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg"] Jul 23 21:36:59.022359 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.022341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.031338 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.031309 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg"] Jul 23 21:36:59.125717 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.125679 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.125896 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.125841 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.125896 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.125883 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqnx\" (UniqueName: \"kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.226504 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.226464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.226699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.226529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.226699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.226554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqnx\" (UniqueName: \"kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.226871 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.226848 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.226937 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.226881 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.236184 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.236155 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqnx\" (UniqueName: \"kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.369061 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.368978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:36:59.507142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.507117 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg"] Jul 23 21:36:59.509100 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:36:59.509050 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8759c3e0_c0c5_4db7_91d2_4ed4d3e82265.slice/crio-6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da WatchSource:0}: Error finding container 6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da: Status 404 returned error can't find the container with id 6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da Jul 23 21:36:59.618791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.618756 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf"] Jul 23 21:36:59.622839 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.622770 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.638763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.638731 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf"] Jul 23 21:36:59.731302 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.731279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.731412 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.731367 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qx5\" (UniqueName: \"kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.731473 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.731428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.832309 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.832268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.832451 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.832327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.832451 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.832377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qx5\" (UniqueName: \"kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.832745 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.832721 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.832789 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.832731 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.842246 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.842224 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qx5\" (UniqueName: \"kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:36:59.896254 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.896166 2569 generic.go:356] "Generic (PLEG): container finished" podID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerID="4252b4a673e122f88474c3dd2be4e78b993121cd8da09db2212442d4554d046e" exitCode=0 Jul 23 21:36:59.896650 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.896253 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" event={"ID":"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265","Type":"ContainerDied","Data":"4252b4a673e122f88474c3dd2be4e78b993121cd8da09db2212442d4554d046e"} Jul 23 21:36:59.896650 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.896304 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" event={"ID":"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265","Type":"ContainerStarted","Data":"6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da"} Jul 23 21:36:59.898306 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.898282 2569 generic.go:356] "Generic (PLEG): container finished" podID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerID="5f57d8e032aa1e9e54d0781fa31290658b9f4e530ac3fbe77c921881b967ba8f" exitCode=0 Jul 23 21:36:59.898421 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.898366 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" event={"ID":"695cf79a-65ff-4f35-8aad-b459956f53b9","Type":"ContainerDied","Data":"5f57d8e032aa1e9e54d0781fa31290658b9f4e530ac3fbe77c921881b967ba8f"} Jul 23 21:36:59.900125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.900058 2569 generic.go:356] "Generic (PLEG): container finished" podID="541d142f-3796-444c-8afb-9ee79df47b18" containerID="8ba51362234d444b879ec8dc804850f3282bd99436713ce4a65aec8961979915" exitCode=0 Jul 23 21:36:59.900125 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.900120 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" event={"ID":"541d142f-3796-444c-8afb-9ee79df47b18","Type":"ContainerDied","Data":"8ba51362234d444b879ec8dc804850f3282bd99436713ce4a65aec8961979915"} Jul 23 21:36:59.900291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.900152 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" event={"ID":"541d142f-3796-444c-8afb-9ee79df47b18","Type":"ContainerStarted","Data":"fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43"} Jul 23 21:36:59.955010 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:36:59.954986 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:37:00.102209 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.102183 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf"] Jul 23 21:37:00.103810 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:37:00.103782 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42819203_1c0c_408e_899b_25b9a14fe707.slice/crio-f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb WatchSource:0}: Error finding container f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb: Status 404 returned error can't find the container with id f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb Jul 23 21:37:00.907328 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.907291 2569 generic.go:356] "Generic (PLEG): container finished" podID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerID="d5562afd379d8d72973ebbcaa933c52c64181e61bd6d3da9363a76e6562edbed" exitCode=0 Jul 23 21:37:00.907708 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.907420 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" event={"ID":"695cf79a-65ff-4f35-8aad-b459956f53b9","Type":"ContainerDied","Data":"d5562afd379d8d72973ebbcaa933c52c64181e61bd6d3da9363a76e6562edbed"} Jul 23 21:37:00.908921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.908900 2569 generic.go:356] "Generic (PLEG): container finished" podID="42819203-1c0c-408e-899b-25b9a14fe707" containerID="703fefcdaa4f8761521036a43a7fd6e24e2d9028c657d44fef361c3e2823affb" exitCode=0 Jul 23 21:37:00.909024 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.908981 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" event={"ID":"42819203-1c0c-408e-899b-25b9a14fe707","Type":"ContainerDied","Data":"703fefcdaa4f8761521036a43a7fd6e24e2d9028c657d44fef361c3e2823affb"} Jul 23 21:37:00.909024 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.909015 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" event={"ID":"42819203-1c0c-408e-899b-25b9a14fe707","Type":"ContainerStarted","Data":"f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb"} Jul 23 21:37:00.911000 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.910978 2569 generic.go:356] "Generic (PLEG): container finished" podID="541d142f-3796-444c-8afb-9ee79df47b18" containerID="31e1459fd6e6b99a7e4b20457c87d7439d97e339c72d39cd2a64ff800651ba95" exitCode=0 Jul 23 21:37:00.911088 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:00.911044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" event={"ID":"541d142f-3796-444c-8afb-9ee79df47b18","Type":"ContainerDied","Data":"31e1459fd6e6b99a7e4b20457c87d7439d97e339c72d39cd2a64ff800651ba95"} Jul 23 21:37:01.918823 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.918786 2569 generic.go:356] "Generic (PLEG): container finished" podID="541d142f-3796-444c-8afb-9ee79df47b18" containerID="566ce9e3edcd849200c21328272744bb08b9bb42a37a47835c578566a52907f2" exitCode=0 Jul 23 21:37:01.919246 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.918862 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" event={"ID":"541d142f-3796-444c-8afb-9ee79df47b18","Type":"ContainerDied","Data":"566ce9e3edcd849200c21328272744bb08b9bb42a37a47835c578566a52907f2"} Jul 23 21:37:01.920710 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.920683 2569 generic.go:356] "Generic (PLEG): container finished" podID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerID="97c2e06b334a15723feac393997f23596bff6073cdb08c633a7018a02bba08a1" exitCode=0 Jul 23 21:37:01.920816 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.920770 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" event={"ID":"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265","Type":"ContainerDied","Data":"97c2e06b334a15723feac393997f23596bff6073cdb08c633a7018a02bba08a1"} Jul 23 21:37:01.922701 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.922680 2569 generic.go:356] "Generic (PLEG): container finished" podID="42819203-1c0c-408e-899b-25b9a14fe707" containerID="0c9a0cf9a1e8befa3ae053a378d06fa38c4d436686693967ad1443e59fa11489" exitCode=0 Jul 23 21:37:01.922792 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:01.922702 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" event={"ID":"42819203-1c0c-408e-899b-25b9a14fe707","Type":"ContainerDied","Data":"0c9a0cf9a1e8befa3ae053a378d06fa38c4d436686693967ad1443e59fa11489"} Jul 23 21:37:02.059189 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.059156 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:37:02.157437 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.157409 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util\") pod \"695cf79a-65ff-4f35-8aad-b459956f53b9\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " Jul 23 21:37:02.157518 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.157445 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt2qs\" (UniqueName: \"kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs\") pod \"695cf79a-65ff-4f35-8aad-b459956f53b9\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " Jul 23 21:37:02.157555 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.157542 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle\") pod \"695cf79a-65ff-4f35-8aad-b459956f53b9\" (UID: \"695cf79a-65ff-4f35-8aad-b459956f53b9\") " Jul 23 21:37:02.158118 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.158086 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle" (OuterVolumeSpecName: "bundle") pod "695cf79a-65ff-4f35-8aad-b459956f53b9" (UID: "695cf79a-65ff-4f35-8aad-b459956f53b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:02.159869 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.159843 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs" (OuterVolumeSpecName: "kube-api-access-xt2qs") pod "695cf79a-65ff-4f35-8aad-b459956f53b9" (UID: "695cf79a-65ff-4f35-8aad-b459956f53b9"). InnerVolumeSpecName "kube-api-access-xt2qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:02.163389 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.163365 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util" (OuterVolumeSpecName: "util") pod "695cf79a-65ff-4f35-8aad-b459956f53b9" (UID: "695cf79a-65ff-4f35-8aad-b459956f53b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:02.258732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.258654 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:02.258732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.258677 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/695cf79a-65ff-4f35-8aad-b459956f53b9-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:02.258732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.258686 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt2qs\" (UniqueName: \"kubernetes.io/projected/695cf79a-65ff-4f35-8aad-b459956f53b9-kube-api-access-xt2qs\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:02.930366 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.930336 2569 generic.go:356] "Generic (PLEG): container finished" podID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerID="53e0944ca2a60d72c9a69fdb6cb17c3d3c9c580bbafcc9f0a8ff2b8e3db98161" exitCode=0 Jul 23 21:37:02.930779 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.930415 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" event={"ID":"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265","Type":"ContainerDied","Data":"53e0944ca2a60d72c9a69fdb6cb17c3d3c9c580bbafcc9f0a8ff2b8e3db98161"} Jul 23 21:37:02.932218 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.932197 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" Jul 23 21:37:02.932218 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.932209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk" event={"ID":"695cf79a-65ff-4f35-8aad-b459956f53b9","Type":"ContainerDied","Data":"3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e"} Jul 23 21:37:02.932494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.932251 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e32354410f1a6a46230877ba54cad5cddf9a4dab0ffc6e5a55d0f95a376da6e" Jul 23 21:37:02.934352 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.934328 2569 generic.go:356] "Generic (PLEG): container finished" podID="42819203-1c0c-408e-899b-25b9a14fe707" containerID="0bdae4bd6e850d82e512f5cef95718b2a399fdf8fdd41c1a4c944e24facd49c4" exitCode=0 Jul 23 21:37:02.934430 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:02.934390 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" event={"ID":"42819203-1c0c-408e-899b-25b9a14fe707","Type":"ContainerDied","Data":"0bdae4bd6e850d82e512f5cef95718b2a399fdf8fdd41c1a4c944e24facd49c4"} Jul 23 21:37:03.073228 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.073201 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:37:03.167329 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.167297 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util\") pod \"541d142f-3796-444c-8afb-9ee79df47b18\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " Jul 23 21:37:03.167514 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.167379 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnzcs\" (UniqueName: \"kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs\") pod \"541d142f-3796-444c-8afb-9ee79df47b18\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " Jul 23 21:37:03.167514 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.167426 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle\") pod \"541d142f-3796-444c-8afb-9ee79df47b18\" (UID: \"541d142f-3796-444c-8afb-9ee79df47b18\") " Jul 23 21:37:03.167906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.167874 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle" (OuterVolumeSpecName: "bundle") pod "541d142f-3796-444c-8afb-9ee79df47b18" (UID: "541d142f-3796-444c-8afb-9ee79df47b18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:03.169680 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.169661 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs" (OuterVolumeSpecName: "kube-api-access-dnzcs") pod "541d142f-3796-444c-8afb-9ee79df47b18" (UID: "541d142f-3796-444c-8afb-9ee79df47b18"). InnerVolumeSpecName "kube-api-access-dnzcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:03.172596 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.172575 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util" (OuterVolumeSpecName: "util") pod "541d142f-3796-444c-8afb-9ee79df47b18" (UID: "541d142f-3796-444c-8afb-9ee79df47b18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:03.268347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.268314 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:03.268347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.268345 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnzcs\" (UniqueName: \"kubernetes.io/projected/541d142f-3796-444c-8afb-9ee79df47b18-kube-api-access-dnzcs\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:03.268535 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.268354 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541d142f-3796-444c-8afb-9ee79df47b18-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:03.942032 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.941994 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" Jul 23 21:37:03.942032 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.942020 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj" event={"ID":"541d142f-3796-444c-8afb-9ee79df47b18","Type":"ContainerDied","Data":"fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43"} Jul 23 21:37:03.942539 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:03.942065 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb27a178a15264be80371f0a3a38e5a926a994fd86ab305fa12bde87cb20eb43" Jul 23 21:37:04.078061 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.078036 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:37:04.107699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.107679 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:37:04.178113 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.178067 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qx5\" (UniqueName: \"kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5\") pod \"42819203-1c0c-408e-899b-25b9a14fe707\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " Jul 23 21:37:04.178267 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.178161 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util\") pod \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " Jul 23 21:37:04.180746 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.178655 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sqnx\" (UniqueName: \"kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx\") pod \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " Jul 23 21:37:04.180746 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.178732 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util\") pod \"42819203-1c0c-408e-899b-25b9a14fe707\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " Jul 23 21:37:04.186249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.181710 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle\") pod \"42819203-1c0c-408e-899b-25b9a14fe707\" (UID: \"42819203-1c0c-408e-899b-25b9a14fe707\") " Jul 23 21:37:04.186249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.181815 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle\") pod \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\" (UID: \"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265\") " Jul 23 21:37:04.186249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.183683 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle" (OuterVolumeSpecName: "bundle") pod "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" (UID: "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:04.186485 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.186258 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util" (OuterVolumeSpecName: "util") pod "42819203-1c0c-408e-899b-25b9a14fe707" (UID: "42819203-1c0c-408e-899b-25b9a14fe707"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:04.186705 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.186658 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle" (OuterVolumeSpecName: "bundle") pod "42819203-1c0c-408e-899b-25b9a14fe707" (UID: "42819203-1c0c-408e-899b-25b9a14fe707"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:04.188467 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.188433 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5" (OuterVolumeSpecName: "kube-api-access-x4qx5") pod "42819203-1c0c-408e-899b-25b9a14fe707" (UID: "42819203-1c0c-408e-899b-25b9a14fe707"). InnerVolumeSpecName "kube-api-access-x4qx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:04.188564 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.188456 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx" (OuterVolumeSpecName: "kube-api-access-7sqnx") pod "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" (UID: "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265"). InnerVolumeSpecName "kube-api-access-7sqnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:04.191983 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.191958 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util" (OuterVolumeSpecName: "util") pod "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" (UID: "8759c3e0-c0c5-4db7-91d2-4ed4d3e82265"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:04.282921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282888 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.282921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282920 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sqnx\" (UniqueName: \"kubernetes.io/projected/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-kube-api-access-7sqnx\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.282921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282931 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-util\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.283194 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282940 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42819203-1c0c-408e-899b-25b9a14fe707-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.283194 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282948 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8759c3e0-c0c5-4db7-91d2-4ed4d3e82265-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.283194 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.282956 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qx5\" (UniqueName: \"kubernetes.io/projected/42819203-1c0c-408e-899b-25b9a14fe707-kube-api-access-x4qx5\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:04.949446 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.949418 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" Jul 23 21:37:04.949446 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.949438 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg" event={"ID":"8759c3e0-c0c5-4db7-91d2-4ed4d3e82265","Type":"ContainerDied","Data":"6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da"} Jul 23 21:37:04.949889 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.949522 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fadc8ef926dc8569cab57a62ac81408e039fe0be7e5e150f0a20a572c2267da" Jul 23 21:37:04.951647 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.951628 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" Jul 23 21:37:04.951769 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.951644 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf" event={"ID":"42819203-1c0c-408e-899b-25b9a14fe707","Type":"ContainerDied","Data":"f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb"} Jul 23 21:37:04.951769 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:04.951689 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f98725f01265ed45506bf6eadbe96cd02204fae0dac4470eea5f25fdacd7cbbb" Jul 23 21:37:07.264173 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264140 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c76666c9-5jqnb"] Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264513 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="pull" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264528 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="pull" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264535 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="extract" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264541 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="extract" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264559 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="pull" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264569 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="pull" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264578 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="extract" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264583 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="extract" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264591 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="extract" Jul 23 21:37:07.264599 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264600 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264614 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264620 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264627 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264633 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264649 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264654 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264662 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264670 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264683 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="pull" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264690 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="pull" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264701 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264708 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="util" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264716 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="pull" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264723 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="pull" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.264990 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="541d142f-3796-444c-8afb-9ee79df47b18" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.265006 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8759c3e0-c0c5-4db7-91d2-4ed4d3e82265" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.265018 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="42819203-1c0c-408e-899b-25b9a14fe707" containerName="extract" Jul 23 21:37:07.265235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.265028 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="695cf79a-65ff-4f35-8aad-b459956f53b9" containerName="extract" Jul 23 21:37:07.269999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.269979 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.280315 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.280291 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c76666c9-5jqnb"] Jul 23 21:37:07.413479 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-trusted-ca-bundle\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413479 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-service-ca\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-oauth-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-oauth-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413596 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.413687 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.413628 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwjh\" (UniqueName: \"kubernetes.io/projected/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-kube-api-access-rkwjh\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.514923 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.514830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.514923 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.514872 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.514923 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.514898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwjh\" (UniqueName: \"kubernetes.io/projected/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-kube-api-access-rkwjh\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.514969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-trusted-ca-bundle\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.514994 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-service-ca\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-oauth-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515043 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-oauth-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515723 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515689 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515825 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515775 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-service-ca\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515825 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515800 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-trusted-ca-bundle\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.515825 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.515779 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-oauth-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.517541 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.517522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-oauth-config\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.517920 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.517906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-console-serving-cert\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.523823 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.523804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwjh\" (UniqueName: \"kubernetes.io/projected/d53215fd-e1fa-4366-b0e1-e847c6ff4e2b-kube-api-access-rkwjh\") pod \"console-68c76666c9-5jqnb\" (UID: \"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b\") " pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.581042 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.581010 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:07.720242 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.720213 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c76666c9-5jqnb"] Jul 23 21:37:07.721650 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:37:07.721625 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53215fd_e1fa_4366_b0e1_e847c6ff4e2b.slice/crio-ba1e52a47ca798ba71aca878c0120fa74644784da997584690b864f9f29d1fd7 WatchSource:0}: Error finding container ba1e52a47ca798ba71aca878c0120fa74644784da997584690b864f9f29d1fd7: Status 404 returned error can't find the container with id ba1e52a47ca798ba71aca878c0120fa74644784da997584690b864f9f29d1fd7 Jul 23 21:37:07.968592 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.968560 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c76666c9-5jqnb" event={"ID":"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b","Type":"ContainerStarted","Data":"6f4841adef0a41714a886c2d14630cd48db1e97066076a8aadc921eba525ad2d"} Jul 23 21:37:07.968769 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.968607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c76666c9-5jqnb" event={"ID":"d53215fd-e1fa-4366-b0e1-e847c6ff4e2b","Type":"ContainerStarted","Data":"ba1e52a47ca798ba71aca878c0120fa74644784da997584690b864f9f29d1fd7"} Jul 23 21:37:07.989250 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:07.989201 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c76666c9-5jqnb" podStartSLOduration=0.989185446 podStartE2EDuration="989.185446ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:07.988107986 +0000 UTC m=+665.505003034" watchObservedRunningTime="2026-07-23 21:37:07.989185446 +0000 UTC m=+665.506080505" Jul 23 21:37:17.581710 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:17.581683 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:17.582104 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:17.581759 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:17.586529 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:17.586506 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:18.027869 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:18.027845 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c76666c9-5jqnb" Jul 23 21:37:18.078249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:18.078214 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:37:21.791671 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.791637 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v"] Jul 23 21:37:21.795420 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.795399 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:21.800253 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.800235 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 21:37:21.801371 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.801347 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 21:37:21.801476 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.801349 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zkvp2\"" Jul 23 21:37:21.814148 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.814124 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v"] Jul 23 21:37:21.836521 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.836487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27\") pod \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" (UID: \"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:21.937461 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.937430 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27\") pod \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" (UID: \"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:21.951252 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:21.951221 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27\") pod \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" (UID: \"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:22.105900 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:22.105813 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:22.243184 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:22.243152 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v"] Jul 23 21:37:22.244989 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:37:22.244965 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ea4d7f_1986_4a0f_8f44_82b1564f4a03.slice/crio-53ebeddd7a8182a47aecbd086610536094ecaa7284f2a03dc1eb29cb4308f907 WatchSource:0}: Error finding container 53ebeddd7a8182a47aecbd086610536094ecaa7284f2a03dc1eb29cb4308f907: Status 404 returned error can't find the container with id 53ebeddd7a8182a47aecbd086610536094ecaa7284f2a03dc1eb29cb4308f907 Jul 23 21:37:23.054456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:23.054423 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" event={"ID":"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03","Type":"ContainerStarted","Data":"53ebeddd7a8182a47aecbd086610536094ecaa7284f2a03dc1eb29cb4308f907"} Jul 23 21:37:25.075150 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:25.075117 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" event={"ID":"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03","Type":"ContainerStarted","Data":"dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3"} Jul 23 21:37:25.075505 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:25.075172 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:25.088150 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:25.088097 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" podStartSLOduration=2.0482942140000002 podStartE2EDuration="4.088059518s" totalImagesPullingTime="2.039765304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:25.086194261 +0000 UTC m=+682.603089320" watchObservedRunningTime="2026-07-23 21:37:25.088059518 +0000 UTC m=+682.604954577" Jul 23 21:37:36.077094 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:36.077049 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:43.102576 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.102540 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c776d85-7xtdr" podUID="ecd04cda-08c9-4124-a17b-ab7da321293c" containerName="console" containerID="cri-o://f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e" gracePeriod=15 Jul 23 21:37:43.351614 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.351592 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:37:43.429832 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429758 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.429832 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429793 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.429832 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429828 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.430127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429864 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.430127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429922 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmm8x\" (UniqueName: \"kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.430127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429939 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.430127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.429971 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config\") pod \"ecd04cda-08c9-4124-a17b-ab7da321293c\" (UID: \"ecd04cda-08c9-4124-a17b-ab7da321293c\") " Jul 23 21:37:43.430377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.430242 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:37:43.430377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.430268 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:37:43.430377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.430342 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config" (OuterVolumeSpecName: "console-config") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:37:43.430767 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.430742 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:37:43.432205 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.432171 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:37:43.432289 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.432226 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:37:43.432289 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.432265 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x" (OuterVolumeSpecName: "kube-api-access-lmm8x") pod "ecd04cda-08c9-4124-a17b-ab7da321293c" (UID: "ecd04cda-08c9-4124-a17b-ab7da321293c"). InnerVolumeSpecName "kube-api-access-lmm8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:43.531055 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531026 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-service-ca\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531055 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531053 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-oauth-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531067 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmm8x\" (UniqueName: \"kubernetes.io/projected/ecd04cda-08c9-4124-a17b-ab7da321293c-kube-api-access-lmm8x\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531107 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-console-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531119 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-oauth-config\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531131 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd04cda-08c9-4124-a17b-ab7da321293c-trusted-ca-bundle\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:43.531251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:43.531143 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd04cda-08c9-4124-a17b-ab7da321293c-console-serving-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:44.184928 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.184895 2569 generic.go:356] "Generic (PLEG): container finished" podID="ecd04cda-08c9-4124-a17b-ab7da321293c" containerID="f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e" exitCode=0 Jul 23 21:37:44.185369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.184951 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c776d85-7xtdr" Jul 23 21:37:44.185369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.184985 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c776d85-7xtdr" event={"ID":"ecd04cda-08c9-4124-a17b-ab7da321293c","Type":"ContainerDied","Data":"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e"} Jul 23 21:37:44.185369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.185050 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c776d85-7xtdr" event={"ID":"ecd04cda-08c9-4124-a17b-ab7da321293c","Type":"ContainerDied","Data":"54d2869ed02d4960126aec750dc47fa008e06fe1d168c167772d1e4084a6df89"} Jul 23 21:37:44.185369 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.185090 2569 scope.go:117] "RemoveContainer" containerID="f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e" Jul 23 21:37:44.194634 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.194618 2569 scope.go:117] "RemoveContainer" containerID="f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e" Jul 23 21:37:44.194889 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:44.194869 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e\": container with ID starting with f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e not found: ID does not exist" containerID="f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e" Jul 23 21:37:44.194956 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.194897 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e"} err="failed to get container status \"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e\": rpc error: code = NotFound desc = could not find container \"f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e\": container with ID starting with f491ef7f9ebe7a2f23b73086d1ec165bf758d94aaec9c289419da7093b73d91e not found: ID does not exist" Jul 23 21:37:44.218456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.218420 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:37:44.226525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.226501 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c776d85-7xtdr"] Jul 23 21:37:44.872513 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.872477 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh"] Jul 23 21:37:44.872926 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.872909 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd04cda-08c9-4124-a17b-ab7da321293c" containerName="console" Jul 23 21:37:44.873024 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.872928 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd04cda-08c9-4124-a17b-ab7da321293c" containerName="console" Jul 23 21:37:44.873117 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.873051 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd04cda-08c9-4124-a17b-ab7da321293c" containerName="console" Jul 23 21:37:44.877363 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.877341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:44.881723 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.881705 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbq99\"" Jul 23 21:37:44.908186 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.908163 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh"] Jul 23 21:37:44.943674 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.943647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:44.943796 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:44.943705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2s8\" (UniqueName: \"kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.044993 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.044960 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.045185 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.045031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2s8\" (UniqueName: \"kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.045377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.045360 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.055814 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.055780 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2s8\" (UniqueName: \"kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.075971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.075941 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd04cda-08c9-4124-a17b-ab7da321293c" path="/var/lib/kubelet/pods/ecd04cda-08c9-4124-a17b-ab7da321293c/volumes" Jul 23 21:37:45.187240 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.187150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:45.349464 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.349443 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh"] Jul 23 21:37:45.351734 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:37:45.351707 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d50990b_bf9a_491f_8f3e_6ad929261055.slice/crio-8174e1cd4c6a2032627b30978900601ecf21eeb43f4b27b69f9e60fdda8c43d9 WatchSource:0}: Error finding container 8174e1cd4c6a2032627b30978900601ecf21eeb43f4b27b69f9e60fdda8c43d9: Status 404 returned error can't find the container with id 8174e1cd4c6a2032627b30978900601ecf21eeb43f4b27b69f9e60fdda8c43d9 Jul 23 21:37:45.722370 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.722333 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh"] Jul 23 21:37:45.726552 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.726524 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh"] Jul 23 21:37:45.754142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.754111 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v"] Jul 23 21:37:45.754380 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.754354 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerName="manager" containerID="cri-o://dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3" gracePeriod=2 Jul 23 21:37:45.777028 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:45.776989 2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-4fs2v\": pods \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:45.783456 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.783427 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v"] Jul 23 21:37:45.796131 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.796104 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj"] Jul 23 21:37:45.796658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.796635 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerName="manager" Jul 23 21:37:45.796658 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.796659 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerName="manager" Jul 23 21:37:45.796908 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.796754 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerName="manager" Jul 23 21:37:45.800127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.800108 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:45.805292 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:45.805264 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:45.820175 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.820063 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj"] Jul 23 21:37:45.852132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.852088 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc5cf\" (UniqueName: \"kubernetes.io/projected/cd4b8f04-115b-4351-96cd-0dc5efc1fe11-kube-api-access-cc5cf\") pod \"limitador-operator-controller-manager-859d7b78bd-62vmj\" (UID: \"cd4b8f04-115b-4351-96cd-0dc5efc1fe11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:45.952980 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.952944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc5cf\" (UniqueName: \"kubernetes.io/projected/cd4b8f04-115b-4351-96cd-0dc5efc1fe11-kube-api-access-cc5cf\") pod \"limitador-operator-controller-manager-859d7b78bd-62vmj\" (UID: \"cd4b8f04-115b-4351-96cd-0dc5efc1fe11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:45.961989 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:45.961961 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc5cf\" (UniqueName: \"kubernetes.io/projected/cd4b8f04-115b-4351-96cd-0dc5efc1fe11-kube-api-access-cc5cf\") pod \"limitador-operator-controller-manager-859d7b78bd-62vmj\" (UID: \"cd4b8f04-115b-4351-96cd-0dc5efc1fe11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:46.125728 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.125699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:46.131010 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.130986 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:46.134170 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:46.134143 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:46.201732 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.201695 2569 generic.go:356] "Generic (PLEG): container finished" podID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerID="dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3" exitCode=0 Jul 23 21:37:46.202155 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.201752 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:46.202155 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.201821 2569 scope.go:117] "RemoveContainer" containerID="dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3" Jul 23 21:37:46.204240 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:46.204210 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:46.256846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.256816 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27\") pod \"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\" (UID: \"c1ea4d7f-1986-4a0f-8f44-82b1564f4a03\") " Jul 23 21:37:46.258946 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.258918 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27" (OuterVolumeSpecName: "kube-api-access-rkn27") pod "c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" (UID: "c1ea4d7f-1986-4a0f-8f44-82b1564f4a03"). InnerVolumeSpecName "kube-api-access-rkn27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:46.265347 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.265327 2569 scope.go:117] "RemoveContainer" containerID="dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3" Jul 23 21:37:46.265732 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:46.265694 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3\": container with ID starting with dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3 not found: ID does not exist" containerID="dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3" Jul 23 21:37:46.265814 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.265749 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3"} err="failed to get container status \"dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3\": rpc error: code = NotFound desc = could not find container \"dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3\": container with ID starting with dd7f095b6e3773802b21963d39e1b33804794fd2d92cde1083a8b99a95abeec3 not found: ID does not exist" Jul 23 21:37:46.358162 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.358129 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkn27\" (UniqueName: \"kubernetes.io/projected/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03-kube-api-access-rkn27\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:46.450854 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:46.450820 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj"] Jul 23 21:37:46.454764 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:37:46.454721 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4b8f04_115b_4351_96cd_0dc5efc1fe11.slice/crio-373e580acb6ec48fc37c751d6ffd64095118ecbadb7e77e148ad3621c2595695 WatchSource:0}: Error finding container 373e580acb6ec48fc37c751d6ffd64095118ecbadb7e77e148ad3621c2595695: Status 404 returned error can't find the container with id 373e580acb6ec48fc37c751d6ffd64095118ecbadb7e77e148ad3621c2595695 Jul 23 21:37:46.514475 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:46.514441 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4fs2v\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" Jul 23 21:37:47.075608 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.075565 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4fs2v" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.44:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 23 21:37:47.077971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.077944 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ea4d7f-1986-4a0f-8f44-82b1564f4a03" path="/var/lib/kubelet/pods/c1ea4d7f-1986-4a0f-8f44-82b1564f4a03/volumes" Jul 23 21:37:47.213493 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.213459 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" event={"ID":"cd4b8f04-115b-4351-96cd-0dc5efc1fe11","Type":"ContainerStarted","Data":"de79c7091df952572579accfe652d1b692ebf0b139c0f7c97fdcc9b10d80390d"} Jul 23 21:37:47.213906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.213522 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" event={"ID":"cd4b8f04-115b-4351-96cd-0dc5efc1fe11","Type":"ContainerStarted","Data":"373e580acb6ec48fc37c751d6ffd64095118ecbadb7e77e148ad3621c2595695"} Jul 23 21:37:47.213906 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.213552 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:37:47.232084 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:47.232007 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" podStartSLOduration=2.231985348 podStartE2EDuration="2.231985348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:47.230914564 +0000 UTC m=+704.747809625" watchObservedRunningTime="2026-07-23 21:37:47.231985348 +0000 UTC m=+704.748880408" Jul 23 21:37:50.245892 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.245837 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" containerName="manager" containerID="cri-o://79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18" gracePeriod=2 Jul 23 21:37:50.495291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.495270 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:50.498118 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:50.498031 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:50.599331 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.599289 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb2s8\" (UniqueName: \"kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8\") pod \"4d50990b-bf9a-491f-8f3e-6ad929261055\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " Jul 23 21:37:50.599477 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.599417 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume\") pod \"4d50990b-bf9a-491f-8f3e-6ad929261055\" (UID: \"4d50990b-bf9a-491f-8f3e-6ad929261055\") " Jul 23 21:37:50.599691 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.599665 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d50990b-bf9a-491f-8f3e-6ad929261055" (UID: "4d50990b-bf9a-491f-8f3e-6ad929261055"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:50.601542 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.601522 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8" (OuterVolumeSpecName: "kube-api-access-mb2s8") pod "4d50990b-bf9a-491f-8f3e-6ad929261055" (UID: "4d50990b-bf9a-491f-8f3e-6ad929261055"). InnerVolumeSpecName "kube-api-access-mb2s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:50.700668 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.700634 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d50990b-bf9a-491f-8f3e-6ad929261055-extensions-socket-volume\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:50.700668 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:50.700665 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2s8\" (UniqueName: \"kubernetes.io/projected/4d50990b-bf9a-491f-8f3e-6ad929261055-kube-api-access-mb2s8\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:37:51.076158 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.076124 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" path="/var/lib/kubelet/pods/4d50990b-bf9a-491f-8f3e-6ad929261055/volumes" Jul 23 21:37:51.252484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.252452 2569 generic.go:356] "Generic (PLEG): container finished" podID="4d50990b-bf9a-491f-8f3e-6ad929261055" containerID="79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18" exitCode=2 Jul 23 21:37:51.252846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.252494 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:51.252846 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.252543 2569 scope.go:117] "RemoveContainer" containerID="79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18" Jul 23 21:37:51.257452 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:51.257425 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:51.261726 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.261709 2569 scope.go:117] "RemoveContainer" containerID="79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18" Jul 23 21:37:51.261971 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:51.261952 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18\": container with ID starting with 79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18 not found: ID does not exist" containerID="79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18" Jul 23 21:37:51.262019 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:51.261977 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18"} err="failed to get container status \"79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18\": rpc error: code = NotFound desc = could not find container \"79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18\": container with ID starting with 79c88a2c56976191a34a5c3104f615d5491129e35fb38bdf58627314c9c30f18 not found: ID does not exist" Jul 23 21:37:53.075089 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:37:53.074998 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-crvhh\" is forbidden: User \"system:node:ip-10-0-132-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-103.ec2.internal' and this object" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-crvhh" Jul 23 21:37:58.233444 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:37:58.233418 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62vmj" Jul 23 21:38:36.132010 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.131975 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:36.132494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.132384 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" containerName="manager" Jul 23 21:38:36.132494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.132396 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" containerName="manager" Jul 23 21:38:36.132494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.132465 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d50990b-bf9a-491f-8f3e-6ad929261055" containerName="manager" Jul 23 21:38:36.134737 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.134721 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.137452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.137427 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 21:38:36.137588 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.137514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-846n7\"" Jul 23 21:38:36.144693 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.144665 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:36.208149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.208121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgp7\" (UniqueName: \"kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.208149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.208162 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.224044 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.224012 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:36.309455 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.309411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgp7\" (UniqueName: \"kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.309682 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.309459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.310227 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.310210 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.317989 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.317967 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgp7\" (UniqueName: \"kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7\") pod \"limitador-limitador-64c94fd64f-zdhhq\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.447549 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.447461 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:36.584175 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:36.584146 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:36.585630 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:38:36.585597 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1115fe26_7ff6_4e75_aa4d_864dbba6630d.slice/crio-e5b616a8d06b4a57f0dbea27f27143ffcec95692101350212c5acf1695ab8440 WatchSource:0}: Error finding container e5b616a8d06b4a57f0dbea27f27143ffcec95692101350212c5acf1695ab8440: Status 404 returned error can't find the container with id e5b616a8d06b4a57f0dbea27f27143ffcec95692101350212c5acf1695ab8440 Jul 23 21:38:37.505406 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:37.505373 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" event={"ID":"1115fe26-7ff6-4e75-aa4d-864dbba6630d","Type":"ContainerStarted","Data":"e5b616a8d06b4a57f0dbea27f27143ffcec95692101350212c5acf1695ab8440"} Jul 23 21:38:39.518932 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:39.518835 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" event={"ID":"1115fe26-7ff6-4e75-aa4d-864dbba6630d","Type":"ContainerStarted","Data":"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068"} Jul 23 21:38:39.518932 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:39.518924 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:39.536714 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:39.536669 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" podStartSLOduration=0.870744028 podStartE2EDuration="3.536656368s" totalImagesPullingTime="2.66591234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:39.535311914 +0000 UTC m=+757.052206976" watchObservedRunningTime="2026-07-23 21:38:39.536656368 +0000 UTC m=+757.053551427" Jul 23 21:38:50.525491 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:50.525462 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:51.275142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.275113 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:51.275316 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.275288 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" podUID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" containerName="limitador" containerID="cri-o://2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068" gracePeriod=30 Jul 23 21:38:51.826562 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.826537 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:51.961788 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.961693 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rgp7\" (UniqueName: \"kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7\") pod \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " Jul 23 21:38:51.961788 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.961754 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file\") pod \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\" (UID: \"1115fe26-7ff6-4e75-aa4d-864dbba6630d\") " Jul 23 21:38:51.962156 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.962134 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file" (OuterVolumeSpecName: "config-file") pod "1115fe26-7ff6-4e75-aa4d-864dbba6630d" (UID: "1115fe26-7ff6-4e75-aa4d-864dbba6630d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:38:51.964250 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:51.964230 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7" (OuterVolumeSpecName: "kube-api-access-6rgp7") pod "1115fe26-7ff6-4e75-aa4d-864dbba6630d" (UID: "1115fe26-7ff6-4e75-aa4d-864dbba6630d"). InnerVolumeSpecName "kube-api-access-6rgp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:38:52.063089 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.063048 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rgp7\" (UniqueName: \"kubernetes.io/projected/1115fe26-7ff6-4e75-aa4d-864dbba6630d-kube-api-access-6rgp7\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:38:52.063089 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.063086 2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1115fe26-7ff6-4e75-aa4d-864dbba6630d-config-file\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:38:52.595579 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.595534 2569 generic.go:356] "Generic (PLEG): container finished" podID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" containerID="2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068" exitCode=0 Jul 23 21:38:52.595762 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.595583 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" Jul 23 21:38:52.595762 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.595606 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" event={"ID":"1115fe26-7ff6-4e75-aa4d-864dbba6630d","Type":"ContainerDied","Data":"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068"} Jul 23 21:38:52.595762 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.595676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zdhhq" event={"ID":"1115fe26-7ff6-4e75-aa4d-864dbba6630d","Type":"ContainerDied","Data":"e5b616a8d06b4a57f0dbea27f27143ffcec95692101350212c5acf1695ab8440"} Jul 23 21:38:52.595762 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.595700 2569 scope.go:117] "RemoveContainer" containerID="2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068" Jul 23 21:38:52.605297 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.605278 2569 scope.go:117] "RemoveContainer" containerID="2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068" Jul 23 21:38:52.605556 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:38:52.605537 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068\": container with ID starting with 2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068 not found: ID does not exist" containerID="2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068" Jul 23 21:38:52.605620 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.605562 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068"} err="failed to get container status \"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068\": rpc error: code = NotFound desc = could not find container \"2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068\": container with ID starting with 2f7f77698429e6b14d59fe5ed58841def3194a62561c4befced2ad439b61d068 not found: ID does not exist" Jul 23 21:38:52.616563 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.616539 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:52.620381 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:52.620361 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zdhhq"] Jul 23 21:38:53.075881 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:53.075847 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" path="/var/lib/kubelet/pods/1115fe26-7ff6-4e75-aa4d-864dbba6630d/volumes" Jul 23 21:38:57.985885 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.985848 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h5bff"] Jul 23 21:38:57.986494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.986474 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" containerName="limitador" Jul 23 21:38:57.986494 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.986495 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" containerName="limitador" Jul 23 21:38:57.986611 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.986591 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1115fe26-7ff6-4e75-aa4d-864dbba6630d" containerName="limitador" Jul 23 21:38:57.989685 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.989671 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:57.993403 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.993369 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 21:38:57.993525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.993468 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 21:38:57.994430 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.994411 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9h72g\"" Jul 23 21:38:57.994550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.994419 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 21:38:57.997753 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:57.997729 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h5bff"] Jul 23 21:38:58.112959 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.112922 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/da8c5c1c-1269-452f-a5a3-a7acc43b3077-kube-api-access-6vpps\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.113174 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.112990 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da8c5c1c-1269-452f-a5a3-a7acc43b3077-data\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.214161 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.214117 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/da8c5c1c-1269-452f-a5a3-a7acc43b3077-kube-api-access-6vpps\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.214365 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.214201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da8c5c1c-1269-452f-a5a3-a7acc43b3077-data\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.214590 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.214570 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da8c5c1c-1269-452f-a5a3-a7acc43b3077-data\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.223597 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.223571 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/da8c5c1c-1269-452f-a5a3-a7acc43b3077-kube-api-access-6vpps\") pod \"postgres-69fb4594cf-h5bff\" (UID: \"da8c5c1c-1269-452f-a5a3-a7acc43b3077\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.301251 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.301207 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:38:58.441532 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.441501 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h5bff"] Jul 23 21:38:58.443404 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:38:58.443367 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8c5c1c_1269_452f_a5a3_a7acc43b3077.slice/crio-bcde5bba0751cd35517202ecf1bb6249df5fc7bc63967bca0c5f880db584e2d3 WatchSource:0}: Error finding container bcde5bba0751cd35517202ecf1bb6249df5fc7bc63967bca0c5f880db584e2d3: Status 404 returned error can't find the container with id bcde5bba0751cd35517202ecf1bb6249df5fc7bc63967bca0c5f880db584e2d3 Jul 23 21:38:58.629952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:38:58.629855 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" event={"ID":"da8c5c1c-1269-452f-a5a3-a7acc43b3077","Type":"ContainerStarted","Data":"bcde5bba0751cd35517202ecf1bb6249df5fc7bc63967bca0c5f880db584e2d3"} Jul 23 21:39:03.226423 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:03.226400 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 21:39:03.664938 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:03.664902 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" event={"ID":"da8c5c1c-1269-452f-a5a3-a7acc43b3077","Type":"ContainerStarted","Data":"b4bf36fd0ca3552c751ec67fd205eb40e831ddc57ffe6c406d3d60c88f3c1903"} Jul 23 21:39:03.665142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:03.665005 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:39:03.682765 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:03.682720 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" podStartSLOduration=1.9037458539999998 podStartE2EDuration="6.682707167s" totalImagesPullingTime="4.778961313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:39:03.680153242 +0000 UTC m=+781.197048299" watchObservedRunningTime="2026-07-23 21:39:03.682707167 +0000 UTC m=+781.199602226" Jul 23 21:39:09.701617 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:09.701592 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h5bff" Jul 23 21:39:10.246662 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.246620 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:10.255420 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.255384 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:10.256961 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.256937 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:10.257926 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.257907 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xq6sh\"" Jul 23 21:39:10.325781 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.325751 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gw9\" (UniqueName: \"kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9\") pod \"authorino-5d4b67c446-txq9s\" (UID: \"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c\") " pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:10.426463 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.426429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gw9\" (UniqueName: \"kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9\") pod \"authorino-5d4b67c446-txq9s\" (UID: \"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c\") " pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:10.434149 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.434117 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gw9\" (UniqueName: \"kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9\") pod \"authorino-5d4b67c446-txq9s\" (UID: \"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c\") " pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:10.482226 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.482192 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:10.482479 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.482467 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:10.505180 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.505109 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-577fd6c469-qxxbh"] Jul 23 21:39:10.510294 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.510272 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.515482 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.515436 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577fd6c469-qxxbh"] Jul 23 21:39:10.595491 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.595461 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577fd6c469-qxxbh"] Jul 23 21:39:10.595869 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:39:10.595840 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xgqwk], unattached volumes=[], failed to process volumes=[kube-api-access-xgqwk]: context canceled" pod="kuadrant-system/authorino-577fd6c469-qxxbh" podUID="9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8" Jul 23 21:39:10.627236 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.627204 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:10.627627 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.627606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqwk\" (UniqueName: \"kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk\") pod \"authorino-577fd6c469-qxxbh\" (UID: \"9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8\") " pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.628184 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:39:10.628154 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9f9156a_0d0b_4898_b7b7_c16b68b4c05c.slice/crio-0dec0a3a9f605b1d314f5166189b60ccdfb5a265fe42bfdef59a6acfb61e7d6d WatchSource:0}: Error finding container 0dec0a3a9f605b1d314f5166189b60ccdfb5a265fe42bfdef59a6acfb61e7d6d: Status 404 returned error can't find the container with id 0dec0a3a9f605b1d314f5166189b60ccdfb5a265fe42bfdef59a6acfb61e7d6d Jul 23 21:39:10.704747 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.704712 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-txq9s" event={"ID":"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c","Type":"ContainerStarted","Data":"0dec0a3a9f605b1d314f5166189b60ccdfb5a265fe42bfdef59a6acfb61e7d6d"} Jul 23 21:39:10.704747 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.704743 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.712137 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.712118 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.728162 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.728138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqwk\" (UniqueName: \"kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk\") pod \"authorino-577fd6c469-qxxbh\" (UID: \"9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8\") " pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.736573 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.736557 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqwk\" (UniqueName: \"kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk\") pod \"authorino-577fd6c469-qxxbh\" (UID: \"9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8\") " pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:10.829285 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.829212 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgqwk\" (UniqueName: \"kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk\") pod \"9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8\" (UID: \"9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8\") " Jul 23 21:39:10.831354 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.831334 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk" (OuterVolumeSpecName: "kube-api-access-xgqwk") pod "9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8" (UID: "9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8"). InnerVolumeSpecName "kube-api-access-xgqwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:39:10.930142 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:10.930112 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgqwk\" (UniqueName: \"kubernetes.io/projected/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8-kube-api-access-xgqwk\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:39:11.712291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:11.712206 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577fd6c469-qxxbh" Jul 23 21:39:11.743315 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:11.743282 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577fd6c469-qxxbh"] Jul 23 21:39:11.746944 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:11.746917 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-577fd6c469-qxxbh"] Jul 23 21:39:13.077699 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:13.077663 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8" path="/var/lib/kubelet/pods/9cdeb912-9c43-4e7c-b84e-2bb5283fa3f8/volumes" Jul 23 21:39:14.733143 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:14.733103 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-txq9s" event={"ID":"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c","Type":"ContainerStarted","Data":"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d"} Jul 23 21:39:14.733143 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:14.733139 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-txq9s" podUID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" containerName="authorino" containerID="cri-o://c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d" gracePeriod=30 Jul 23 21:39:14.748403 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:14.748348 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-txq9s" podStartSLOduration=1.629926632 podStartE2EDuration="4.748328465s" totalImagesPullingTime="3.118401833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:39:14.747749846 +0000 UTC m=+792.264644905" watchObservedRunningTime="2026-07-23 21:39:14.748328465 +0000 UTC m=+792.265223524" Jul 23 21:39:14.994435 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:14.994414 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:15.068389 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.068358 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6gw9\" (UniqueName: \"kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9\") pod \"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c\" (UID: \"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c\") " Jul 23 21:39:15.070527 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.070492 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9" (OuterVolumeSpecName: "kube-api-access-q6gw9") pod "d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" (UID: "d9f9156a-0d0b-4898-b7b7-c16b68b4c05c"). InnerVolumeSpecName "kube-api-access-q6gw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:39:15.170017 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.169986 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6gw9\" (UniqueName: \"kubernetes.io/projected/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c-kube-api-access-q6gw9\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:39:15.739867 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.739831 2569 generic.go:356] "Generic (PLEG): container finished" podID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" containerID="c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d" exitCode=0 Jul 23 21:39:15.740291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.739879 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-txq9s" Jul 23 21:39:15.740291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.739919 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-txq9s" event={"ID":"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c","Type":"ContainerDied","Data":"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d"} Jul 23 21:39:15.740291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.739963 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-txq9s" event={"ID":"d9f9156a-0d0b-4898-b7b7-c16b68b4c05c","Type":"ContainerDied","Data":"0dec0a3a9f605b1d314f5166189b60ccdfb5a265fe42bfdef59a6acfb61e7d6d"} Jul 23 21:39:15.740291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.739978 2569 scope.go:117] "RemoveContainer" containerID="c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d" Jul 23 21:39:15.749355 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.749338 2569 scope.go:117] "RemoveContainer" containerID="c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d" Jul 23 21:39:15.749605 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:39:15.749585 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d\": container with ID starting with c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d not found: ID does not exist" containerID="c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d" Jul 23 21:39:15.749650 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.749613 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d"} err="failed to get container status \"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d\": rpc error: code = NotFound desc = could not find container \"c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d\": container with ID starting with c43b2540236d2cc303aea5cc27af6668a9f74c2a6249d362cddd5653c430133d not found: ID does not exist" Jul 23 21:39:15.756407 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.756386 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:15.760227 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:15.760206 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-txq9s"] Jul 23 21:39:17.076240 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.076212 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" path="/var/lib/kubelet/pods/d9f9156a-0d0b-4898-b7b7-c16b68b4c05c/volumes" Jul 23 21:39:17.239634 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.239604 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:17.240137 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.240113 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" containerName="authorino" Jul 23 21:39:17.240137 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.240133 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" containerName="authorino" Jul 23 21:39:17.240307 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.240262 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9f9156a-0d0b-4898-b7b7-c16b68b4c05c" containerName="authorino" Jul 23 21:39:17.245525 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.245505 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.249488 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.249471 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 21:39:17.251690 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.250738 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9wqrd\"" Jul 23 21:39:17.251690 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.251478 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 21:39:17.254811 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.254788 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:17.285952 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.285925 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.286100 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.286007 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9wc\" (UniqueName: \"kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.387109 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.386993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9wc\" (UniqueName: \"kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.387109 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.387059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.387325 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:39:17.387187 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 23 21:39:17.387325 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:39:17.387245 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert podName:90415272-02a8-41b0-a86a-98fff52070c0 nodeName:}" failed. No retries permitted until 2026-07-23 21:39:17.887229628 +0000 UTC m=+795.404124664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert") pod "maas-controller-5cbcfcb7df-r7rxg" (UID: "90415272-02a8-41b0-a86a-98fff52070c0") : secret "maas-controller-webhook-cert" not found Jul 23 21:39:17.398025 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.397997 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9wc\" (UniqueName: \"kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.437366 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.437333 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86877bcff5-k522l"] Jul 23 21:39:17.441391 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.441375 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.449626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.449384 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86877bcff5-k522l"] Jul 23 21:39:17.487574 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.487542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-677t7\" (UniqueName: \"kubernetes.io/projected/1446d1de-8560-4244-8aec-cd2e6aefce5c-kube-api-access-677t7\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.487751 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.487609 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1446d1de-8560-4244-8aec-cd2e6aefce5c-webhook-cert\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.589122 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.589093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1446d1de-8560-4244-8aec-cd2e6aefce5c-webhook-cert\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.589307 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.589194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-677t7\" (UniqueName: \"kubernetes.io/projected/1446d1de-8560-4244-8aec-cd2e6aefce5c-kube-api-access-677t7\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.591754 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.591728 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1446d1de-8560-4244-8aec-cd2e6aefce5c-webhook-cert\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.596911 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.596887 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-677t7\" (UniqueName: \"kubernetes.io/projected/1446d1de-8560-4244-8aec-cd2e6aefce5c-kube-api-access-677t7\") pod \"maas-controller-86877bcff5-k522l\" (UID: \"1446d1de-8560-4244-8aec-cd2e6aefce5c\") " pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.753003 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.752972 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:17.890563 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.890537 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86877bcff5-k522l"] Jul 23 21:39:17.892199 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:39:17.892169 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1446d1de_8560_4244_8aec_cd2e6aefce5c.slice/crio-e6738b37da0a7028646963c5b012b2123ea9824fad471b220a7bd53a4504a4f2 WatchSource:0}: Error finding container e6738b37da0a7028646963c5b012b2123ea9824fad471b220a7bd53a4504a4f2: Status 404 returned error can't find the container with id e6738b37da0a7028646963c5b012b2123ea9824fad471b220a7bd53a4504a4f2 Jul 23 21:39:17.892437 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.892415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:17.894965 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:17.894950 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") pod \"maas-controller-5cbcfcb7df-r7rxg\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:18.158791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:18.158693 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:18.295611 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:18.295581 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:18.298225 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:39:18.298199 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90415272_02a8_41b0_a86a_98fff52070c0.slice/crio-f40e35fbc9149e742ae5817005c686f9d014c0f279f3f102b856b904f022d54a WatchSource:0}: Error finding container f40e35fbc9149e742ae5817005c686f9d014c0f279f3f102b856b904f022d54a: Status 404 returned error can't find the container with id f40e35fbc9149e742ae5817005c686f9d014c0f279f3f102b856b904f022d54a Jul 23 21:39:18.763280 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:18.763245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"e6738b37da0a7028646963c5b012b2123ea9824fad471b220a7bd53a4504a4f2"} Jul 23 21:39:18.765270 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:18.765188 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" event={"ID":"90415272-02a8-41b0-a86a-98fff52070c0","Type":"ContainerStarted","Data":"f40e35fbc9149e742ae5817005c686f9d014c0f279f3f102b856b904f022d54a"} Jul 23 21:39:20.778184 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.778147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" event={"ID":"90415272-02a8-41b0-a86a-98fff52070c0","Type":"ContainerStarted","Data":"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006"} Jul 23 21:39:20.778622 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.778246 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:20.779797 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.779774 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"f52ead75f132ce7cf1a52615454afc437cfa29f2a0ffcaa67dc9b2c3ccb2e5a4"} Jul 23 21:39:20.779921 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.779904 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:20.799132 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.799061 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" podStartSLOduration=1.662438794 podStartE2EDuration="3.799043399s" totalImagesPullingTime="2.136604605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:39:20.798770353 +0000 UTC m=+798.315665414" watchObservedRunningTime="2026-07-23 21:39:20.799043399 +0000 UTC m=+798.315938459" Jul 23 21:39:20.822629 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:20.822584 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86877bcff5-k522l" podStartSLOduration=1.286229884 podStartE2EDuration="3.822570503s" totalImagesPullingTime="2.536340619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:39:20.821251823 +0000 UTC m=+798.338146885" watchObservedRunningTime="2026-07-23 21:39:20.822570503 +0000 UTC m=+798.339465562" Jul 23 21:39:31.787897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:31.787816 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:39:31.787897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:31.787887 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:31.852612 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:31.852581 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:31.852800 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:31.852775 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" podUID="90415272-02a8-41b0-a86a-98fff52070c0" containerName="manager" containerID="cri-o://1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006" gracePeriod=30 Jul 23 21:39:32.109306 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.109281 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:32.247111 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.247060 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") pod \"90415272-02a8-41b0-a86a-98fff52070c0\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " Jul 23 21:39:32.247291 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.247166 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx9wc\" (UniqueName: \"kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc\") pod \"90415272-02a8-41b0-a86a-98fff52070c0\" (UID: \"90415272-02a8-41b0-a86a-98fff52070c0\") " Jul 23 21:39:32.249214 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.249189 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90415272-02a8-41b0-a86a-98fff52070c0" (UID: "90415272-02a8-41b0-a86a-98fff52070c0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:39:32.249331 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.249270 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc" (OuterVolumeSpecName: "kube-api-access-lx9wc") pod "90415272-02a8-41b0-a86a-98fff52070c0" (UID: "90415272-02a8-41b0-a86a-98fff52070c0"). InnerVolumeSpecName "kube-api-access-lx9wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:39:32.348855 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.348782 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90415272-02a8-41b0-a86a-98fff52070c0-webhook-cert\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:39:32.348855 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.348821 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx9wc\" (UniqueName: \"kubernetes.io/projected/90415272-02a8-41b0-a86a-98fff52070c0-kube-api-access-lx9wc\") on node \"ip-10-0-132-103.ec2.internal\" DevicePath \"\"" Jul 23 21:39:32.854388 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.854360 2569 generic.go:356] "Generic (PLEG): container finished" podID="90415272-02a8-41b0-a86a-98fff52070c0" containerID="1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006" exitCode=0 Jul 23 21:39:32.854388 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.854394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" event={"ID":"90415272-02a8-41b0-a86a-98fff52070c0","Type":"ContainerDied","Data":"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006"} Jul 23 21:39:32.854861 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.854407 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" Jul 23 21:39:32.854861 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.854432 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbcfcb7df-r7rxg" event={"ID":"90415272-02a8-41b0-a86a-98fff52070c0","Type":"ContainerDied","Data":"f40e35fbc9149e742ae5817005c686f9d014c0f279f3f102b856b904f022d54a"} Jul 23 21:39:32.854861 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.854453 2569 scope.go:117] "RemoveContainer" containerID="1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006" Jul 23 21:39:32.866755 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.866730 2569 scope.go:117] "RemoveContainer" containerID="1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006" Jul 23 21:39:32.867268 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:39:32.867234 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006\": container with ID starting with 1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006 not found: ID does not exist" containerID="1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006" Jul 23 21:39:32.867374 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.867281 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006"} err="failed to get container status \"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006\": rpc error: code = NotFound desc = could not find container \"1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006\": container with ID starting with 1c3d8c56fd72ffc2a9c8580e2ead3790fab33117243878f143709e14a0f97006 not found: ID does not exist" Jul 23 21:39:32.877579 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.877558 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:32.880958 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:32.880940 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cbcfcb7df-r7rxg"] Jul 23 21:39:33.076842 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:39:33.076812 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90415272-02a8-41b0-a86a-98fff52070c0" path="/var/lib/kubelet/pods/90415272-02a8-41b0-a86a-98fff52070c0/volumes" Jul 23 21:41:02.985860 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:02.985834 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:41:02.987277 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:02.987255 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:41:02.992722 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:02.992702 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:41:02.994403 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:02.994386 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:41:21.450935 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:21.450901 2569 generic.go:356] "Generic (PLEG): container finished" podID="1446d1de-8560-4244-8aec-cd2e6aefce5c" containerID="f52ead75f132ce7cf1a52615454afc437cfa29f2a0ffcaa67dc9b2c3ccb2e5a4" exitCode=1 Jul 23 21:41:21.451379 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:21.450940 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerDied","Data":"f52ead75f132ce7cf1a52615454afc437cfa29f2a0ffcaa67dc9b2c3ccb2e5a4"} Jul 23 21:41:21.451379 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:21.451274 2569 scope.go:117] "RemoveContainer" containerID="f52ead75f132ce7cf1a52615454afc437cfa29f2a0ffcaa67dc9b2c3ccb2e5a4" Jul 23 21:41:21.786016 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:21.785985 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:41:22.458310 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:22.458275 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191"} Jul 23 21:41:22.458686 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:22.458441 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:41:33.466093 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:41:33.466047 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:43:40.214868 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:40.214827 2569 generic.go:356] "Generic (PLEG): container finished" podID="1446d1de-8560-4244-8aec-cd2e6aefce5c" containerID="28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191" exitCode=1 Jul 23 21:43:40.215310 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:40.214904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerDied","Data":"28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191"} Jul 23 21:43:40.215310 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:40.214987 2569 scope.go:117] "RemoveContainer" containerID="f52ead75f132ce7cf1a52615454afc437cfa29f2a0ffcaa67dc9b2c3ccb2e5a4" Jul 23 21:43:40.215415 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:40.215328 2569 scope.go:117] "RemoveContainer" containerID="28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191" Jul 23 21:43:40.215563 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:43:40.215543 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:43:43.464727 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:43.464694 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:43:43.465183 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:43.465041 2569 scope.go:117] "RemoveContainer" containerID="28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191" Jul 23 21:43:43.465269 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:43:43.465248 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:43:54.070202 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:54.070109 2569 scope.go:117] "RemoveContainer" containerID="28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191" Jul 23 21:43:54.070586 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:54.070417 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:43:55.304677 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:55.304646 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7"} Jul 23 21:43:55.305155 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:43:55.304877 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:44:06.312452 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:44:06.312418 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:46:03.024263 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:03.024174 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:46:03.026828 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:03.026807 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:46:03.030912 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:03.030895 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:46:03.033787 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:03.033769 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vczgs_7844a2c8-3514-44f2-bd5a-ea2b04a5cb3f/ovn-acl-logging/0.log" Jul 23 21:46:11.050221 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:11.050191 2569 generic.go:356] "Generic (PLEG): container finished" podID="1446d1de-8560-4244-8aec-cd2e6aefce5c" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" exitCode=1 Jul 23 21:46:11.050626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:11.050276 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerDied","Data":"897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7"} Jul 23 21:46:11.050626 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:11.050337 2569 scope.go:117] "RemoveContainer" containerID="28ae85a310a57099b9cfe63a8e455079489239afe58bf4ba09505e7de7aa3191" Jul 23 21:46:11.050744 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:11.050625 2569 scope.go:117] "RemoveContainer" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" Jul 23 21:46:11.050873 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:46:11.050853 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:46:16.310422 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:16.310389 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:46:16.310800 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:16.310729 2569 scope.go:117] "RemoveContainer" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" Jul 23 21:46:16.310933 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:46:16.310914 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:46:17.753127 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:17.753092 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:46:17.753510 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:17.753429 2569 scope.go:117] "RemoveContainer" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" Jul 23 21:46:17.753613 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:46:17.753594 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:46:31.070170 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:31.070142 2569 scope.go:117] "RemoveContainer" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" Jul 23 21:46:32.164098 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:32.164041 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3"} Jul 23 21:46:32.164475 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:32.164263 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:46:43.172274 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:46:43.172248 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:48:47.922521 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:47.922489 2569 generic.go:356] "Generic (PLEG): container finished" podID="1446d1de-8560-4244-8aec-cd2e6aefce5c" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" exitCode=1 Jul 23 21:48:47.922939 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:47.922561 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerDied","Data":"1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3"} Jul 23 21:48:47.922939 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:47.922624 2569 scope.go:117] "RemoveContainer" containerID="897dfece9db3f0bcfbce6890a9a647f2d66353facf94f1721fbdda24ea5a18b7" Jul 23 21:48:47.923030 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:47.922973 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:48:47.923214 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:48:47.923190 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:48:53.170841 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:53.170810 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:48:53.171235 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:53.171160 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:48:53.171375 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:48:53.171354 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:48:57.753439 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:57.753381 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:48:57.753915 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:48:57.753862 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:48:57.754128 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:48:57.754064 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:49:13.073460 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:13.073433 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:49:13.073867 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:49:13.073642 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:49:26.070561 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:26.070524 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:49:26.071028 ip-10-0-132-103 kubenswrapper[2569]: E0723 21:49:26.070680 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-86877bcff5-k522l_opendatahub(1446d1de-8560-4244-8aec-cd2e6aefce5c)\"" pod="opendatahub/maas-controller-86877bcff5-k522l" podUID="1446d1de-8560-4244-8aec-cd2e6aefce5c" Jul 23 21:49:38.070067 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:38.070032 2569 scope.go:117] "RemoveContainer" containerID="1d110ee1b63882cbcbd77859fb62708a6e24117a831d79cde827b58117f66cb3" Jul 23 21:49:38.070498 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:38.070384 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:49:39.205667 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:39.205632 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86877bcff5-k522l" event={"ID":"1446d1de-8560-4244-8aec-cd2e6aefce5c","Type":"ContainerStarted","Data":"292e512aad438793f0938cdcbb16b7e228dc247a0084365c73e59ef1e78c140f"} Jul 23 21:49:39.206177 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:39.205860 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:49:45.551359 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:45.551328 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rxljn_b4131d71-5625-4c54-88bb-72d284226976/manager/0.log" Jul 23 21:49:45.667890 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:45.667858 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tqq7c_3ade8af3-ab84-4349-82d9-6b26fe99928b/manager/0.log" Jul 23 21:49:45.780851 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:45.780815 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86877bcff5-k522l_1446d1de-8560-4244-8aec-cd2e6aefce5c/manager/4.log" Jul 23 21:49:46.145953 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:46.145928 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-56xlw_0826338c-b9d4-4c8c-b669-5bcca902060c/copy-manifests/0.log" Jul 23 21:49:46.151712 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:46.151689 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-56xlw_0826338c-b9d4-4c8c-b669-5bcca902060c/manager/0.log" Jul 23 21:49:46.738173 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:46.738146 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h5bff_da8c5c1c-1269-452f-a5a3-a7acc43b3077/postgres/0.log" Jul 23 21:49:47.436377 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.436350 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/util/0.log" Jul 23 21:49:47.443719 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.443697 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/pull/0.log" Jul 23 21:49:47.450470 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.450448 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/extract/0.log" Jul 23 21:49:47.562506 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.562485 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/util/0.log" Jul 23 21:49:47.568096 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.568053 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/pull/0.log" Jul 23 21:49:47.573975 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.573960 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/extract/0.log" Jul 23 21:49:47.689045 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.688975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/extract/0.log" Jul 23 21:49:47.694827 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.694809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/util/0.log" Jul 23 21:49:47.700453 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.700436 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/pull/0.log" Jul 23 21:49:47.814334 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.814306 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/util/0.log" Jul 23 21:49:47.820954 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.820935 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/pull/0.log" Jul 23 21:49:47.827170 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:47.827151 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/extract/0.log" Jul 23 21:49:48.733431 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:48.733402 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-62vmj_cd4b8f04-115b-4351-96cd-0dc5efc1fe11/manager/0.log" Jul 23 21:49:49.086390 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:49.086365 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9lbv_23f78a53-824c-44d0-8413-4b528d3b5018/istio-proxy/0.log" Jul 23 21:49:49.679336 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:49.679293 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b98bc9bd8-8qf2h_1efd1344-252e-49b2-8894-d6bb533078a7/router/0.log" Jul 23 21:49:50.212758 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:50.212726 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86877bcff5-k522l" Jul 23 21:49:55.808373 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.808301 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m4gt/must-gather-n4qgz"] Jul 23 21:49:55.808710 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.808701 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90415272-02a8-41b0-a86a-98fff52070c0" containerName="manager" Jul 23 21:49:55.808756 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.808711 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90415272-02a8-41b0-a86a-98fff52070c0" containerName="manager" Jul 23 21:49:55.808791 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.808778 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="90415272-02a8-41b0-a86a-98fff52070c0" containerName="manager" Jul 23 21:49:55.811971 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.811953 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.821665 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.821646 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m4gt\"/\"default-dockercfg-t8fz8\"" Jul 23 21:49:55.821763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.821678 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"kube-root-ca.crt\"" Jul 23 21:49:55.824197 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.824175 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"openshift-service-ca.crt\"" Jul 23 21:49:55.827916 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.827893 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/must-gather-n4qgz"] Jul 23 21:49:55.844940 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.844918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlwf\" (UniqueName: \"kubernetes.io/projected/5b18cf43-9095-4c88-a45e-42e5badf0611-kube-api-access-9tlwf\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.845056 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.844950 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b18cf43-9095-4c88-a45e-42e5badf0611-must-gather-output\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.946095 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.946036 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlwf\" (UniqueName: \"kubernetes.io/projected/5b18cf43-9095-4c88-a45e-42e5badf0611-kube-api-access-9tlwf\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.946095 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.946091 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b18cf43-9095-4c88-a45e-42e5badf0611-must-gather-output\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.946458 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.946439 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b18cf43-9095-4c88-a45e-42e5badf0611-must-gather-output\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:55.955036 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:55.955010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlwf\" (UniqueName: \"kubernetes.io/projected/5b18cf43-9095-4c88-a45e-42e5badf0611-kube-api-access-9tlwf\") pod \"must-gather-n4qgz\" (UID: \"5b18cf43-9095-4c88-a45e-42e5badf0611\") " pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:56.121436 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:56.121341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" Jul 23 21:49:56.258107 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:56.258062 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/must-gather-n4qgz"] Jul 23 21:49:56.259617 ip-10-0-132-103 kubenswrapper[2569]: W0723 21:49:56.259591 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b18cf43_9095_4c88_a45e_42e5badf0611.slice/crio-d753c5b16f6c98b157959a4906b6f0ccb45e3e3856222b66e125ecdaa88bf8d1 WatchSource:0}: Error finding container d753c5b16f6c98b157959a4906b6f0ccb45e3e3856222b66e125ecdaa88bf8d1: Status 404 returned error can't find the container with id d753c5b16f6c98b157959a4906b6f0ccb45e3e3856222b66e125ecdaa88bf8d1 Jul 23 21:49:56.298434 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:56.298405 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" event={"ID":"5b18cf43-9095-4c88-a45e-42e5badf0611","Type":"ContainerStarted","Data":"d753c5b16f6c98b157959a4906b6f0ccb45e3e3856222b66e125ecdaa88bf8d1"} Jul 23 21:49:58.318281 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:58.318240 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" event={"ID":"5b18cf43-9095-4c88-a45e-42e5badf0611","Type":"ContainerStarted","Data":"5d9e7a73d87c0ce0eebe41a550062dfdd8680ccee66889977c3f2564559a64d3"} Jul 23 21:49:58.318787 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:58.318298 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" event={"ID":"5b18cf43-9095-4c88-a45e-42e5badf0611","Type":"ContainerStarted","Data":"80b8c658c6b10ee2906423b1d7476f4d074069aa51fa493fec4f7d5056adc4f7"} Jul 23 21:49:58.338128 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:58.338031 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m4gt/must-gather-n4qgz" podStartSLOduration=2.38431348 podStartE2EDuration="3.338010225s" totalImagesPullingTime="953.696745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:49:58.336245881 +0000 UTC m=+1435.853140941" watchObservedRunningTime="2026-07-23 21:49:58.338010225 +0000 UTC m=+1435.854905285" Jul 23 21:49:58.932155 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:58.932112 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hnpw7_b238b0a9-eae5-4093-b71b-f3d74e66a2d9/global-pull-secret-syncer/0.log" Jul 23 21:49:59.078985 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:59.078948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r6w8p_3ed946ab-20a3-4fec-ad08-eff4c3d22642/konnectivity-agent/0.log" Jul 23 21:49:59.124183 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:49:59.124152 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-103.ec2.internal_58b77fc7576202595728da24c1fb8b2a/haproxy/0.log" Jul 23 21:50:04.286161 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.286097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/extract/0.log" Jul 23 21:50:04.313107 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.313006 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/util/0.log" Jul 23 21:50:04.339484 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.339446 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595frtj_541d142f-3796-444c-8afb-9ee79df47b18/pull/0.log" Jul 23 21:50:04.376822 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.376756 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/extract/0.log" Jul 23 21:50:04.400781 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.400596 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/util/0.log" Jul 23 21:50:04.422645 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.422622 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kb5dk_695cf79a-65ff-4f35-8aad-b459956f53b9/pull/0.log" Jul 23 21:50:04.449557 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.449483 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/extract/0.log" Jul 23 21:50:04.471336 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.471297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/util/0.log" Jul 23 21:50:04.495203 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.495163 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735kghg_8759c3e0-c0c5-4db7-91d2-4ed4d3e82265/pull/0.log" Jul 23 21:50:04.522563 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.522540 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/extract/0.log" Jul 23 21:50:04.546608 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.546479 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/util/0.log" Jul 23 21:50:04.568476 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.568451 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwfwf_42819203-1c0c-408e-899b-25b9a14fe707/pull/0.log" Jul 23 21:50:04.822856 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:04.822780 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-62vmj_cd4b8f04-115b-4351-96cd-0dc5efc1fe11/manager/0.log" Jul 23 21:50:06.364517 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.364481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/alertmanager/0.log" Jul 23 21:50:06.394490 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.394461 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/config-reloader/0.log" Jul 23 21:50:06.428267 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.428240 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/kube-rbac-proxy-web/0.log" Jul 23 21:50:06.466841 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.466806 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/kube-rbac-proxy/0.log" Jul 23 21:50:06.495458 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.495427 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/kube-rbac-proxy-metric/0.log" Jul 23 21:50:06.522933 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.522907 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/prom-label-proxy/0.log" Jul 23 21:50:06.547120 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.547065 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7644c3e5-1ebf-492c-bbf0-e0fc7c2a7ef6/init-config-reloader/0.log" Jul 23 21:50:06.594784 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.594755 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-bfkxz_112b6c2f-e3f9-4c4d-ba6a-baca6a0625e1/cluster-monitoring-operator/0.log" Jul 23 21:50:06.625380 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.625310 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-6b5x8_726aca89-eea9-4006-9501-93f60d7d9444/kube-state-metrics/0.log" Jul 23 21:50:06.648648 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.648610 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-6b5x8_726aca89-eea9-4006-9501-93f60d7d9444/kube-rbac-proxy-main/0.log" Jul 23 21:50:06.670174 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.670096 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-6b5x8_726aca89-eea9-4006-9501-93f60d7d9444/kube-rbac-proxy-self/0.log" Jul 23 21:50:06.764003 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.763978 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5g66p_9a69f45f-33fc-43e9-9e6b-1a680b9a245e/node-exporter/0.log" Jul 23 21:50:06.786979 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.786953 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5g66p_9a69f45f-33fc-43e9-9e6b-1a680b9a245e/kube-rbac-proxy/0.log" Jul 23 21:50:06.812180 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.812157 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5g66p_9a69f45f-33fc-43e9-9e6b-1a680b9a245e/init-textfile/0.log" Jul 23 21:50:06.982223 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:06.982141 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78578_e3aa517d-aa1d-413a-82cc-16c3b1449a74/kube-rbac-proxy-main/0.log" Jul 23 21:50:07.016249 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.016222 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78578_e3aa517d-aa1d-413a-82cc-16c3b1449a74/kube-rbac-proxy-self/0.log" Jul 23 21:50:07.038437 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.038382 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78578_e3aa517d-aa1d-413a-82cc-16c3b1449a74/openshift-state-metrics/0.log" Jul 23 21:50:07.286265 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.286228 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-xstt6_e243b107-bebf-45a9-9d35-4dbe631f9447/prometheus-operator-admission-webhook/0.log" Jul 23 21:50:07.316632 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.316603 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6954f5f6-6d755_de25a059-9050-4a6b-91b1-4f9c5d5c19a2/telemeter-client/0.log" Jul 23 21:50:07.338763 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.338728 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6954f5f6-6d755_de25a059-9050-4a6b-91b1-4f9c5d5c19a2/reload/0.log" Jul 23 21:50:07.359602 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.359577 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6954f5f6-6d755_de25a059-9050-4a6b-91b1-4f9c5d5c19a2/kube-rbac-proxy/0.log" Jul 23 21:50:07.389448 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.389419 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/thanos-query/0.log" Jul 23 21:50:07.421679 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.421651 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/kube-rbac-proxy-web/0.log" Jul 23 21:50:07.443088 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.443044 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/kube-rbac-proxy/0.log" Jul 23 21:50:07.463968 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.463943 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/prom-label-proxy/0.log" Jul 23 21:50:07.484837 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.484806 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/kube-rbac-proxy-rules/0.log" Jul 23 21:50:07.505326 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:07.505259 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d69574b6-69gv4_b56c626b-fb3d-492b-8e88-ca8cd43b648b/kube-rbac-proxy-metrics/0.log" Jul 23 21:50:08.239957 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.239925 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb"] Jul 23 21:50:08.246243 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.246213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.251905 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.251874 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb"] Jul 23 21:50:08.385531 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.385498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-proc\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.385785 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.385769 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-podres\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.385972 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.385952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxpbb\" (UniqueName: \"kubernetes.io/projected/4fef4ee3-4b46-46ee-8316-f172d3d272a9-kube-api-access-lxpbb\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.386172 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.386151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-lib-modules\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.386314 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.386294 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-sys\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.487715 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-lib-modules\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-sys\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-proc\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-podres\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487846 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-lib-modules\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487857 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-proc\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-sys\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487903 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxpbb\" (UniqueName: \"kubernetes.io/projected/4fef4ee3-4b46-46ee-8316-f172d3d272a9-kube-api-access-lxpbb\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.488190 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.487927 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fef4ee3-4b46-46ee-8316-f172d3d272a9-podres\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.497230 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.497202 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxpbb\" (UniqueName: \"kubernetes.io/projected/4fef4ee3-4b46-46ee-8316-f172d3d272a9-kube-api-access-lxpbb\") pod \"perf-node-gather-daemonset-htfpb\" (UID: \"4fef4ee3-4b46-46ee-8316-f172d3d272a9\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.561010 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.560977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:08.755438 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:08.755407 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb"] Jul 23 21:50:09.270281 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.270255 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/1.log" Jul 23 21:50:09.277889 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.277863 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ppfbn_3278619c-e21d-4b61-b93f-29347c59da27/console-operator/2.log" Jul 23 21:50:09.434351 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.434312 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" event={"ID":"4fef4ee3-4b46-46ee-8316-f172d3d272a9","Type":"ContainerStarted","Data":"f8979ec64bb99156991be916521e5afa95589258907424add50a2a7f312ff7f6"} Jul 23 21:50:09.434549 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.434381 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" event={"ID":"4fef4ee3-4b46-46ee-8316-f172d3d272a9","Type":"ContainerStarted","Data":"0fffd9e085f6f6a28b9e481d94c68e5fffaefc36993bb69fe46ebe2367860957"} Jul 23 21:50:09.434549 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.434411 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:09.453184 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.453124 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" podStartSLOduration=1.453102677 podStartE2EDuration="1.453102677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:50:09.450409087 +0000 UTC m=+1446.967304147" watchObservedRunningTime="2026-07-23 21:50:09.453102677 +0000 UTC m=+1446.969997733" Jul 23 21:50:09.738266 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.738192 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68c76666c9-5jqnb_d53215fd-e1fa-4366-b0e1-e847c6ff4e2b/console/0.log" Jul 23 21:50:09.768733 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:09.768704 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-56bsk_455d1fd7-23a7-4f0e-a923-3a569e285da6/download-server/0.log" Jul 23 21:50:11.353230 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:11.353158 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rfg5_c2193f99-506e-4e9f-9d40-615f7b2aba37/dns/0.log" Jul 23 21:50:11.371298 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:11.371271 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rfg5_c2193f99-506e-4e9f-9d40-615f7b2aba37/kube-rbac-proxy/0.log" Jul 23 21:50:11.444220 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:11.444193 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxdkv_61017217-5c58-404f-9156-7f84d6582f73/dns-node-resolver/0.log" Jul 23 21:50:12.060461 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:12.060436 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qn96_c5363779-23fc-49b7-bf64-caf7c771214c/node-ca/0.log" Jul 23 21:50:13.059415 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:13.059388 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9lbv_23f78a53-824c-44d0-8413-4b528d3b5018/istio-proxy/0.log" Jul 23 21:50:13.194550 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:13.194522 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b98bc9bd8-8qf2h_1efd1344-252e-49b2-8894-d6bb533078a7/router/0.log" Jul 23 21:50:13.781462 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:13.781432 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jd6dq_793b7480-eba1-4622-b1bd-149a01f96a41/serve-healthcheck-canary/0.log" Jul 23 21:50:14.311824 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:14.311792 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgght_713c6710-f99d-472c-8ab6-9e12d72ab651/kube-rbac-proxy/0.log" Jul 23 21:50:14.333272 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:14.333248 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgght_713c6710-f99d-472c-8ab6-9e12d72ab651/exporter/0.log" Jul 23 21:50:14.353333 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:14.353304 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgght_713c6710-f99d-472c-8ab6-9e12d72ab651/extractor/0.log" Jul 23 21:50:15.456736 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:15.456700 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-htfpb" Jul 23 21:50:16.642173 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.642143 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rxljn_b4131d71-5625-4c54-88bb-72d284226976/manager/0.log" Jul 23 21:50:16.668345 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.668271 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tqq7c_3ade8af3-ab84-4349-82d9-6b26fe99928b/manager/0.log" Jul 23 21:50:16.693754 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.693724 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86877bcff5-k522l_1446d1de-8560-4244-8aec-cd2e6aefce5c/manager/4.log" Jul 23 21:50:16.694171 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.694144 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86877bcff5-k522l_1446d1de-8560-4244-8aec-cd2e6aefce5c/manager/3.log" Jul 23 21:50:16.788999 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.788969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-56xlw_0826338c-b9d4-4c8c-b669-5bcca902060c/manager/0.log" Jul 23 21:50:16.815534 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:16.815505 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-56xlw_0826338c-b9d4-4c8c-b669-5bcca902060c/copy-manifests/0.log" Jul 23 21:50:18.349859 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:18.349827 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-746c6b6887-8jvvm_f46b8b42-2677-478a-8c22-805554082dde/manager/0.log" Jul 23 21:50:18.378130 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:18.378091 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gfkjn_7fb03f7b-2c2e-4f67-9c3a-187d237bc9e0/openshift-lws-operator/0.log" Jul 23 21:50:19.186387 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:19.186357 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9lbv_23f78a53-824c-44d0-8413-4b528d3b5018/istio-proxy/0.log" Jul 23 21:50:19.280390 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:19.280365 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b98bc9bd8-8qf2h_1efd1344-252e-49b2-8894-d6bb533078a7/router/0.log" Jul 23 21:50:20.291611 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:20.291587 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9lbv_23f78a53-824c-44d0-8413-4b528d3b5018/istio-proxy/0.log" Jul 23 21:50:20.386897 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:20.386873 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b98bc9bd8-8qf2h_1efd1344-252e-49b2-8894-d6bb533078a7/router/0.log" Jul 23 21:50:23.627964 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:23.627933 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-24fh7_64d08acf-af16-4a1c-9158-20747578bc85/kube-storage-version-migrator-operator/1.log" Jul 23 21:50:23.629161 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:23.629123 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-24fh7_64d08acf-af16-4a1c-9158-20747578bc85/kube-storage-version-migrator-operator/0.log" Jul 23 21:50:24.603792 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:24.603753 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-29gw7_a9e16765-d35a-458b-90e2-8b8af35b72d4/kube-multus/0.log" Jul 23 21:50:24.953287 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:24.953220 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/kube-multus-additional-cni-plugins/0.log" Jul 23 21:50:24.972532 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:24.972500 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/egress-router-binary-copy/0.log" Jul 23 21:50:24.990760 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:24.990742 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/cni-plugins/0.log" Jul 23 21:50:25.012179 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.012162 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/bond-cni-plugin/0.log" Jul 23 21:50:25.031571 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.031541 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/routeoverride-cni/0.log" Jul 23 21:50:25.051089 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.051049 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/whereabouts-cni-bincopy/0.log" Jul 23 21:50:25.072344 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.072311 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpmnh_782aebb8-4e5d-4a0c-ab00-607c8346add7/whereabouts-cni/0.log" Jul 23 21:50:25.124047 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.124022 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-67t9z_b7d7f64d-333d-403e-816b-11a767b1ba2f/network-metrics-daemon/0.log" Jul 23 21:50:25.142018 ip-10-0-132-103 kubenswrapper[2569]: I0723 21:50:25.141996 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-67t9z_b7d7f64d-333d-403e-816b-11a767b1ba2f/kube-rbac-proxy/0.log"