Jul 01 19:35:12.205220 ip-10-0-138-21 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.749241 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757419 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757432 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757435 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757438 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757441 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757444 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757447 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.827216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757450 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757452 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757455 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757457 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757460 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757463 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757465 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757468 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757470 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757473 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757475 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757480 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757484 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757487 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757490 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757493 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757496 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757498 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757502 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.828481 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757505 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757508 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757510 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757513 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757520 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757523 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757526 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757530 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757534 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757537 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757539 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757542 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757545 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757547 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757550 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757552 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757555 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757557 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757560 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.829326 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757563 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757566 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757569 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757571 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757574 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757577 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757580 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757582 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757584 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757587 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757590 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757592 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757595 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757597 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757602 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757606 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757608 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757611 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757613 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.830347 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757616 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757618 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757621 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757623 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757626 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757628 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757631 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757633 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757636 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757638 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757640 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757643 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757645 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757666 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757672 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757675 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757678 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757680 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757683 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757686 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757689 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.831839 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757691 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757694 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757699 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757702 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757704 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757707 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757710 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757713 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757715 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757718 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757720 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757723 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757725 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.757728 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758434 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758440 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758443 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758446 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758448 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758451 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.832722 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758454 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758457 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758460 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758462 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758467 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758470 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758472 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758475 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758477 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758480 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758484 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758487 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758489 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758493 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758496 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758498 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758501 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758504 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758507 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.833543 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758509 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758512 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758514 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758517 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758520 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758522 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758524 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758527 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758529 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758534 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758538 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758541 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758544 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758546 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758548 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758551 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758553 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758556 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758559 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.834455 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758561 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758564 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758567 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758569 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758572 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758575 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758577 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758580 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758583 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758585 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758590 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758593 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758596 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758599 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758602 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758605 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758609 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758612 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758615 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.835216 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758617 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758620 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758623 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758626 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758628 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758631 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758633 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758636 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758639 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758642 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758645 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758647 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758650 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758653 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758655 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758657 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758660 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758663 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758665 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758668 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.835848 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758671 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758673 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758679 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758683 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758686 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758689 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758691 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758694 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758697 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758699 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758701 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758704 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758707 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.758709 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759093 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759098 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759101 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759104 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759107 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.836651 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759113 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759115 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759118 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759120 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759123 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759126 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759128 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759130 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759133 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759136 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759140 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759144 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759149 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759151 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759154 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759158 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759161 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759164 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759168 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.837348 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759171 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759173 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759176 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759179 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759181 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759183 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759186 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759188 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759191 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759193 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759196 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759198 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759201 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759204 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759207 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759210 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759212 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759216 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759218 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759221 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.837997 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759223 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.837427 ip-10-0-138-21 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759226 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759228 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759231 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759233 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759237 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759241 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759244 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759247 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759249 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759251 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759254 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759257 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759260 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759262 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759265 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759268 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759270 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759273 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.839151 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759275 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759278 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759280 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759283 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759285 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759288 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759292 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759295 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759297 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759300 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759302 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759305 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759307 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759310 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759312 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759314 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759317 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759319 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759323 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759326 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.839960 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759329 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759331 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759334 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759336 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759339 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759341 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759343 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759346 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759348 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759351 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759353 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759355 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759358 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759360 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759363 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.759365 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759431 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759437 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759449 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759453 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:35:12.840568 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759457 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759460 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759464 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759468 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759471 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759474 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759477 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759481 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759484 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759486 2579 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759491 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759493 2579 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759497 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759500 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759504 2579 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759507 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759510 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759513 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759516 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759520 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759523 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759526 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759529 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759532 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:35:12.841338 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759535 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759538 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759541 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759543 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759548 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759551 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759555 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759558 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759560 2579 flags.go:64] FLAG: --enable-server="true" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759563 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759568 2579 flags.go:64] FLAG: --event-burst="100" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759571 2579 flags.go:64] FLAG: --event-qps="50" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759574 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759577 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759580 2579 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759583 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759586 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759589 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759593 2579 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759596 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759598 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759602 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759605 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759608 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759611 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:35:12.842106 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759613 2579 flags.go:64] FLAG: --feature-gates="" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759617 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759620 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759623 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759626 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759628 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759631 2579 flags.go:64] FLAG: --help="false" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759634 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-21.ec2.internal" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759637 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759640 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759643 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759646 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759649 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759653 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759656 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759658 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759661 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759664 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759667 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759670 2579 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759672 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759675 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759678 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759681 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:35:12.842915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759684 2579 flags.go:64] FLAG: --lock-file="" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759688 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759690 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759693 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759698 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759702 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759705 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759707 2579 flags.go:64] FLAG: --logging-format="text" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759710 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759713 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759717 2579 flags.go:64] FLAG: --manifest-url="" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759719 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759723 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759726 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759729 2579 flags.go:64] FLAG: --max-pods="110" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759732 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759735 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759738 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759741 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759743 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759746 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759751 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759758 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759761 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759764 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:35:12.843560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759767 2579 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759770 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759775 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759778 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759781 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759783 2579 flags.go:64] FLAG: --port="10250" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759786 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759789 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc7118c9e524238f" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759793 2579 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759796 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759799 2579 flags.go:64] FLAG: --register-node="true" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759802 2579 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759805 2579 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759809 2579 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759811 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759814 2579 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759818 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759820 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759823 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759826 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759829 2579 flags.go:64] FLAG: --runonce="false" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759832 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759835 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759838 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759841 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:35:12.844288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759843 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759846 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759849 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759852 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759856 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759859 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759875 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759878 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759881 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759884 2579 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759887 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759892 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759895 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759898 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759901 2579 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759906 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759908 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759911 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759914 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759917 2579 flags.go:64] FLAG: --v="2" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759921 2579 flags.go:64] FLAG: --version="false" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759925 2579 flags.go:64] FLAG: --vmodule="" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759929 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.759932 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760046 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.845027 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760049 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760052 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760055 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760058 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760060 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760063 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760066 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760069 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760072 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760074 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760077 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760081 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760083 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760086 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760089 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760091 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760094 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760096 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760099 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760101 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.845617 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760104 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760106 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760111 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760113 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760116 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760118 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760121 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760123 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760126 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760129 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760132 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760136 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760139 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760142 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760145 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760148 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760151 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760153 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760156 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.846237 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760158 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760161 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760163 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760166 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760169 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760172 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760174 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760177 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760180 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760182 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760185 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760187 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760190 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760193 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760195 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760198 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760202 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760204 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760207 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760209 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.847066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760212 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760214 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760217 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760220 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760222 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760225 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760227 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760231 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760234 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760237 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760240 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760243 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760246 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760248 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760251 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760253 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760257 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760260 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760262 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.847691 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760265 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760267 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760270 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760272 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760275 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760278 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760280 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760283 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760286 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760288 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760291 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760293 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760296 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760299 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760302 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760306 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760309 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760312 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760315 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.848321 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.760318 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.761131 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768087 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768103 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768116 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768124 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768180 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768184 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768188 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768191 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768194 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768198 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768201 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768204 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.849195 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768207 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768210 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768213 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768216 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768219 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768221 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768224 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768228 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768232 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768235 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768238 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768241 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768244 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768247 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768249 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768252 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768255 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768258 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768261 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768263 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.849913 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768266 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768269 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768272 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768274 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768278 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768282 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768284 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768287 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768289 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768292 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768294 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768296 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768299 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768302 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768304 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768307 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768310 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768312 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768315 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.850554 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768317 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768320 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768322 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768325 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768327 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768330 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768332 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768335 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768337 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768339 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768342 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768345 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768347 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768350 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768353 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768356 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768359 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768362 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768364 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768367 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.851063 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768369 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768372 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768374 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768377 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768379 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768382 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768384 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768387 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768389 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768392 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768395 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768398 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768402 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768404 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768407 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768410 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768412 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768415 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768418 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768420 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.851575 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768423 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768425 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768428 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768431 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768433 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768436 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768441 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768444 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768446 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768449 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768451 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768454 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768459 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768564 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:35:12.852101 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768568 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768571 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768573 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768576 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768578 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768581 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768584 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768587 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768589 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768592 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768595 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768597 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768599 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768602 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768605 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768607 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768610 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768612 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768615 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768617 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:35:12.852681 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768620 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768622 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768625 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768628 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768632 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768635 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768638 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768641 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768643 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768646 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768648 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768651 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768653 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768656 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768658 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768661 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768663 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768666 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768668 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768671 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:35:12.853422 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768673 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768676 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768678 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768681 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768683 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768686 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768689 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768691 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768693 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768697 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768700 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768702 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768705 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768707 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768710 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768713 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768718 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768721 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768724 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:35:12.854035 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768726 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768729 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768731 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768735 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768738 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768741 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768744 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768747 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768749 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768752 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768754 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768757 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768759 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768762 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768765 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768767 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768770 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768772 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768775 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768777 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:35:12.854697 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768780 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768783 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768785 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768788 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768790 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768793 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768796 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768798 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768801 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768816 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768819 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768821 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768824 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768826 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768829 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768831 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768834 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768836 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:35:12.855482 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:12.768840 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768845 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.768965 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.770998 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.772547 2579 server.go:1019] "Starting client certificate rotation" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.772647 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.773515 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.775974 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.795626 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.806572 2579 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.808985 2579 log.go:25] "Validated CRI v1 image API" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.809709 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:35:12.856394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.812394 2579 fs.go:135] Filesystem UUIDs: map[3fe75018-d08c-4e81-af5a-b58ff7722153:/dev/nvme0n1p4 549e3d9d-01f3-4851-9bdd-eb5397c2500c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:35:12.856914 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.812412 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.816705 2579 manager.go:216] Machine: {Timestamp:2026-07-01 19:35:12.816203904 +0000 UTC m=+0.442642979 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084016 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24478d0f06a1b00783a523c01d55ef SystemUUID:ec24478d-0f06-a1b0-0783-a523c01d55ef BootID:fa5e81bc-1f9e-4daf-acfb-4afce997e453 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:96:3f:5f:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:96:3f:5f:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:cd:df:a5:f1:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.816820 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.816925 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.819206 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.819242 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.820532 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.820549 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:35:12.856971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.820560 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.820579 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.821732 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825009 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825157 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825549 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825560 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825576 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825586 2579 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825595 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825984 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.825999 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.828476 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.829305 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831059 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831093 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831828 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831846 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831855 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831881 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831894 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831902 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831934 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831943 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831955 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831963 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831975 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.831986 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.832008 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.832016 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.836472 2579 server.go:1268] "Started kubelet" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.837041 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.837048 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.837102 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.838753 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.840276 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.842426 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.842872 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.842856 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:35:12.857397 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.844075 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.846252 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.846261 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.846534 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.846994 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.847012 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.847055 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.847156 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.847165 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.852975 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853101 2579 factory.go:55] Registering systemd factory Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853116 2579 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853322 2579 factory.go:153] Registering CRI-O factory Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853338 2579 factory.go:223] Registration of the crio container factory successfully Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853404 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853430 2579 factory.go:103] Registering Raw factory Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.853448 2579 manager.go:1196] Started watching for new ooms in manager Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.848734 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-21.ec2.internal.18be417e3766669c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-21.ec2.internal,UID:ip-10-0-138-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-21.ec2.internal,},FirstTimestamp:2026-07-01 19:35:12.83643766 +0000 UTC m=+0.462876735,LastTimestamp:2026-07-01 19:35:12.83643766 +0000 UTC m=+0.462876735,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-21.ec2.internal,}" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.854173 2579 manager.go:349] Starting recovery of all containers Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.857393 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b4qvq" Jul 01 19:35:12.859056 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.858225 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:35:12.862908 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.862890 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b4qvq" Jul 01 19:35:12.864233 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.864220 2579 manager.go:354] Recovery completed Jul 01 19:35:12.869502 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.869489 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:12.871293 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871274 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:12.871346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871305 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:12.871346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871320 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:12.871842 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871824 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:35:12.871842 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871840 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:35:12.871966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871856 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:35:12.871966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.871839 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:12.872583 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.872569 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:12.872640 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.872594 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:12.872640 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.872604 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:12.873006 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.872993 2579 policy_none.go:49] "None policy: Start" Jul 01 19:35:12.873061 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.873011 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:35:12.873061 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.873024 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:35:12.874252 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.874241 2579 policy_none.go:47] "Start" Jul 01 19:35:12.914758 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.914542 2579 manager.go:337] "Starting Device Plugin manager" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.914774 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.914794 2579 server.go:87] "Starting device plugin registration server" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.915102 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.915115 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.915265 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.915345 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.915353 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.915856 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.915941 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.918987 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.920249 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.920285 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.920303 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:12.920332 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:35:12.929373 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:12.924335 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:13.015490 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.015393 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:13.016446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.016427 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:13.016533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.016462 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:13.016533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.016472 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:13.016533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.016501 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.020589 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.020565 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal"] Jul 01 19:35:13.020648 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.020639 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:13.022305 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.022279 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:13.022427 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.022317 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:13.022427 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.022328 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:13.023828 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.023814 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:13.023955 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.023935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.024004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.023970 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:13.024576 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024559 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:13.024661 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024587 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:13.024661 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024597 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:13.024661 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024566 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:13.024661 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024655 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:13.024846 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.024666 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:13.025698 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.025683 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.025822 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.025703 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-21.ec2.internal\": node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.026118 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.026097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.026167 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.026121 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:35:13.026752 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.026736 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:35:13.026825 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.026766 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:35:13.026825 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.026777 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:35:13.041431 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.041414 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-21.ec2.internal\" not found" node="ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.045130 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.045116 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-21.ec2.internal\" not found" node="ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.047292 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.047273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.047371 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.047298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.047371 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.047314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a87c635a4fd37941e7463055cab2cf8a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"a87c635a4fd37941e7463055cab2cf8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.053258 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.053242 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.147767 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.147767 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.148004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a87c635a4fd37941e7463055cab2cf8a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"a87c635a4fd37941e7463055cab2cf8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.148004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147827 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a87c635a4fd37941e7463055cab2cf8a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"a87c635a4fd37941e7463055cab2cf8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.148004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.148004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.147846 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ecfb2d5c0f926017f7892061c810d23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"5ecfb2d5c0f926017f7892061c810d23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.153888 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.153852 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.254700 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.254661 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.345429 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.345364 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.348838 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.348697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.355258 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.355241 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.455775 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.455728 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.556337 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.556294 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.656959 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.656888 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 01 19:35:13.699719 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.699694 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:13.746687 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.746659 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.767722 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.767699 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:35:13.769883 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.769860 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.771720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.771705 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:35:13.771855 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.771836 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:35:13.771946 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.771883 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:35:13.771946 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.771904 2579 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a583b133831ff488b992bd981a386506-a260bd53b926b82a.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.138.21:60564->100.56.120.136:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:13.826100 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.826064 2579 apiserver.go:52] "Watching apiserver" Jul 01 19:35:13.844898 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.844860 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:35:13.846946 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.845898 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2txg9","openshift-multus/network-metrics-daemon-l8tkd","openshift-network-operator/iptables-alerter-qrxwj","openshift-image-registry/node-ca-l8w54","openshift-multus/multus-additional-cni-plugins-2ltx4","openshift-multus/multus-zcdc9","openshift-network-diagnostics/network-check-target-75fb6","openshift-ovn-kubernetes/ovnkube-node-68kvf","kube-system/global-pull-secret-syncer-mnjlh","kube-system/konnectivity-agent-xgdtt","kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb","openshift-cluster-node-tuning-operator/tuned-rpjwv"] Jul 01 19:35:13.846946 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.846476 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:35:13.847964 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.847945 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:13.848068 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.848020 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:13.849224 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.849207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:13.849305 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.849261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:13.850423 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.850408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:13.851613 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.851594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:13.851722 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.851702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:13.853617 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.853590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.853716 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.853627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.853882 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.853851 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sqxhl\"" Jul 01 19:35:13.854113 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854097 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.854153 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854116 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:35:13.854385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854370 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:35:13.854451 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854412 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.854497 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854486 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhpsx\"" Jul 01 19:35:13.854915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.854899 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.855203 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.855190 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.855958 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.855943 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:35:13.856716 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.856704 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:13.857405 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.857405 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7vs2h\"" Jul 01 19:35:13.857601 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857415 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.857601 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857457 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:35:13.857722 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:35:13.857771 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.857756 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:13.858413 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.858385 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhpnh\"" Jul 01 19:35:13.858498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.858463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.859198 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.859183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:35:13.859628 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.859613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55q9g\"" Jul 01 19:35:13.859798 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.859780 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.859903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.859829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:13.859953 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.859921 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:13.861216 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.861200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:13.861351 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.861333 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:35:13.861970 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.861956 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wwgl\"" Jul 01 19:35:13.862072 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.862029 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.862662 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.862632 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.862768 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.862671 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:35:13.862768 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.862694 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:35:13.862768 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.862698 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:35:13.863248 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.863220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.864757 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.864088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:35:13.864757 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.864152 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:35:13.864757 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.864304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gtz8p\"" Jul 01 19:35:13.865114 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.865088 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:35:13.865191 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.865177 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.865883 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.865354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.865883 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.865766 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:35:13.866023 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.865934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.866299 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.866141 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.866922 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.866285 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2k4xb\"" Jul 01 19:35:13.866922 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.866510 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:30:13 +0000 UTC" deadline="2028-02-03 17:22:12.958355287 +0000 UTC" Jul 01 19:35:13.866922 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.866548 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13965h46m59.09181081s" Jul 01 19:35:13.867839 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.867504 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:13.868242 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.868012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p5vsv\"" Jul 01 19:35:13.868580 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.868561 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:13.889985 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:13.889945 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecfb2d5c0f926017f7892061c810d23.slice/crio-b99e24d87bebe9d3ae50cf34c83fbe54a096dccee4e4708ce7e5b4582756525c WatchSource:0}: Error finding container b99e24d87bebe9d3ae50cf34c83fbe54a096dccee4e4708ce7e5b4582756525c: Status 404 returned error can't find the container with id b99e24d87bebe9d3ae50cf34c83fbe54a096dccee4e4708ce7e5b4582756525c Jul 01 19:35:13.897523 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.897503 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:35:13.901318 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.901281 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgvgk" Jul 01 19:35:13.912189 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.912158 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgvgk" Jul 01 19:35:13.924363 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.924310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"5ecfb2d5c0f926017f7892061c810d23","Type":"ContainerStarted","Data":"b99e24d87bebe9d3ae50cf34c83fbe54a096dccee4e4708ce7e5b4582756525c"} Jul 01 19:35:13.948607 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.948586 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:35:13.952551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-kubernetes\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.952680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-host\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.952680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxzq\" (UniqueName: \"kubernetes.io/projected/4d447735-9d53-4dc9-a240-968105c12d01-kube-api-access-tcxzq\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:13.952680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-ovn\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.952680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z577c\" (UniqueName: \"kubernetes.io/projected/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-kube-api-access-z577c\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-cni-binary-copy\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-socket-dir-parent\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-daemon-config\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-slash\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-env-overrides\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.952847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-systemd\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-host\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-system-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-k8s-cni-cncf-io\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-multus\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.952967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysconfig\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-hostroot\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-conf-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-systemd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-etc-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-node-log\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.953200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-sys-fs\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-tuned\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-cnibin\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-socket-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-run\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmzw\" (UniqueName: \"kubernetes.io/projected/dc5f0b87-a267-4ec6-9a23-78eab177b2da-kube-api-access-4xmzw\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-netns\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d447735-9d53-4dc9-a240-968105c12d01-hosts-file\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d447735-9d53-4dc9-a240-968105c12d01-tmp-dir\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8244bbf7-0229-4681-9611-71e7e63301cb-agent-certs\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-conf\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-kubelet\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-bin\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:13.953837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-registration-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-var-lib-kubelet\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-etc-kubernetes\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-log-socket\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pqx\" (UniqueName: \"kubernetes.io/projected/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-kube-api-access-w7pqx\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953711 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-netd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-dbus\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stt2g\" (UniqueName: \"kubernetes.io/projected/50305bf7-c186-430a-b245-c03c0e23f000-kube-api-access-stt2g\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.954530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nffkw\" (UniqueName: \"kubernetes.io/projected/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-kube-api-access-nffkw\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-cnibin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-config\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-system-cni-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.953980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-os-release\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-device-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-bin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-script-lib\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-kubelet-config\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-kubelet\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-netns\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955049 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz6rp\" (UniqueName: \"kubernetes.io/projected/128a70c9-323b-471e-8ac3-1a6c59514408-kube-api-access-bz6rp\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-sys\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-lib-modules\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-serviceca\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50305bf7-c186-430a-b245-c03c0e23f000-iptables-alerter-script\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vh59\" (UniqueName: \"kubernetes.io/projected/4081b4df-525a-43ae-9388-b39d564cadf7-kube-api-access-4vh59\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-modprobe-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gsw\" (UniqueName: \"kubernetes.io/projected/84475ee1-3651-4e38-a2b2-6643bc601dda-kube-api-access-j4gsw\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50305bf7-c186-430a-b245-c03c0e23f000-host-slash\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8244bbf7-0229-4681-9611-71e7e63301cb-konnectivity-ca\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-tmp\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-os-release\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-multus-certs\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-systemd-units\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-var-lib-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955921 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovn-node-metrics-cert\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:13.955921 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:13.954708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:13.961942 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.961915 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:13.961942 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.961935 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:13.962076 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.961960 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:13.962076 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:13.962020 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:14.462003296 +0000 UTC m=+2.088442360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:14.038371 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.038342 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:14.056022 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.055990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vh59\" (UniqueName: \"kubernetes.io/projected/4081b4df-525a-43ae-9388-b39d564cadf7-kube-api-access-4vh59\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.056022 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-modprobe-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gsw\" (UniqueName: \"kubernetes.io/projected/84475ee1-3651-4e38-a2b2-6643bc601dda-kube-api-access-j4gsw\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50305bf7-c186-430a-b245-c03c0e23f000-host-slash\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8244bbf7-0229-4681-9611-71e7e63301cb-konnectivity-ca\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-tmp\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-os-release\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50305bf7-c186-430a-b245-c03c0e23f000-host-slash\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-multus-certs\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-modprobe-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-multus-certs\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-systemd-units\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-var-lib-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-systemd-units\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.056334 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovn-node-metrics-cert\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-var-lib-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-kubernetes\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-host\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxzq\" (UniqueName: \"kubernetes.io/projected/4d447735-9d53-4dc9-a240-968105c12d01-kube-api-access-tcxzq\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-os-release\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-ovn\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-kubernetes\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z577c\" (UniqueName: \"kubernetes.io/projected/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-kube-api-access-z577c\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-host\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056517 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-cni-binary-copy\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-socket-dir-parent\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-daemon-config\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057066 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-slash\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-env-overrides\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056709 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-ovn\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-systemd\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8244bbf7-0229-4681-9611-71e7e63301cb-konnectivity-ca\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-host\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.056796 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-system-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-k8s-cni-cncf-io\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-multus\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.056900 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:14.556873446 +0000 UTC m=+2.183312531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056884 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.057860 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056946 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-multus\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysconfig\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-hostroot\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-systemd\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-host\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-conf-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-systemd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-etc-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-node-log\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-sys-fs\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-tuned\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-cnibin\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-socket-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.058658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-run\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmzw\" (UniqueName: \"kubernetes.io/projected/dc5f0b87-a267-4ec6-9a23-78eab177b2da-kube-api-access-4xmzw\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-netns\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d447735-9d53-4dc9-a240-968105c12d01-hosts-file\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d447735-9d53-4dc9-a240-968105c12d01-tmp-dir\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8244bbf7-0229-4681-9611-71e7e63301cb-agent-certs\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-conf\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-kubelet\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057440 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-env-overrides\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-bin\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057468 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-cni-binary-copy\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-registration-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057546 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-socket-dir-parent\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-var-lib-kubelet\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.059517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057577 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-etc-kubernetes\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057590 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-k8s-cni-cncf-io\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.056898 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-slash\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-log-socket\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pqx\" (UniqueName: \"kubernetes.io/projected/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-kube-api-access-w7pqx\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-cnibin\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057071 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-system-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-socket-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-run-systemd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-run\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-sys-fs\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.060301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-etc-openvswitch\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-conf\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d447735-9d53-4dc9-a240-968105c12d01-hosts-file\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058090 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-bin\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-node-log\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-run-netns\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.058189 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-log-socket\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-daemon-config\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.058239 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:14.558222259 +0000 UTC m=+2.184661328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058243 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-registration-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.060766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-netd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-var-lib-kubelet\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-hostroot\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-dbus\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-etc-kubernetes\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d447735-9d53-4dc9-a240-968105c12d01-tmp-dir\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058362 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-conf-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.057847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058405 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-kubelet\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-cni-netd\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stt2g\" (UniqueName: \"kubernetes.io/projected/50305bf7-c186-430a-b245-c03c0e23f000-kube-api-access-stt2g\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysctl-d\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nffkw\" (UniqueName: \"kubernetes.io/projected/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-kube-api-access-nffkw\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.061507 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-cnibin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-config\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-dbus\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-system-cni-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-os-release\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-device-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058746 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-system-cni-dir\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-bin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-cnibin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058842 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-script-lib\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.062375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-multus-cni-dir\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.058915 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4081b4df-525a-43ae-9388-b39d564cadf7-os-release\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84475ee1-3651-4e38-a2b2-6643bc601dda-host-var-lib-cni-bin\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-kubelet-config\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/128a70c9-323b-471e-8ac3-1a6c59514408-device-dir\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-kubelet\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-netns\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059150 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/576b371e-5d0d-4e6f-b162-e5966bd53b9c-kubelet-config\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz6rp\" (UniqueName: \"kubernetes.io/projected/128a70c9-323b-471e-8ac3-1a6c59514408-kube-api-access-bz6rp\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059192 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-kubelet\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-sys\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-lib-modules\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-serviceca\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.062773 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50305bf7-c186-430a-b245-c03c0e23f000-iptables-alerter-script\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-config\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-sys\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-host-run-netns\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059572 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovnkube-script-lib\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-lib-modules\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059693 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4081b4df-525a-43ae-9388-b39d564cadf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-sysconfig\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.059977 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50305bf7-c186-430a-b245-c03c0e23f000-iptables-alerter-script\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.060094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-serviceca\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.060892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-tmp\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.061226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8244bbf7-0229-4681-9611-71e7e63301cb-agent-certs\") pod \"konnectivity-agent-xgdtt\" (UID: \"8244bbf7-0229-4681-9611-71e7e63301cb\") " pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.061598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-ovn-node-metrics-cert\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.063263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.061712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc5f0b87-a267-4ec6-9a23-78eab177b2da-etc-tuned\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.063915 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.063898 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87c635a4fd37941e7463055cab2cf8a.slice/crio-a45e22fcf3b55f295aaa9aec6b1a3ac6f6cb639aceb6208aa32661c77a273f2d WatchSource:0}: Error finding container a45e22fcf3b55f295aaa9aec6b1a3ac6f6cb639aceb6208aa32661c77a273f2d: Status 404 returned error can't find the container with id a45e22fcf3b55f295aaa9aec6b1a3ac6f6cb639aceb6208aa32661c77a273f2d Jul 01 19:35:14.081678 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.081639 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gsw\" (UniqueName: \"kubernetes.io/projected/84475ee1-3651-4e38-a2b2-6643bc601dda-kube-api-access-j4gsw\") pod \"multus-zcdc9\" (UID: \"84475ee1-3651-4e38-a2b2-6643bc601dda\") " pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.081812 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.081653 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nffkw\" (UniqueName: \"kubernetes.io/projected/fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd-kube-api-access-nffkw\") pod \"node-ca-l8w54\" (UID: \"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd\") " pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.081906 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.081850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz6rp\" (UniqueName: \"kubernetes.io/projected/128a70c9-323b-471e-8ac3-1a6c59514408-kube-api-access-bz6rp\") pod \"aws-ebs-csi-driver-node-n7rqb\" (UID: \"128a70c9-323b-471e-8ac3-1a6c59514408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.082068 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.082043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxzq\" (UniqueName: \"kubernetes.io/projected/4d447735-9d53-4dc9-a240-968105c12d01-kube-api-access-tcxzq\") pod \"node-resolver-2txg9\" (UID: \"4d447735-9d53-4dc9-a240-968105c12d01\") " pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.082416 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.082395 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pqx\" (UniqueName: \"kubernetes.io/projected/56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e-kube-api-access-w7pqx\") pod \"ovnkube-node-68kvf\" (UID: \"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e\") " pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.083498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.083478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmzw\" (UniqueName: \"kubernetes.io/projected/dc5f0b87-a267-4ec6-9a23-78eab177b2da-kube-api-access-4xmzw\") pod \"tuned-rpjwv\" (UID: \"dc5f0b87-a267-4ec6-9a23-78eab177b2da\") " pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.083675 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.083659 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stt2g\" (UniqueName: \"kubernetes.io/projected/50305bf7-c186-430a-b245-c03c0e23f000-kube-api-access-stt2g\") pod \"iptables-alerter-qrxwj\" (UID: \"50305bf7-c186-430a-b245-c03c0e23f000\") " pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.084071 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.084053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z577c\" (UniqueName: \"kubernetes.io/projected/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-kube-api-access-z577c\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:14.088360 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.088342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vh59\" (UniqueName: \"kubernetes.io/projected/4081b4df-525a-43ae-9388-b39d564cadf7-kube-api-access-4vh59\") pod \"multus-additional-cni-plugins-2ltx4\" (UID: \"4081b4df-525a-43ae-9388-b39d564cadf7\") " pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.183671 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.183574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrxwj" Jul 01 19:35:14.192301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.192274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8w54" Jul 01 19:35:14.192628 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.192605 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50305bf7_c186_430a_b245_c03c0e23f000.slice/crio-266dbdbd8321c63525a8b7b3e08313f174e6e5b711727ab56a0ad9b4e6c7cd3b WatchSource:0}: Error finding container 266dbdbd8321c63525a8b7b3e08313f174e6e5b711727ab56a0ad9b4e6c7cd3b: Status 404 returned error can't find the container with id 266dbdbd8321c63525a8b7b3e08313f174e6e5b711727ab56a0ad9b4e6c7cd3b Jul 01 19:35:14.199458 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.199440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" Jul 01 19:35:14.204465 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.204443 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcdc9" Jul 01 19:35:14.207025 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.207003 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4081b4df_525a_43ae_9388_b39d564cadf7.slice/crio-32a772c3f359c48d1118bb00da01e617504ebb6d4c6021773f0ab82c56f1c764 WatchSource:0}: Error finding container 32a772c3f359c48d1118bb00da01e617504ebb6d4c6021773f0ab82c56f1c764: Status 404 returned error can't find the container with id 32a772c3f359c48d1118bb00da01e617504ebb6d4c6021773f0ab82c56f1c764 Jul 01 19:35:14.210244 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.210221 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2txg9" Jul 01 19:35:14.216905 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.216879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:14.217166 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.217144 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84475ee1_3651_4e38_a2b2_6643bc601dda.slice/crio-a9cb0d27bc6a092f57ecd5e1bff9bc6c8cce7de4c07597b97d240eec4c712861 WatchSource:0}: Error finding container a9cb0d27bc6a092f57ecd5e1bff9bc6c8cce7de4c07597b97d240eec4c712861: Status 404 returned error can't find the container with id a9cb0d27bc6a092f57ecd5e1bff9bc6c8cce7de4c07597b97d240eec4c712861 Jul 01 19:35:14.220713 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.220684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d447735_9d53_4dc9_a240_968105c12d01.slice/crio-7c539dc96801b03ba4b6e044b9a1f3d9b11cbe46944df5da8311286ba005e1e1 WatchSource:0}: Error finding container 7c539dc96801b03ba4b6e044b9a1f3d9b11cbe46944df5da8311286ba005e1e1: Status 404 returned error can't find the container with id 7c539dc96801b03ba4b6e044b9a1f3d9b11cbe46944df5da8311286ba005e1e1 Jul 01 19:35:14.222034 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.222016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:14.226424 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.226394 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a952fa_6cbd_4b79_bf43_1d6a9ccfe52e.slice/crio-27d8b0e41380e88ed14e427e95458014e52e16ddaf4c0faff981d6a2c3fd7fbc WatchSource:0}: Error finding container 27d8b0e41380e88ed14e427e95458014e52e16ddaf4c0faff981d6a2c3fd7fbc: Status 404 returned error can't find the container with id 27d8b0e41380e88ed14e427e95458014e52e16ddaf4c0faff981d6a2c3fd7fbc Jul 01 19:35:14.228864 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.228806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" Jul 01 19:35:14.230642 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.230619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8244bbf7_0229_4681_9611_71e7e63301cb.slice/crio-d4f8f7a24974d226f534adc5e0b181a54d04eac714004dacdcca1c70a471d964 WatchSource:0}: Error finding container d4f8f7a24974d226f534adc5e0b181a54d04eac714004dacdcca1c70a471d964: Status 404 returned error can't find the container with id d4f8f7a24974d226f534adc5e0b181a54d04eac714004dacdcca1c70a471d964 Jul 01 19:35:14.233923 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.233895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" Jul 01 19:35:14.237884 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.237854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128a70c9_323b_471e_8ac3_1a6c59514408.slice/crio-ee7d7797551724e4874b365454bb07cd4dba724a31ce090cc70d448b7ede8e59 WatchSource:0}: Error finding container ee7d7797551724e4874b365454bb07cd4dba724a31ce090cc70d448b7ede8e59: Status 404 returned error can't find the container with id ee7d7797551724e4874b365454bb07cd4dba724a31ce090cc70d448b7ede8e59 Jul 01 19:35:14.243047 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:35:14.243024 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5f0b87_a267_4ec6_9a23_78eab177b2da.slice/crio-124d28a168659c9a3acac0b474f451d9b26c307eb03eee6dde3d2bde982cbd5b WatchSource:0}: Error finding container 124d28a168659c9a3acac0b474f451d9b26c307eb03eee6dde3d2bde982cbd5b: Status 404 returned error can't find the container with id 124d28a168659c9a3acac0b474f451d9b26c307eb03eee6dde3d2bde982cbd5b Jul 01 19:35:14.462453 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.462355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:14.465104 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.462799 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:14.465104 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.462847 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:14.465104 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.462862 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:14.465104 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.462980 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:15.46294718 +0000 UTC m=+3.089386259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:14.563472 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.563430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:14.563680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.563506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:14.563680 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.563603 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:14.563680 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.563621 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:14.563811 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.563698 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:15.563674188 +0000 UTC m=+3.190113277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:14.563811 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:14.563725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:15.563713236 +0000 UTC m=+3.190152300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:14.670655 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.670620 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:14.916224 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.915991 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:30:14 +0000 UTC" deadline="2028-04-06 14:30:29.92387865 +0000 UTC" Jul 01 19:35:14.916224 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.916058 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15474h55m15.007824695s" Jul 01 19:35:14.937720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.937597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"27d8b0e41380e88ed14e427e95458014e52e16ddaf4c0faff981d6a2c3fd7fbc"} Jul 01 19:35:14.944482 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.944344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2txg9" event={"ID":"4d447735-9d53-4dc9-a240-968105c12d01","Type":"ContainerStarted","Data":"7c539dc96801b03ba4b6e044b9a1f3d9b11cbe46944df5da8311286ba005e1e1"} Jul 01 19:35:14.958689 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.958657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcdc9" event={"ID":"84475ee1-3651-4e38-a2b2-6643bc601dda","Type":"ContainerStarted","Data":"a9cb0d27bc6a092f57ecd5e1bff9bc6c8cce7de4c07597b97d240eec4c712861"} Jul 01 19:35:14.973449 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.973409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerStarted","Data":"32a772c3f359c48d1118bb00da01e617504ebb6d4c6021773f0ab82c56f1c764"} Jul 01 19:35:14.992758 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.992712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8w54" event={"ID":"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd","Type":"ContainerStarted","Data":"43155b4ae5e889588faa59a66eba4de5a826414e162c6ad9fed895a110d1c62c"} Jul 01 19:35:14.996116 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:14.996077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrxwj" event={"ID":"50305bf7-c186-430a-b245-c03c0e23f000","Type":"ContainerStarted","Data":"266dbdbd8321c63525a8b7b3e08313f174e6e5b711727ab56a0ad9b4e6c7cd3b"} Jul 01 19:35:15.003048 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.003002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" event={"ID":"dc5f0b87-a267-4ec6-9a23-78eab177b2da","Type":"ContainerStarted","Data":"124d28a168659c9a3acac0b474f451d9b26c307eb03eee6dde3d2bde982cbd5b"} Jul 01 19:35:15.016574 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.016455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" event={"ID":"a87c635a4fd37941e7463055cab2cf8a","Type":"ContainerStarted","Data":"a45e22fcf3b55f295aaa9aec6b1a3ac6f6cb639aceb6208aa32661c77a273f2d"} Jul 01 19:35:15.018755 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.018660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" event={"ID":"128a70c9-323b-471e-8ac3-1a6c59514408","Type":"ContainerStarted","Data":"ee7d7797551724e4874b365454bb07cd4dba724a31ce090cc70d448b7ede8e59"} Jul 01 19:35:15.023857 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.023828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgdtt" event={"ID":"8244bbf7-0229-4681-9611-71e7e63301cb","Type":"ContainerStarted","Data":"d4f8f7a24974d226f534adc5e0b181a54d04eac714004dacdcca1c70a471d964"} Jul 01 19:35:15.472462 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.472425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:15.472682 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.472626 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:15.472682 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.472648 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:15.472682 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.472661 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:15.472859 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.472729 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:17.472710163 +0000 UTC m=+5.099149234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:15.573613 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.573573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:15.573809 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.573643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:15.573809 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.573773 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:15.573931 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.573838 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:17.573819343 +0000 UTC m=+5.200258410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:15.574299 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.574276 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:15.574390 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.574340 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:17.574324043 +0000 UTC m=+5.200763111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:15.917480 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.917167 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:30:14 +0000 UTC" deadline="2028-04-17 01:08:56.10113369 +0000 UTC" Jul 01 19:35:15.917480 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.917208 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15725h33m40.183930372s" Jul 01 19:35:15.920574 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.920547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:15.920713 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.920688 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:15.921443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.921143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:15.921443 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.921246 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:15.921443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:15.921316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:15.921443 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:15.921383 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:16.213011 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:16.212921 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:35:17.491967 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.491936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:17.492453 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.492139 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:17.492453 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.492161 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:17.492453 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.492174 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:17.492453 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.492234 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:21.492215422 +0000 UTC m=+9.118654485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:17.592710 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.592667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:17.592921 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.592745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:17.592978 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.592935 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:17.593027 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.593002 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:21.592983565 +0000 UTC m=+9.219422647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:17.593097 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.593076 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:17.593149 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.593113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:21.593102358 +0000 UTC m=+9.219541426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.920712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.920852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.921244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.921332 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:17.921379 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:17.921517 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:17.921443 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:19.920815 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:19.920740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:19.920815 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:19.920782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:19.921356 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:19.920892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:19.921356 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:19.920908 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:19.921356 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:19.921002 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:19.921356 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:19.921089 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:21.527618 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.527518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:21.528085 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.527709 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:21.528085 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.527731 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:21.528085 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.527742 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:21.528085 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.527789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:29.527776868 +0000 UTC m=+17.154215929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:21.628829 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.628790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:21.628998 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.628858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:21.628998 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.628969 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:21.629162 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.628996 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:21.629162 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.629033 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:29.629018391 +0000 UTC m=+17.255457453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:21.629162 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.629053 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:29.6290424 +0000 UTC m=+17.255481465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.920990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.921122 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.921297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:21.921297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.921420 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:21.921530 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:21.921479 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:23.921382 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:23.921301 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:23.921382 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:23.921330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:23.921382 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:23.921341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:23.921855 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:23.921446 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:23.921855 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:23.921521 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:23.921855 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:23.921570 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:25.921393 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:25.921361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:25.921393 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:25.921385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:25.921802 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:25.921470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:25.921802 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:25.921470 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:25.921802 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:25.921549 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:25.921802 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:25.921619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:27.921508 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:27.921474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:27.921508 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:27.921489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:27.921986 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:27.921588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:27.921986 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:27.921605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:27.921986 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:27.921660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:27.921986 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:27.921739 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:29.588986 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.588731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:29.589522 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.588938 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:29.589522 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.589064 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:29.589522 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.589088 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:29.589522 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.589158 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.589138588 +0000 UTC m=+33.215577659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:29.689916 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.689860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:29.690086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.689933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:29.690086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.689994 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:29.690086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.690029 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:29.690086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.690072 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.690050803 +0000 UTC m=+33.316489865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:29.690273 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.690092 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.69008308 +0000 UTC m=+33.316522146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:29.920551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.920470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:29.920551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.920504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:29.920551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:29.920509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:29.920771 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.920586 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:29.920771 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.920724 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:29.920850 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:29.920822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:31.920616 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:31.920576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:31.921139 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:31.920658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:31.921139 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:31.920804 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:31.921139 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:31.920842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:31.921139 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:31.920982 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:31.921139 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:31.921069 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:33.920536 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:33.920504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:33.920973 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:33.920504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:33.920973 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:33.920714 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:33.920973 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:33.920509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:33.920973 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:33.920602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:33.920973 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:33.920812 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:35.071510 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.071176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" event={"ID":"128a70c9-323b-471e-8ac3-1a6c59514408","Type":"ContainerStarted","Data":"cfa833da982d7830dc9da965d4b2af739b0586566f653f6ab33fddc99fc5ec3b"} Jul 01 19:35:35.073072 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.073013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgdtt" event={"ID":"8244bbf7-0229-4681-9611-71e7e63301cb","Type":"ContainerStarted","Data":"206021172d16bb076f8e84afa9df75fde050c9f2f2082f18af94929a6a1407cc"} Jul 01 19:35:35.075857 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.075836 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:35:35.076208 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076172 2579 generic.go:356] "Generic (PLEG): container finished" podID="56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e" containerID="83f7ddde97b1cf0fa3f6a9273afa6dbc803eba8d0e3cadfbd2a45b9b98404837" exitCode=1 Jul 01 19:35:35.076287 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"d3e940ec47a80b976bba26dd28a1c92e8e11e17f7ae6d0e4a5625707ca2436ac"} Jul 01 19:35:35.076358 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"3d0fba714b24d075c65a786881eb334d0fb429977ac838cc11cfae34b2d6c844"} Jul 01 19:35:35.076409 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"41569c69cf437426e81dd31da2a257c02c0b265af9b142b3303795180399b54d"} Jul 01 19:35:35.076465 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"918cd2af916d3cc056a899a623e3638fd2f3ea623cd25c48e3f3234f6b9d10a6"} Jul 01 19:35:35.076523 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerDied","Data":"83f7ddde97b1cf0fa3f6a9273afa6dbc803eba8d0e3cadfbd2a45b9b98404837"} Jul 01 19:35:35.076575 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.076557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"506c291edaea78a83f895a454becd8457a9382457fee4bc52cc1419362819c7a"} Jul 01 19:35:35.077681 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.077659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2txg9" event={"ID":"4d447735-9d53-4dc9-a240-968105c12d01","Type":"ContainerStarted","Data":"08c9317a71eac032781dfc18258008dc78139ad60ba07b269444a9dee2571fb9"} Jul 01 19:35:35.079177 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.079158 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcdc9" event={"ID":"84475ee1-3651-4e38-a2b2-6643bc601dda","Type":"ContainerStarted","Data":"79dba17e194a2957473ed4f47c3f0155fb0c11a1ddf59ae9bb9f5c7a8500e85b"} Jul 01 19:35:35.080689 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.080669 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="c65654a3a6a126298c9b808db6a25119e4f17c2c96910e8ebb2ed2ae47b5838a" exitCode=0 Jul 01 19:35:35.080771 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.080739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"c65654a3a6a126298c9b808db6a25119e4f17c2c96910e8ebb2ed2ae47b5838a"} Jul 01 19:35:35.082335 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.082312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8w54" event={"ID":"fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd","Type":"ContainerStarted","Data":"bb5c13d34112c9cde49d39c6531d9bdd55efe76e14ffe2dbeb5c603299dbb157"} Jul 01 19:35:35.083911 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.083888 2579 generic.go:356] "Generic (PLEG): container finished" podID="5ecfb2d5c0f926017f7892061c810d23" containerID="f3f2e97aa9db39b4556bda78e6083a1608a4e42f4c8f11e1fbb67e133927e9cb" exitCode=0 Jul 01 19:35:35.084005 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.083963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"5ecfb2d5c0f926017f7892061c810d23","Type":"ContainerDied","Data":"f3f2e97aa9db39b4556bda78e6083a1608a4e42f4c8f11e1fbb67e133927e9cb"} Jul 01 19:35:35.084064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.084046 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 01 19:35:35.085494 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.085471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" event={"ID":"dc5f0b87-a267-4ec6-9a23-78eab177b2da","Type":"ContainerStarted","Data":"44cdc0164328cb91a04c6269a1790918769ea3590785dfb34f1dbc120797d5d0"} Jul 01 19:35:35.086873 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.086836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" event={"ID":"a87c635a4fd37941e7463055cab2cf8a","Type":"ContainerStarted","Data":"24b33ad3e18faa5e315b2a59e55510928873f79902d9cc4267eadb5d4b0b9b38"} Jul 01 19:35:35.094850 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.094806 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgdtt" podStartSLOduration=2.027305138 podStartE2EDuration="22.094791957s" totalImagesPullingTime="20.067486819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.094671298 +0000 UTC m=+22.721110382" watchObservedRunningTime="2026-07-01 19:35:35.094791957 +0000 UTC m=+22.721231040" Jul 01 19:35:35.099775 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.099746 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:35:35.100733 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.100695 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal"] Jul 01 19:35:35.115519 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.115479 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2txg9" podStartSLOduration=2.037980347 podStartE2EDuration="22.115468297s" totalImagesPullingTime="20.07748795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.114897584 +0000 UTC m=+22.741336662" watchObservedRunningTime="2026-07-01 19:35:35.115468297 +0000 UTC m=+22.741907381" Jul 01 19:35:35.155961 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.155902 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" podStartSLOduration=21.155883019 podStartE2EDuration="21.155883019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.132052906 +0000 UTC m=+22.758491990" watchObservedRunningTime="2026-07-01 19:35:35.155883019 +0000 UTC m=+22.782322100" Jul 01 19:35:35.174064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.173999 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rpjwv" podStartSLOduration=2.062841355 podStartE2EDuration="22.173973017s" totalImagesPullingTime="20.111131662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.15519417 +0000 UTC m=+22.781633254" watchObservedRunningTime="2026-07-01 19:35:35.173973017 +0000 UTC m=+22.800412102" Jul 01 19:35:35.216043 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.215998 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8w54" podStartSLOduration=6.311918424 podStartE2EDuration="22.215981799s" totalImagesPullingTime="15.904063375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.175379531 +0000 UTC m=+22.801818616" watchObservedRunningTime="2026-07-01 19:35:35.215981799 +0000 UTC m=+22.842420883" Jul 01 19:35:35.246133 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.246097 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zcdc9" podStartSLOduration=2.026104255 podStartE2EDuration="22.246082972s" totalImagesPullingTime="20.219978717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:35.245849764 +0000 UTC m=+22.872288849" watchObservedRunningTime="2026-07-01 19:35:35.246082972 +0000 UTC m=+22.872522056" Jul 01 19:35:35.921038 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.921003 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:35.921215 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.921056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:35.921215 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:35.921125 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:35.921215 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:35.920998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:35.921364 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:35.921240 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:35.921364 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:35.921300 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:36.090902 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.090850 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrxwj" event={"ID":"50305bf7-c186-430a-b245-c03c0e23f000","Type":"ContainerStarted","Data":"ed7274354f30a1baf85f49e6628adaa03f99960c4f7b5b1cdbcb1272822c56b4"} Jul 01 19:35:36.093152 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.093116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"5ecfb2d5c0f926017f7892061c810d23","Type":"ContainerStarted","Data":"ae5510633c1f27af5987e98b3241b892f29a450e2c3fcc239e187f3cdea5a519"} Jul 01 19:35:36.126590 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.126540 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrxwj" podStartSLOduration=2.96715275 podStartE2EDuration="23.126520977s" totalImagesPullingTime="20.159368227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:36.125769357 +0000 UTC m=+23.752208442" watchObservedRunningTime="2026-07-01 19:35:36.126520977 +0000 UTC m=+23.752960062" Jul 01 19:35:36.144476 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.144428 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" podStartSLOduration=1.144408074 podStartE2EDuration="1.144408074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:36.144057215 +0000 UTC m=+23.770496298" watchObservedRunningTime="2026-07-01 19:35:36.144408074 +0000 UTC m=+23.770847158" Jul 01 19:35:36.242308 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.242279 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:35:36.937112 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.936991 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:35:36.242303761Z","UUID":"742016c5-e79f-4f5f-961e-da8665afd1ab","Handler":null,"Name":"","Endpoint":""} Jul 01 19:35:36.938771 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.938744 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:35:36.938945 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:36.938782 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:35:37.097828 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.097793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" event={"ID":"128a70c9-323b-471e-8ac3-1a6c59514408","Type":"ContainerStarted","Data":"7365e33e9bec44d73f3e7e2cdb532a9c87eba2da1b252d06187dbe4d197bdf05"} Jul 01 19:35:37.840465 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.840427 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:37.841145 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.841127 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:37.921102 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.921066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:37.921287 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.921066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:37.921287 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:37.921184 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:37.921287 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:37.921273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:37.921454 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:37.921072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:37.921454 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:37.921367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:38.103173 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.103032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" event={"ID":"128a70c9-323b-471e-8ac3-1a6c59514408","Type":"ContainerStarted","Data":"6f86d6f95ea61ceaf7025610f136ff6da6b62cd1b1c23706ff482c45d2b7f60e"} Jul 01 19:35:38.106614 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.106590 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:35:38.107119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.107080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"6b5581e2bf2f50ff7f76cd2371d8dd199a439313dfe21225a516ae070c792c01"} Jul 01 19:35:38.107390 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.107347 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:38.107777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.107761 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgdtt" Jul 01 19:35:38.126659 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:38.126621 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7rqb" podStartSLOduration=2.757453464 podStartE2EDuration="25.126604122s" totalImagesPullingTime="22.369150658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:38.126384119 +0000 UTC m=+25.752823201" watchObservedRunningTime="2026-07-01 19:35:38.126604122 +0000 UTC m=+25.753043206" Jul 01 19:35:39.175062 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:39.174883 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2txg9_4d447735-9d53-4dc9-a240-968105c12d01/dns-node-resolver/0.log" Jul 01 19:35:39.921086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:39.921004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:39.921257 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:39.921004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:39.921257 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:39.921007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:39.921257 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:39.921224 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:39.921376 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:39.921106 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:39.921376 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:39.921282 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:40.113317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.113280 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="599cf658f986455c3b9df1a70c9a2f1563341bc3c881c34342f051ffcd51f982" exitCode=0 Jul 01 19:35:40.113492 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.113370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"599cf658f986455c3b9df1a70c9a2f1563341bc3c881c34342f051ffcd51f982"} Jul 01 19:35:40.116596 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.116579 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:35:40.116940 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.116920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"d13b02f00079f0659b210938f5acde836d5552d8acf3a75b5367810182a8edab"} Jul 01 19:35:40.117330 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.117314 2579 scope.go:117] "RemoveContainer" containerID="83f7ddde97b1cf0fa3f6a9273afa6dbc803eba8d0e3cadfbd2a45b9b98404837" Jul 01 19:35:40.347497 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:40.347343 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8w54_fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd/node-ca/0.log" Jul 01 19:35:41.122429 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.122405 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:35:41.122775 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.122749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" event={"ID":"56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e","Type":"ContainerStarted","Data":"217d9efb1cf08f6f196d813ad33a0e7d7f287655842be0a922761a2bebbead9c"} Jul 01 19:35:41.123050 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.123029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:41.123278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.123098 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:41.123278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.123144 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:41.139489 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.139468 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:41.139614 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.139557 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:35:41.166371 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.166317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" podStartSLOduration=8.019706332 podStartE2EDuration="28.166297264s" totalImagesPullingTime="20.146590932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:41.164518987 +0000 UTC m=+28.790958072" watchObservedRunningTime="2026-07-01 19:35:41.166297264 +0000 UTC m=+28.792736378" Jul 01 19:35:41.435955 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.435854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnjlh"] Jul 01 19:35:41.436339 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.436051 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:41.436339 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:41.436145 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:41.438769 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.438743 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75fb6"] Jul 01 19:35:41.438902 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.438823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:41.438950 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:41.438919 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:41.462859 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.462829 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8tkd"] Jul 01 19:35:41.463000 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:41.462973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:41.463080 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:41.463059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:42.126409 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:42.126377 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="5a30d456fc3add7936c324e190d3fe7456107461b82c8773d7853da7e6c79f06" exitCode=0 Jul 01 19:35:42.126601 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:42.126442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"5a30d456fc3add7936c324e190d3fe7456107461b82c8773d7853da7e6c79f06"} Jul 01 19:35:42.921816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:42.921782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:42.922293 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:42.921918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:42.922293 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:42.921912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:42.922293 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:42.922028 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:42.922293 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:42.922072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:42.922293 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:42.922162 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:44.133810 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:44.133579 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="43f431eaa99e6392807c998d4f6fc881b52802f12a2d5f8076781336f6074268" exitCode=0 Jul 01 19:35:44.134182 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:44.133663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"43f431eaa99e6392807c998d4f6fc881b52802f12a2d5f8076781336f6074268"} Jul 01 19:35:44.921498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:44.921469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:44.921498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:44.921483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:44.921696 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:44.921588 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:44.921696 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:44.921634 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:44.921696 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:44.921684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:44.921804 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:44.921778 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:45.611609 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:45.611580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:45.612042 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.611817 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:45.612042 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.611844 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:45.612042 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.611858 2579 projected.go:196] Error preparing data for projected volume kube-api-access-mb82k for pod openshift-network-diagnostics/network-check-target-75fb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:45.612042 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.611945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k podName:dc605f81-73ab-4196-b72c-a1fbd1f4c14d nodeName:}" failed. No retries permitted until 2026-07-01 19:36:17.611924115 +0000 UTC m=+65.238363180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mb82k" (UniqueName: "kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k") pod "network-check-target-75fb6" (UID: "dc605f81-73ab-4196-b72c-a1fbd1f4c14d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:45.712302 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:45.712269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:45.712302 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:45.712314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:45.712541 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.712429 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:45.712541 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.712498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret podName:576b371e-5d0d-4e6f-b162-e5966bd53b9c nodeName:}" failed. No retries permitted until 2026-07-01 19:36:17.712480224 +0000 UTC m=+65.338919303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret") pod "global-pull-secret-syncer-mnjlh" (UID: "576b371e-5d0d-4e6f-b162-e5966bd53b9c") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:45.712541 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.712429 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:45.712674 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:45.712548 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs podName:4046eaa4-7a83-4cc4-b18b-6f9d66628c82 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:17.712537511 +0000 UTC m=+65.338976577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs") pod "network-metrics-daemon-l8tkd" (UID: "4046eaa4-7a83-4cc4-b18b-6f9d66628c82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:46.920783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:46.920609 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:46.920783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:46.920641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:46.921302 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:46.920823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:46.921302 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:46.920820 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:46.921302 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:46.921072 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:46.921302 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:46.921190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:48.921262 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:48.921175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:48.921759 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:48.921182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:48.921759 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:48.921284 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:48.921759 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:48.921182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:48.921759 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:48.921373 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:48.921759 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:48.921464 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:49.147774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:49.147741 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="37b5853d494e555f452e2e16048d47d27a6130660ff20e1347cf77ac356f95d4" exitCode=0 Jul 01 19:35:49.147774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:49.147775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"37b5853d494e555f452e2e16048d47d27a6130660ff20e1347cf77ac356f95d4"} Jul 01 19:35:50.155555 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:50.155521 2579 generic.go:356] "Generic (PLEG): container finished" podID="4081b4df-525a-43ae-9388-b39d564cadf7" containerID="33f195513660784e95aa5d22844e502a65d87c3c7892fa2016edb82fdd91f467" exitCode=0 Jul 01 19:35:50.156149 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:50.155589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerDied","Data":"33f195513660784e95aa5d22844e502a65d87c3c7892fa2016edb82fdd91f467"} Jul 01 19:35:50.921355 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:50.921316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:50.921355 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:50.921356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:50.921595 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:50.921453 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:50.921595 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:50.921493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:50.921595 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:50.921567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:50.921740 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:50.921709 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:51.161202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:51.161167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" event={"ID":"4081b4df-525a-43ae-9388-b39d564cadf7","Type":"ContainerStarted","Data":"b4468b31b195e9dbf99a9bffa2a5931da06fafdd4fd92ec7520a4b04f60ef69d"} Jul 01 19:35:51.193448 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:51.193260 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2ltx4" podStartSLOduration=6.832827422 podStartE2EDuration="38.19324205s" totalImagesPullingTime="31.360414628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:51.19291623 +0000 UTC m=+38.819355315" watchObservedRunningTime="2026-07-01 19:35:51.19324205 +0000 UTC m=+38.819681134" Jul 01 19:35:52.921746 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:52.921719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:52.922370 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:52.921817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:52.922370 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:52.921884 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:52.922370 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:52.921903 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:52.922370 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:52.921933 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:52.922370 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:52.922020 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:54.920941 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:54.920904 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:54.921403 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:54.920909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:54.921403 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:54.920912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:54.921403 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:54.921085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:54.921403 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:54.921176 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:54.921403 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:54.921272 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:56.921322 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:56.921252 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:56.921806 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:56.921253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:56.921806 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:56.921253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:56.921806 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:56.921409 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:35:56.921806 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:56.921442 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:56.921806 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:56.921503 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:58.921579 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:58.921537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:35:58.922086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:58.921545 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:35:58.922086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:58.921654 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:35:58.922086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:58.921710 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:35:58.922086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:35:58.921746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:35:58.922086 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:35:58.921814 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:36:00.920620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:00.920589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:36:00.920620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:00.920608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:36:00.920620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:00.920615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:00.921113 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:00.920683 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjlh" podUID="576b371e-5d0d-4e6f-b162-e5966bd53b9c" Jul 01 19:36:00.921113 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:00.920739 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8tkd" podUID="4046eaa4-7a83-4cc4-b18b-6f9d66628c82" Jul 01 19:36:00.921113 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:00.920834 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75fb6" podUID="dc605f81-73ab-4196-b72c-a1fbd1f4c14d" Jul 01 19:36:02.033433 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.033408 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeReady" Jul 01 19:36:02.033792 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.033561 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:36:02.123301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.123265 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6pzqv"] Jul 01 19:36:02.133045 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.133018 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rhr52"] Jul 01 19:36:02.133152 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.133131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.135636 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.135616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g9mcw\"" Jul 01 19:36:02.135770 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.135754 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:36:02.136349 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.136334 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:36:02.148263 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.148239 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pzqv"] Jul 01 19:36:02.148352 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.148328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.155258 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.155017 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rhr52"] Jul 01 19:36:02.155258 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.155239 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:36:02.155448 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.155431 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:36:02.156243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.156205 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdnb9\"" Jul 01 19:36:02.156374 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.156322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:36:02.156463 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.156447 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:36:02.221591 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.221513 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6p7fz"] Jul 01 19:36:02.232450 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.232429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.233445 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.233424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb2e73ab-4881-492c-ab73-b805844d1ec9-metrics-tls\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.233544 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.233454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb2e73ab-4881-492c-ab73-b805844d1ec9-config-volume\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.233544 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.233473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2e73ab-4881-492c-ab73-b805844d1ec9-tmp-dir\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.233639 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.233553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57pgk\" (UniqueName: \"kubernetes.io/projected/fb2e73ab-4881-492c-ab73-b805844d1ec9-kube-api-access-57pgk\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.237627 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.237608 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:36:02.238368 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.237957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:36:02.238368 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.237968 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:36:02.238368 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.238017 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tq7c\"" Jul 01 19:36:02.251162 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.251138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6p7fz"] Jul 01 19:36:02.334133 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-crio-socket\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.334133 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb2e73ab-4881-492c-ab73-b805844d1ec9-metrics-tls\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.334346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qn8x\" (UniqueName: \"kubernetes.io/projected/f94c50d5-f964-4a33-b494-7a2a11ffceb2-kube-api-access-4qn8x\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.334346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb2e73ab-4881-492c-ab73-b805844d1ec9-config-volume\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.334346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2e73ab-4881-492c-ab73-b805844d1ec9-tmp-dir\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.334346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.334496 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-data-volume\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.334496 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57pgk\" (UniqueName: \"kubernetes.io/projected/fb2e73ab-4881-492c-ab73-b805844d1ec9-kube-api-access-57pgk\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.334496 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94c50d5-f964-4a33-b494-7a2a11ffceb2-cert\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.334496 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.334654 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2bw\" (UniqueName: \"kubernetes.io/projected/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-api-access-fw2bw\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.334654 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2e73ab-4881-492c-ab73-b805844d1ec9-tmp-dir\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.334794 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.334773 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb2e73ab-4881-492c-ab73-b805844d1ec9-config-volume\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.338210 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.338176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb2e73ab-4881-492c-ab73-b805844d1ec9-metrics-tls\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.343467 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.343447 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57pgk\" (UniqueName: \"kubernetes.io/projected/fb2e73ab-4881-492c-ab73-b805844d1ec9-kube-api-access-57pgk\") pod \"dns-default-6pzqv\" (UID: \"fb2e73ab-4881-492c-ab73-b805844d1ec9\") " pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.435512 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-data-volume\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94c50d5-f964-4a33-b494-7a2a11ffceb2-cert\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.435688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2bw\" (UniqueName: \"kubernetes.io/projected/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-api-access-fw2bw\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-crio-socket\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qn8x\" (UniqueName: \"kubernetes.io/projected/f94c50d5-f964-4a33-b494-7a2a11ffceb2-kube-api-access-4qn8x\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.435971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435831 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-crio-socket\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.435971 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.435912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-data-volume\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.436410 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.436382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.437997 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.437979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.438160 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.438141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94c50d5-f964-4a33-b494-7a2a11ffceb2-cert\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.441970 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.441942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:02.445033 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.445010 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qn8x\" (UniqueName: \"kubernetes.io/projected/f94c50d5-f964-4a33-b494-7a2a11ffceb2-kube-api-access-4qn8x\") pod \"ingress-canary-6p7fz\" (UID: \"f94c50d5-f964-4a33-b494-7a2a11ffceb2\") " pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.456378 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.456352 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2bw\" (UniqueName: \"kubernetes.io/projected/f712ddd2-0b45-440d-aca2-e27c0cc88d1b-kube-api-access-fw2bw\") pod \"insights-runtime-extractor-rhr52\" (UID: \"f712ddd2-0b45-440d-aca2-e27c0cc88d1b\") " pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.540832 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.540798 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6p7fz" Jul 01 19:36:02.618147 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.618127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pzqv"] Jul 01 19:36:02.619803 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:02.619777 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2e73ab_4881_492c_ab73_b805844d1ec9.slice/crio-39e0995a8dfd3f6b1ccc2b839e3e414d45f45f1c51dac898b71934cc8d8057ae WatchSource:0}: Error finding container 39e0995a8dfd3f6b1ccc2b839e3e414d45f45f1c51dac898b71934cc8d8057ae: Status 404 returned error can't find the container with id 39e0995a8dfd3f6b1ccc2b839e3e414d45f45f1c51dac898b71934cc8d8057ae Jul 01 19:36:02.677146 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.676978 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6p7fz"] Jul 01 19:36:02.679591 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:02.679563 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94c50d5_f964_4a33_b494_7a2a11ffceb2.slice/crio-a50621ac545049c5feee53c74f78fe1cc49b176fc5d6a97bb09c0f1f767b4fc6 WatchSource:0}: Error finding container a50621ac545049c5feee53c74f78fe1cc49b176fc5d6a97bb09c0f1f767b4fc6: Status 404 returned error can't find the container with id a50621ac545049c5feee53c74f78fe1cc49b176fc5d6a97bb09c0f1f767b4fc6 Jul 01 19:36:02.756420 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.756389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rhr52" Jul 01 19:36:02.886397 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.886364 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rhr52"] Jul 01 19:36:02.889561 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:02.889533 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf712ddd2_0b45_440d_aca2_e27c0cc88d1b.slice/crio-ad8d96c2b37283fc06b626f405b3d865f04764515fe21a621cbb1119f0c220c4 WatchSource:0}: Error finding container ad8d96c2b37283fc06b626f405b3d865f04764515fe21a621cbb1119f0c220c4: Status 404 returned error can't find the container with id ad8d96c2b37283fc06b626f405b3d865f04764515fe21a621cbb1119f0c220c4 Jul 01 19:36:02.922200 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.922169 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:02.922388 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.922244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:36:02.922388 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.922280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:36:02.924969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.924947 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:36:02.925366 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.925346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdstn\"" Jul 01 19:36:02.925499 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.925371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:36:02.925499 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.925491 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:36:02.925663 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.925628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8z2\"" Jul 01 19:36:02.925663 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:02.925633 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:36:03.189249 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:03.189215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhr52" event={"ID":"f712ddd2-0b45-440d-aca2-e27c0cc88d1b","Type":"ContainerStarted","Data":"ad8d96c2b37283fc06b626f405b3d865f04764515fe21a621cbb1119f0c220c4"} Jul 01 19:36:03.190204 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:03.190186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6p7fz" event={"ID":"f94c50d5-f964-4a33-b494-7a2a11ffceb2","Type":"ContainerStarted","Data":"a50621ac545049c5feee53c74f78fe1cc49b176fc5d6a97bb09c0f1f767b4fc6"} Jul 01 19:36:03.191151 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:03.191132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pzqv" event={"ID":"fb2e73ab-4881-492c-ab73-b805844d1ec9","Type":"ContainerStarted","Data":"39e0995a8dfd3f6b1ccc2b839e3e414d45f45f1c51dac898b71934cc8d8057ae"} Jul 01 19:36:06.552598 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.552561 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr"] Jul 01 19:36:06.644659 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.644617 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr"] Jul 01 19:36:06.644816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.644766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:06.651566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.651524 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 19:36:06.651760 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.651533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-48vtc\"" Jul 01 19:36:06.664149 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.664115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac7bbc51-ee83-44d0-bd57-c97516860b8f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-99cmr\" (UID: \"ac7bbc51-ee83-44d0-bd57-c97516860b8f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:06.765284 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.765252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac7bbc51-ee83-44d0-bd57-c97516860b8f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-99cmr\" (UID: \"ac7bbc51-ee83-44d0-bd57-c97516860b8f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:06.768392 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.768361 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac7bbc51-ee83-44d0-bd57-c97516860b8f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-99cmr\" (UID: \"ac7bbc51-ee83-44d0-bd57-c97516860b8f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:06.955696 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:06.955658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:08.766341 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:08.766310 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr"] Jul 01 19:36:08.769760 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:08.769722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7bbc51_ee83_44d0_bd57_c97516860b8f.slice/crio-fc2dcd8864795f3b7f72878c800c6277d9a9a97c44e56b0860315ebabfaa9c92 WatchSource:0}: Error finding container fc2dcd8864795f3b7f72878c800c6277d9a9a97c44e56b0860315ebabfaa9c92: Status 404 returned error can't find the container with id fc2dcd8864795f3b7f72878c800c6277d9a9a97c44e56b0860315ebabfaa9c92 Jul 01 19:36:09.208837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.208761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pzqv" event={"ID":"fb2e73ab-4881-492c-ab73-b805844d1ec9","Type":"ContainerStarted","Data":"736dacf32dc39d9029182b912989d1b88af524deb1d9b9ae8aec97d558000724"} Jul 01 19:36:09.208837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.208818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pzqv" event={"ID":"fb2e73ab-4881-492c-ab73-b805844d1ec9","Type":"ContainerStarted","Data":"0d2c0d736608277a974b5fb8623bf149e214eb81ad807e853416a5634b65e9d7"} Jul 01 19:36:09.209055 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.208883 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:09.210156 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.210135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhr52" event={"ID":"f712ddd2-0b45-440d-aca2-e27c0cc88d1b","Type":"ContainerStarted","Data":"0a11e144cb94a45da458f72918ec4a751c2d322306c762f1b94baa6d5012e627"} Jul 01 19:36:09.211505 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.211485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6p7fz" event={"ID":"f94c50d5-f964-4a33-b494-7a2a11ffceb2","Type":"ContainerStarted","Data":"1624d864e17a0d43f79a8fbfadd0e4d9431c03842f9ad943db7d630c77edf05f"} Jul 01 19:36:09.212514 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.212495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" event={"ID":"ac7bbc51-ee83-44d0-bd57-c97516860b8f","Type":"ContainerStarted","Data":"fc2dcd8864795f3b7f72878c800c6277d9a9a97c44e56b0860315ebabfaa9c92"} Jul 01 19:36:09.232774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.232718 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6pzqv" podStartSLOduration=1.225705852 podStartE2EDuration="7.232703763s" totalImagesPullingTime="6.006997911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:09.23216874 +0000 UTC m=+56.858607824" watchObservedRunningTime="2026-07-01 19:36:09.232703763 +0000 UTC m=+56.859142844" Jul 01 19:36:09.250906 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:09.250849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6p7fz" podStartSLOduration=1.30222838 podStartE2EDuration="7.250835605s" totalImagesPullingTime="5.948607225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:09.250242397 +0000 UTC m=+56.876681493" watchObservedRunningTime="2026-07-01 19:36:09.250835605 +0000 UTC m=+56.877274690" Jul 01 19:36:11.220912 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.220876 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" event={"ID":"ac7bbc51-ee83-44d0-bd57-c97516860b8f","Type":"ContainerStarted","Data":"b55321269203e3fff85638a3515e2fad598e07a4f2c7883a984220bbda6ff609"} Jul 01 19:36:11.221400 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.221028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:11.222920 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.222891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhr52" event={"ID":"f712ddd2-0b45-440d-aca2-e27c0cc88d1b","Type":"ContainerStarted","Data":"f8051ad10055d39530e9bdfc74cdff6e7a915e06fb0bfbb1979d6da6d5c6c1ff"} Jul 01 19:36:11.225821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.225799 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" Jul 01 19:36:11.238115 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.237995 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-99cmr" podStartSLOduration=3.841613973 podStartE2EDuration="5.237982033s" totalImagesPullingTime="1.39636806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:11.23740735 +0000 UTC m=+58.863846435" watchObservedRunningTime="2026-07-01 19:36:11.237982033 +0000 UTC m=+58.864421118" Jul 01 19:36:11.630967 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.630932 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-87k7v"] Jul 01 19:36:11.633407 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.633385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.635788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.635764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 19:36:11.635914 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.635794 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:36:11.635914 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.635800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 19:36:11.637064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.636995 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:36:11.637064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.637044 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:36:11.637262 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.637079 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8jl2b\"" Jul 01 19:36:11.647671 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.647643 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-87k7v"] Jul 01 19:36:11.701294 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.701236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.701294 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.701286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.701582 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.701345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c037f3-2153-4920-8ed3-a4c2ca917c67-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.701582 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.701379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqqdp\" (UniqueName: \"kubernetes.io/projected/a8c037f3-2153-4920-8ed3-a4c2ca917c67-kube-api-access-xqqdp\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.802036 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.801996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.802278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.802053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.802278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.802091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c037f3-2153-4920-8ed3-a4c2ca917c67-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.802278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.802118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqqdp\" (UniqueName: \"kubernetes.io/projected/a8c037f3-2153-4920-8ed3-a4c2ca917c67-kube-api-access-xqqdp\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.802278 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:11.802165 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 19:36:11.802278 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:11.802248 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls podName:a8c037f3-2153-4920-8ed3-a4c2ca917c67 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:12.30222415 +0000 UTC m=+59.928663218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-87k7v" (UID: "a8c037f3-2153-4920-8ed3-a4c2ca917c67") : secret "prometheus-operator-tls" not found Jul 01 19:36:11.802981 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.802954 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c037f3-2153-4920-8ed3-a4c2ca917c67-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.805180 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.805145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:11.813835 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:11.813811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqqdp\" (UniqueName: \"kubernetes.io/projected/a8c037f3-2153-4920-8ed3-a4c2ca917c67-kube-api-access-xqqdp\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:12.304875 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:12.304821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:12.305317 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:12.304945 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 19:36:12.305317 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:12.305019 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls podName:a8c037f3-2153-4920-8ed3-a4c2ca917c67 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:13.304996286 +0000 UTC m=+60.931435354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-87k7v" (UID: "a8c037f3-2153-4920-8ed3-a4c2ca917c67") : secret "prometheus-operator-tls" not found Jul 01 19:36:13.140108 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.140075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-68kvf" Jul 01 19:36:13.309652 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.309614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:13.312271 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.312234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8c037f3-2153-4920-8ed3-a4c2ca917c67-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-87k7v\" (UID: \"a8c037f3-2153-4920-8ed3-a4c2ca917c67\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:13.447561 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.447492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8jl2b\"" Jul 01 19:36:13.454841 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.454809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" Jul 01 19:36:13.594625 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:13.594590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-87k7v"] Jul 01 19:36:13.597721 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:13.597687 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c037f3_2153_4920_8ed3_a4c2ca917c67.slice/crio-08d34736d5362cf0bd498b81a87760d9be9689985373c0797528716c51877486 WatchSource:0}: Error finding container 08d34736d5362cf0bd498b81a87760d9be9689985373c0797528716c51877486: Status 404 returned error can't find the container with id 08d34736d5362cf0bd498b81a87760d9be9689985373c0797528716c51877486 Jul 01 19:36:14.233150 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:14.233110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" event={"ID":"a8c037f3-2153-4920-8ed3-a4c2ca917c67","Type":"ContainerStarted","Data":"08d34736d5362cf0bd498b81a87760d9be9689985373c0797528716c51877486"} Jul 01 19:36:14.235486 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:14.235458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhr52" event={"ID":"f712ddd2-0b45-440d-aca2-e27c0cc88d1b","Type":"ContainerStarted","Data":"b749f0dbdc36d57667ccec7ebb1b75d7f32e7e2483024e871e0d4fd8d0e3d091"} Jul 01 19:36:14.256694 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:14.256640 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rhr52" podStartSLOduration=1.860658018 podStartE2EDuration="12.256622248s" totalImagesPullingTime="10.39596423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:36:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:14.255151942 +0000 UTC m=+61.881591027" watchObservedRunningTime="2026-07-01 19:36:14.256622248 +0000 UTC m=+61.883061331" Jul 01 19:36:15.240166 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:15.240121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" event={"ID":"a8c037f3-2153-4920-8ed3-a4c2ca917c67","Type":"ContainerStarted","Data":"4086b029ead070c4ddf8c9d993d558a2fa90a1a56f5795df61c868287b7a7fa9"} Jul 01 19:36:15.240564 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:15.240189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" event={"ID":"a8c037f3-2153-4920-8ed3-a4c2ca917c67","Type":"ContainerStarted","Data":"08cae13e13c17286b1ead154d3585833ce9b22abd383fad61ad7a5245c1a2c0d"} Jul 01 19:36:15.275791 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:15.275733 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-87k7v" podStartSLOduration=3.177719849 podStartE2EDuration="4.275717325s" totalImagesPullingTime="1.097997476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:15.275340789 +0000 UTC m=+62.901779873" watchObservedRunningTime="2026-07-01 19:36:15.275717325 +0000 UTC m=+62.902156409" Jul 01 19:36:17.148231 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.148197 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l"] Jul 01 19:36:17.150906 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.150887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.155110 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.155089 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:36:17.155376 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.155362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5x5jb\"" Jul 01 19:36:17.156151 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.156130 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 19:36:17.177187 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.177150 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l"] Jul 01 19:36:17.220655 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.220622 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-26j9v"] Jul 01 19:36:17.222784 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.222763 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.225601 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.225573 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzlzj\"" Jul 01 19:36:17.225690 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.225634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:36:17.225690 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.225657 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:36:17.225967 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.225945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:36:17.241052 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-metrics-client-ca\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241162 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b68j7\" (UniqueName: \"kubernetes.io/projected/370c4859-30e0-4256-bb36-6fea7bc24fb5-kube-api-access-b68j7\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.241162 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-accelerators-collector-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241277 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-textfile\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241277 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-wtmp\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241277 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-tls\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241277 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzv2\" (UniqueName: \"kubernetes.io/projected/4386e50b-7b89-42e3-9b41-9ca199262135-kube-api-access-4hzv2\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.241406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.241490 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370c4859-30e0-4256-bb36-6fea7bc24fb5-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.241490 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-sys\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241490 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-root\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.241490 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.241466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.282228 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.282191 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-7zzfz"] Jul 01 19:36:17.284359 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.284340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.287141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.287114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:36:17.287790 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.287767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-l8q78\"" Jul 01 19:36:17.288341 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.288317 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 19:36:17.289593 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.289574 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 19:36:17.309897 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.309851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-7zzfz"] Jul 01 19:36:17.342000 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.341971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-metrics-client-ca\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-metrics-client-ca\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b68j7\" (UniqueName: \"kubernetes.io/projected/370c4859-30e0-4256-bb36-6fea7bc24fb5-kube-api-access-b68j7\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-accelerators-collector-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-textfile\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-wtmp\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c3c2559-6ddd-4a42-aee3-1ee0453546da-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-tls\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-wtmp\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzv2\" (UniqueName: \"kubernetes.io/projected/4386e50b-7b89-42e3-9b41-9ca199262135-kube-api-access-4hzv2\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-textfile\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342446 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qdqh\" (UniqueName: \"kubernetes.io/projected/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-api-access-7qdqh\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342550 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-metrics-client-ca\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370c4859-30e0-4256-bb36-6fea7bc24fb5-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-sys\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-root\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-accelerators-collector-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342689 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-root\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.342783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.342731 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4386e50b-7b89-42e3-9b41-9ca199262135-sys\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.343346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.343306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370c4859-30e0-4256-bb36-6fea7bc24fb5-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.344775 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.344747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-tls\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.344958 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.344941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4386e50b-7b89-42e3-9b41-9ca199262135-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.345001 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.344970 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.345130 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.345109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370c4859-30e0-4256-bb36-6fea7bc24fb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.353851 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.353826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b68j7\" (UniqueName: \"kubernetes.io/projected/370c4859-30e0-4256-bb36-6fea7bc24fb5-kube-api-access-b68j7\") pod \"openshift-state-metrics-57f99c8b49-kbs9l\" (UID: \"370c4859-30e0-4256-bb36-6fea7bc24fb5\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.354025 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.354009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzv2\" (UniqueName: \"kubernetes.io/projected/4386e50b-7b89-42e3-9b41-9ca199262135-kube-api-access-4hzv2\") pod \"node-exporter-26j9v\" (UID: \"4386e50b-7b89-42e3-9b41-9ca199262135\") " pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.443340 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c3c2559-6ddd-4a42-aee3-1ee0453546da-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443340 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443340 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qdqh\" (UniqueName: \"kubernetes.io/projected/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-api-access-7qdqh\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443619 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-metrics-client-ca\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443619 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443619 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.443766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.443683 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c3c2559-6ddd-4a42-aee3-1ee0453546da-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.444081 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.444060 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.444182 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.444170 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2559-6ddd-4a42-aee3-1ee0453546da-metrics-client-ca\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.445743 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.445718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.445845 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.445826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.456349 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.456330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qdqh\" (UniqueName: \"kubernetes.io/projected/9c3c2559-6ddd-4a42-aee3-1ee0453546da-kube-api-access-7qdqh\") pod \"kube-state-metrics-845b954455-7zzfz\" (UID: \"9c3c2559-6ddd-4a42-aee3-1ee0453546da\") " pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.460128 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.460113 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" Jul 01 19:36:17.531226 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.531194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-26j9v" Jul 01 19:36:17.543066 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:17.543030 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4386e50b_7b89_42e3_9b41_9ca199262135.slice/crio-fad5e874a4d8bb8404f2b9b5d84cc234d74778345e0a3f9baa9d2ef2559161fe WatchSource:0}: Error finding container fad5e874a4d8bb8404f2b9b5d84cc234d74778345e0a3f9baa9d2ef2559161fe: Status 404 returned error can't find the container with id fad5e874a4d8bb8404f2b9b5d84cc234d74778345e0a3f9baa9d2ef2559161fe Jul 01 19:36:17.596588 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.596559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" Jul 01 19:36:17.596786 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.596762 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l"] Jul 01 19:36:17.600429 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:17.600402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370c4859_30e0_4256_bb36_6fea7bc24fb5.slice/crio-f9fd1c1e625adb5d6a6e95c850d0067e0c288a835f0f5c2a4800360d17796d3c WatchSource:0}: Error finding container f9fd1c1e625adb5d6a6e95c850d0067e0c288a835f0f5c2a4800360d17796d3c: Status 404 returned error can't find the container with id f9fd1c1e625adb5d6a6e95c850d0067e0c288a835f0f5c2a4800360d17796d3c Jul 01 19:36:17.644653 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.644633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:17.647831 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.647809 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:36:17.659053 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.659026 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:36:17.668275 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.668243 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb82k\" (UniqueName: \"kubernetes.io/projected/dc605f81-73ab-4196-b72c-a1fbd1f4c14d-kube-api-access-mb82k\") pod \"network-check-target-75fb6\" (UID: \"dc605f81-73ab-4196-b72c-a1fbd1f4c14d\") " pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:17.741154 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.741133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-7zzfz"] Jul 01 19:36:17.743342 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:17.743316 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3c2559_6ddd_4a42_aee3_1ee0453546da.slice/crio-e975f68fd3074e8c32315cc64bf26fdcb5ecd7a2fddd3ec1fb7bbf062798d7f6 WatchSource:0}: Error finding container e975f68fd3074e8c32315cc64bf26fdcb5ecd7a2fddd3ec1fb7bbf062798d7f6: Status 404 returned error can't find the container with id e975f68fd3074e8c32315cc64bf26fdcb5ecd7a2fddd3ec1fb7bbf062798d7f6 Jul 01 19:36:17.745074 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.745042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:36:17.745128 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.745090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:36:17.747656 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.747636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:36:17.747762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.747664 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:36:17.758387 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.758350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/576b371e-5d0d-4e6f-b162-e5966bd53b9c-original-pull-secret\") pod \"global-pull-secret-syncer-mnjlh\" (UID: \"576b371e-5d0d-4e6f-b162-e5966bd53b9c\") " pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:36:17.758387 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.758362 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4046eaa4-7a83-4cc4-b18b-6f9d66628c82-metrics-certs\") pod \"network-metrics-daemon-l8tkd\" (UID: \"4046eaa4-7a83-4cc4-b18b-6f9d66628c82\") " pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:36:17.936595 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.936570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdstn\"" Jul 01 19:36:17.938991 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.938977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjlh" Jul 01 19:36:17.943836 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.943812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:17.947242 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.947070 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8z2\"" Jul 01 19:36:17.954087 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:17.954067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8tkd" Jul 01 19:36:18.093592 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.093553 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75fb6"] Jul 01 19:36:18.097441 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:18.097402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc605f81_73ab_4196_b72c_a1fbd1f4c14d.slice/crio-44c115783e2f4782245a104b5168197d6e0e89da000db0ce127f68f543441e84 WatchSource:0}: Error finding container 44c115783e2f4782245a104b5168197d6e0e89da000db0ce127f68f543441e84: Status 404 returned error can't find the container with id 44c115783e2f4782245a104b5168197d6e0e89da000db0ce127f68f543441e84 Jul 01 19:36:18.119606 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.119578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnjlh"] Jul 01 19:36:18.124644 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:18.124611 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576b371e_5d0d_4e6f_b162_e5966bd53b9c.slice/crio-eb7383d0f9afa1b29cebb1af8746b3e3b86dd8e41271e9a5aecb3317f073d27a WatchSource:0}: Error finding container eb7383d0f9afa1b29cebb1af8746b3e3b86dd8e41271e9a5aecb3317f073d27a: Status 404 returned error can't find the container with id eb7383d0f9afa1b29cebb1af8746b3e3b86dd8e41271e9a5aecb3317f073d27a Jul 01 19:36:18.136302 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.136003 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8tkd"] Jul 01 19:36:18.142405 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:18.142345 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4046eaa4_7a83_4cc4_b18b_6f9d66628c82.slice/crio-8a1609d0f324bbe54e69557de0d4a40db68be5f227467509232d837f14290eae WatchSource:0}: Error finding container 8a1609d0f324bbe54e69557de0d4a40db68be5f227467509232d837f14290eae: Status 404 returned error can't find the container with id 8a1609d0f324bbe54e69557de0d4a40db68be5f227467509232d837f14290eae Jul 01 19:36:18.197296 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.197022 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:36:18.201181 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.201150 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.205647 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.205619 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-djptz\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.205978 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.206166 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.206330 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.206532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.206709 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.206910 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.207136 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.207308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:36:18.208962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.207495 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:36:18.219272 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.219190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:36:18.249837 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.249990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56bkp\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.250975 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.250654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.256067 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.255918 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" event={"ID":"370c4859-30e0-4256-bb36-6fea7bc24fb5","Type":"ContainerStarted","Data":"ec0fa1e9c13e58176ea18b143a119f881e973fb1ad7d0a239d7fb28381dddbb8"} Jul 01 19:36:18.256067 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.255990 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" event={"ID":"370c4859-30e0-4256-bb36-6fea7bc24fb5","Type":"ContainerStarted","Data":"b6499e675f5686535aee05f8c94dd9b0664c7276bf4933b7f3afc9220069127e"} Jul 01 19:36:18.256067 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.256019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" event={"ID":"370c4859-30e0-4256-bb36-6fea7bc24fb5","Type":"ContainerStarted","Data":"f9fd1c1e625adb5d6a6e95c850d0067e0c288a835f0f5c2a4800360d17796d3c"} Jul 01 19:36:18.258513 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.258485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" event={"ID":"9c3c2559-6ddd-4a42-aee3-1ee0453546da","Type":"ContainerStarted","Data":"e975f68fd3074e8c32315cc64bf26fdcb5ecd7a2fddd3ec1fb7bbf062798d7f6"} Jul 01 19:36:18.260512 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.260452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26j9v" event={"ID":"4386e50b-7b89-42e3-9b41-9ca199262135","Type":"ContainerStarted","Data":"fad5e874a4d8bb8404f2b9b5d84cc234d74778345e0a3f9baa9d2ef2559161fe"} Jul 01 19:36:18.262657 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.262586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8tkd" event={"ID":"4046eaa4-7a83-4cc4-b18b-6f9d66628c82","Type":"ContainerStarted","Data":"8a1609d0f324bbe54e69557de0d4a40db68be5f227467509232d837f14290eae"} Jul 01 19:36:18.264686 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.264655 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75fb6" event={"ID":"dc605f81-73ab-4196-b72c-a1fbd1f4c14d","Type":"ContainerStarted","Data":"44c115783e2f4782245a104b5168197d6e0e89da000db0ce127f68f543441e84"} Jul 01 19:36:18.268488 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.268458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnjlh" event={"ID":"576b371e-5d0d-4e6f-b162-e5966bd53b9c","Type":"ContainerStarted","Data":"eb7383d0f9afa1b29cebb1af8746b3e3b86dd8e41271e9a5aecb3317f073d27a"} Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.351545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56bkp\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.352212 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:18.352002 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 19:36:18.354309 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.353230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.354309 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:18.353358 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls podName:92061990-1dc1-4251-a7c9-b766257f0465 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:18.852045439 +0000 UTC m=+66.478484516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "92061990-1dc1-4251-a7c9-b766257f0465") : secret "alertmanager-main-tls" not found Jul 01 19:36:18.354309 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.353524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.354309 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.354076 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.362411 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.362359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.362555 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.362472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.362555 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.362525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.363205 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.363145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.363411 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.363372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.363486 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.363469 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.363965 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.363926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.364053 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.363968 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56bkp\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.365238 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.365212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.857075 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:18.856955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:18.857276 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:18.857166 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 19:36:18.857276 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:36:18.857235 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls podName:92061990-1dc1-4251-a7c9-b766257f0465 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:19.857215064 +0000 UTC m=+67.483654129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "92061990-1dc1-4251-a7c9-b766257f0465") : secret "alertmanager-main-tls" not found Jul 01 19:36:19.218583 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:19.218241 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6pzqv" Jul 01 19:36:19.866655 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:19.866536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:19.870896 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:19.869660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:20.018368 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.018138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:36:20.071695 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.070918 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4"] Jul 01 19:36:20.077403 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.076218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.084040 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.083743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 19:36:20.084040 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.083912 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 19:36:20.087702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.086358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2n7qu695tmdqa\"" Jul 01 19:36:20.087702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.086481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 19:36:20.087702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.086604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 19:36:20.087702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.086358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6t7rh\"" Jul 01 19:36:20.087702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.086982 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 19:36:20.088557 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.088531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4"] Jul 01 19:36:20.173132 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173298 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173298 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-grpc-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173298 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173464 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545d983a-76ca-4236-8ddb-68a7137f98a7-metrics-client-ca\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173464 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173464 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.173464 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.173423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqn9\" (UniqueName: \"kubernetes.io/projected/545d983a-76ca-4236-8ddb-68a7137f98a7-kube-api-access-swqn9\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.248105 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.247994 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:36:20.254297 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:20.254258 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92061990_1dc1_4251_a7c9_b766257f0465.slice/crio-2c38362c8d7a949aca873f121e47240ee9722da813bb56825d270a29236aa795 WatchSource:0}: Error finding container 2c38362c8d7a949aca873f121e47240ee9722da813bb56825d270a29236aa795: Status 404 returned error can't find the container with id 2c38362c8d7a949aca873f121e47240ee9722da813bb56825d270a29236aa795 Jul 01 19:36:20.274005 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.273856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-grpc-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274005 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.273983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274232 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545d983a-76ca-4236-8ddb-68a7137f98a7-metrics-client-ca\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274232 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274232 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274232 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqn9\" (UniqueName: \"kubernetes.io/projected/545d983a-76ca-4236-8ddb-68a7137f98a7-kube-api-access-swqn9\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274232 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.274487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.274252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.276317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.275587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545d983a-76ca-4236-8ddb-68a7137f98a7-metrics-client-ca\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.278531 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.277557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.278531 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.278046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.278531 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.278405 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.278784 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.278605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-grpc-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.279297 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.279272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-tls\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.280855 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.280835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/545d983a-76ca-4236-8ddb-68a7137f98a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.283225 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.283193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" event={"ID":"370c4859-30e0-4256-bb36-6fea7bc24fb5","Type":"ContainerStarted","Data":"15191bc6bdc16d4dd654bac48d85f74eb016f32f1287f490b520a5795368c161"} Jul 01 19:36:20.284818 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.284794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqn9\" (UniqueName: \"kubernetes.io/projected/545d983a-76ca-4236-8ddb-68a7137f98a7-kube-api-access-swqn9\") pod \"thanos-querier-ff99fdcb8-8d2c4\" (UID: \"545d983a-76ca-4236-8ddb-68a7137f98a7\") " pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:20.287138 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.287108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" event={"ID":"9c3c2559-6ddd-4a42-aee3-1ee0453546da","Type":"ContainerStarted","Data":"a53532948fedca86a108bb18451b6a03706dcb723c341933d2b012fc53e33dbd"} Jul 01 19:36:20.287251 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.287176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" event={"ID":"9c3c2559-6ddd-4a42-aee3-1ee0453546da","Type":"ContainerStarted","Data":"5cc8415b6cb3b15fdbc11aa5c47cbea0b5d4297bd3bd73f2dcc91145278c5ea1"} Jul 01 19:36:20.287251 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.287208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" event={"ID":"9c3c2559-6ddd-4a42-aee3-1ee0453546da","Type":"ContainerStarted","Data":"0f816e2c3f2fc7cbbb6124f6e3cc0287f8efaf7b913a55c0d5ad8d7822a7ad91"} Jul 01 19:36:20.288942 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.288914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"2c38362c8d7a949aca873f121e47240ee9722da813bb56825d270a29236aa795"} Jul 01 19:36:20.290726 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.290699 2579 generic.go:356] "Generic (PLEG): container finished" podID="4386e50b-7b89-42e3-9b41-9ca199262135" containerID="d85b542c88c0b64565b97f135221cb887141d7f0b68a5627ad9cd3199f118e1f" exitCode=0 Jul 01 19:36:20.290829 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.290775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26j9v" event={"ID":"4386e50b-7b89-42e3-9b41-9ca199262135","Type":"ContainerDied","Data":"d85b542c88c0b64565b97f135221cb887141d7f0b68a5627ad9cd3199f118e1f"} Jul 01 19:36:20.293055 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.293028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8tkd" event={"ID":"4046eaa4-7a83-4cc4-b18b-6f9d66628c82","Type":"ContainerStarted","Data":"e324f61f723f24d5f69283c9d27f0464a1e510215770ee003ed01e754d845719"} Jul 01 19:36:20.293141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.293073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8tkd" event={"ID":"4046eaa4-7a83-4cc4-b18b-6f9d66628c82","Type":"ContainerStarted","Data":"3a67629d2e13adf9f1a05cd772a352f7e20b7af5b677bbc48e8532a9e9d034af"} Jul 01 19:36:20.307688 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.307614 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbs9l" podStartSLOduration=1.2838821870000001 podStartE2EDuration="3.307591357s" totalImagesPullingTime="2.02370917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:20.306066818 +0000 UTC m=+67.932505907" watchObservedRunningTime="2026-07-01 19:36:20.307591357 +0000 UTC m=+67.934030443" Jul 01 19:36:20.350203 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.350141 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-7zzfz" podStartSLOduration=1.342389928 podStartE2EDuration="3.350120964s" totalImagesPullingTime="2.007731036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:20.348738113 +0000 UTC m=+67.975177198" watchObservedRunningTime="2026-07-01 19:36:20.350120964 +0000 UTC m=+67.976560052" Jul 01 19:36:20.371821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.371755 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l8tkd" podStartSLOduration=65.717134528 podStartE2EDuration="1m7.37173169s" totalImagesPullingTime="1.654597162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:20.37162016 +0000 UTC m=+67.998059245" watchObservedRunningTime="2026-07-01 19:36:20.37173169 +0000 UTC m=+67.998170775" Jul 01 19:36:20.418351 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:20.418089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:21.691545 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.691511 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d4f8989b8-tgsj2"] Jul 01 19:36:21.700456 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:21.700420 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545d983a_76ca_4236_8ddb_68a7137f98a7.slice/crio-7c6a863fde88007b68bdd508838b9b128acd7debf4f1dab4fe52d803392b99d8 WatchSource:0}: Error finding container 7c6a863fde88007b68bdd508838b9b128acd7debf4f1dab4fe52d803392b99d8: Status 404 returned error can't find the container with id 7c6a863fde88007b68bdd508838b9b128acd7debf4f1dab4fe52d803392b99d8 Jul 01 19:36:21.720788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.719372 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4"] Jul 01 19:36:21.720788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.719442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d4f8989b8-tgsj2"] Jul 01 19:36:21.720788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.719530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.728528 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.728265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 19:36:21.728528 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.728363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cs8r8\"" Jul 01 19:36:21.728695 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.728599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5iu8csj4168i3\"" Jul 01 19:36:21.728953 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.728781 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 19:36:21.734416 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.734371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 19:36:21.734525 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.734413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:36:21.788154 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-client-certs\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788154 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-metrics-server-audit-profiles\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-tls\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgjfd\" (UniqueName: \"kubernetes.io/projected/3a531825-b193-43d4-a09a-5031f1474f53-kube-api-access-zgjfd\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-client-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.788419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.788381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a531825-b193-43d4-a09a-5031f1474f53-audit-log\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.837998 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.836669 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8"] Jul 01 19:36:21.851647 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.851532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:21.853282 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.853253 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8"] Jul 01 19:36:21.854278 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.854260 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zqww7\"" Jul 01 19:36:21.854582 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.854568 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 19:36:21.889241 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-tls\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgjfd\" (UniqueName: \"kubernetes.io/projected/3a531825-b193-43d4-a09a-5031f1474f53-kube-api-access-zgjfd\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-client-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwnj\" (UniqueName: \"kubernetes.io/projected/6069d65d-be58-4faa-b2ce-0f4370bf5340-kube-api-access-hfwnj\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a531825-b193-43d4-a09a-5031f1474f53-audit-log\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6069d65d-be58-4faa-b2ce-0f4370bf5340-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:21.889442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-client-certs\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-metrics-server-audit-profiles\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.889952 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.889925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a531825-b193-43d4-a09a-5031f1474f53-audit-log\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.890304 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.890282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.890652 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.890627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a531825-b193-43d4-a09a-5031f1474f53-metrics-server-audit-profiles\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.892042 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.892016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-client-certs\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.892123 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.892098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-client-ca-bundle\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.892291 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.892262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a531825-b193-43d4-a09a-5031f1474f53-secret-metrics-server-tls\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.901474 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.901451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgjfd\" (UniqueName: \"kubernetes.io/projected/3a531825-b193-43d4-a09a-5031f1474f53-kube-api-access-zgjfd\") pod \"metrics-server-5d4f8989b8-tgsj2\" (UID: \"3a531825-b193-43d4-a09a-5031f1474f53\") " pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:21.990914 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.990855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwnj\" (UniqueName: \"kubernetes.io/projected/6069d65d-be58-4faa-b2ce-0f4370bf5340-kube-api-access-hfwnj\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:21.991104 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.990934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6069d65d-be58-4faa-b2ce-0f4370bf5340-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:21.993932 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:21.993899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6069d65d-be58-4faa-b2ce-0f4370bf5340-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:22.001524 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.001483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwnj\" (UniqueName: \"kubernetes.io/projected/6069d65d-be58-4faa-b2ce-0f4370bf5340-kube-api-access-hfwnj\") pod \"monitoring-plugin-cd8656b8-9k4p8\" (UID: \"6069d65d-be58-4faa-b2ce-0f4370bf5340\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:22.054287 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.054238 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:22.162672 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.162576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:22.303003 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.302965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"7c6a863fde88007b68bdd508838b9b128acd7debf4f1dab4fe52d803392b99d8"} Jul 01 19:36:22.305492 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.305448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26j9v" event={"ID":"4386e50b-7b89-42e3-9b41-9ca199262135","Type":"ContainerStarted","Data":"729638075d31232a8dee5ee47d81d07d775219b550b89d2c575211e5184be71d"} Jul 01 19:36:22.305637 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.305499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26j9v" event={"ID":"4386e50b-7b89-42e3-9b41-9ca199262135","Type":"ContainerStarted","Data":"f13195340a8c10c098ca20784b537ff354709b012791c614e22350b5e3deaabf"} Jul 01 19:36:22.331895 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:22.331517 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-26j9v" podStartSLOduration=2.970243085 podStartE2EDuration="5.331497135s" totalImagesPullingTime="2.209196035s" totalInitContainerRuntime="152.058015ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:22.329657995 +0000 UTC m=+69.956097080" watchObservedRunningTime="2026-07-01 19:36:22.331497135 +0000 UTC m=+69.957936220" Jul 01 19:36:23.413166 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.413132 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:36:23.417603 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.417509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.422754 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.422564 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:36:23.422754 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.422703 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:36:23.422969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.422852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:36:23.423440 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.423335 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:36:23.423440 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.423375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.424530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.424543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.424957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425050 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425144 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lvhu02uroo40\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425340 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425467 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:36:23.426406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.425585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:36:23.428462 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.427103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vshm5\"" Jul 01 19:36:23.429970 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.429952 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:36:23.463722 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.463646 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.505858 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.505977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcs4f\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.506385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.506297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607639 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcs4f\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.607821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.607994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608176 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608787 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608787 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608787 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608363 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.608958 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.609014 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.608972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.610592 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.610280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.611475 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.611410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.611715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.611744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.611768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.612254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.612442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.612623 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.612576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.613575 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.613516 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.614222 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.614199 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.619966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.614963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.619966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.615165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.619966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.615499 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.619966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.615936 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.619966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.618577 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.623431 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.623409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcs4f\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f\") pod \"prometheus-k8s-0\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:23.731147 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:23.731033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:24.069680 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.069648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8"] Jul 01 19:36:24.093100 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:24.093067 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6069d65d_be58_4faa_b2ce_0f4370bf5340.slice/crio-7cff31c3a4647842d48a1453222a11c75b855b661df80cb2d22a6270e142e8b9 WatchSource:0}: Error finding container 7cff31c3a4647842d48a1453222a11c75b855b661df80cb2d22a6270e142e8b9: Status 404 returned error can't find the container with id 7cff31c3a4647842d48a1453222a11c75b855b661df80cb2d22a6270e142e8b9 Jul 01 19:36:24.289473 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.289370 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d4f8989b8-tgsj2"] Jul 01 19:36:24.291771 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:24.291742 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a531825_b193_43d4_a09a_5031f1474f53.slice/crio-2ce890a721d601246b0777204f2f8a346946fbf20013dcb5f8e27250941ee0e5 WatchSource:0}: Error finding container 2ce890a721d601246b0777204f2f8a346946fbf20013dcb5f8e27250941ee0e5: Status 404 returned error can't find the container with id 2ce890a721d601246b0777204f2f8a346946fbf20013dcb5f8e27250941ee0e5 Jul 01 19:36:24.302885 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.302833 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:36:24.307204 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:36:24.307177 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1af43b_bf35_4252_8a66_c930dbbf42dc.slice/crio-d8d49c068efdac53e77fd46a034f8c2ba84fba60495426383eb4e5cbcbb5295f WatchSource:0}: Error finding container d8d49c068efdac53e77fd46a034f8c2ba84fba60495426383eb4e5cbcbb5295f: Status 404 returned error can't find the container with id d8d49c068efdac53e77fd46a034f8c2ba84fba60495426383eb4e5cbcbb5295f Jul 01 19:36:24.317008 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.316979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" event={"ID":"3a531825-b193-43d4-a09a-5031f1474f53","Type":"ContainerStarted","Data":"2ce890a721d601246b0777204f2f8a346946fbf20013dcb5f8e27250941ee0e5"} Jul 01 19:36:24.318632 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.318605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75fb6" event={"ID":"dc605f81-73ab-4196-b72c-a1fbd1f4c14d","Type":"ContainerStarted","Data":"0e8e5142423422ae36ea22380527b754848d4d0d733bef584c9ac4548b23dc30"} Jul 01 19:36:24.318758 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.318739 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:36:24.320366 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.320341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnjlh" event={"ID":"576b371e-5d0d-4e6f-b162-e5966bd53b9c","Type":"ContainerStarted","Data":"49487e17eda634997470e5a15644f253b83af080d89d2e145978658854534a11"} Jul 01 19:36:24.322012 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.321984 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" event={"ID":"6069d65d-be58-4faa-b2ce-0f4370bf5340","Type":"ContainerStarted","Data":"7cff31c3a4647842d48a1453222a11c75b855b661df80cb2d22a6270e142e8b9"} Jul 01 19:36:24.323995 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.323883 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="a0ab1f43e62c5078b4f423129e55fbc5fba43cf1f1ce0d2572ac995e89c80929" exitCode=0 Jul 01 19:36:24.323995 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.323942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"a0ab1f43e62c5078b4f423129e55fbc5fba43cf1f1ce0d2572ac995e89c80929"} Jul 01 19:36:24.326162 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.326137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"d8d49c068efdac53e77fd46a034f8c2ba84fba60495426383eb4e5cbcbb5295f"} Jul 01 19:36:24.343302 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.343264 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-75fb6" podStartSLOduration=65.597230454 podStartE2EDuration="1m11.343247539s" totalImagesPullingTime="5.746017085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:24.342934891 +0000 UTC m=+71.969373977" watchObservedRunningTime="2026-07-01 19:36:24.343247539 +0000 UTC m=+71.969686624" Jul 01 19:36:24.387203 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:24.387149 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mnjlh" podStartSLOduration=65.651742105 podStartE2EDuration="1m11.387131878s" totalImagesPullingTime="5.735389773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:24.38694012 +0000 UTC m=+72.013379205" watchObservedRunningTime="2026-07-01 19:36:24.387131878 +0000 UTC m=+72.013570961" Jul 01 19:36:25.333273 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:25.333235 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" exitCode=0 Jul 01 19:36:25.334001 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:25.333969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} Jul 01 19:36:26.343010 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:26.342972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" event={"ID":"6069d65d-be58-4faa-b2ce-0f4370bf5340","Type":"ContainerStarted","Data":"3a064444fadc0ba76da3905b7bd5f7d50b23884a26825a54cc6d7aea17e37130"} Jul 01 19:36:26.343453 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:26.343137 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:26.348731 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:26.348705 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" Jul 01 19:36:26.362317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:26.362265 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-9k4p8" podStartSLOduration=4.062585616 podStartE2EDuration="5.362243274s" totalImagesPullingTime="1.299657658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:26.360325652 +0000 UTC m=+73.986764739" watchObservedRunningTime="2026-07-01 19:36:26.362243274 +0000 UTC m=+73.988682371" Jul 01 19:36:27.351046 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.349904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" event={"ID":"3a531825-b193-43d4-a09a-5031f1474f53","Type":"ContainerStarted","Data":"dcf5bea7e0a2930d373930402288746ba1b249104f9d25f55f43ac87b8e600a9"} Jul 01 19:36:27.355297 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.355262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"c0c4a05733295d9ba2710314909948b1f2e3c9b92f818b5507b908bd14a04ac4"} Jul 01 19:36:27.355468 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.355346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"18a8479b9cb0c9990a4782c759076bccee3f396d57120cc0f2ddc3482862a192"} Jul 01 19:36:27.355468 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.355376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"b55cfa7f5a2846a135d6b22ae6c30149e61e1e7305599b6431e917f3c66660aa"} Jul 01 19:36:27.361188 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.361129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"2afee5a4badc8749da51ee5f4e4d2e1c84bd7b0d2632b7d1231c108096736e9a"} Jul 01 19:36:27.361317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.361228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"803c09734ce19164a4cbedc1adf2b5cc9b60095ad213f165dafc7c9595f55b38"} Jul 01 19:36:27.361317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.361270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"fc335c9f7fee81465240c6919b4d3cb58875b0a674e5395f73f9774dd787fc35"} Jul 01 19:36:27.361317 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.361308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"5f8e21563de7ceb251354d1e4f01f1d542bb22ee446d3f09f1eb2e9f57a95cbf"} Jul 01 19:36:27.361438 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.361345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"43d7da5ee77b4dc2b94eac3c54fe48bb48d71c301ad7e0ef6f6137c5046ed1e9"} Jul 01 19:36:27.374690 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:27.374623 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" podStartSLOduration=3.83520803 podStartE2EDuration="6.374602601s" totalImagesPullingTime="2.539394571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:27.372949505 +0000 UTC m=+74.999388585" watchObservedRunningTime="2026-07-01 19:36:27.374602601 +0000 UTC m=+75.001041685" Jul 01 19:36:28.370249 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.370204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"2a109a5b6549dd55871114adb56d520ed7eae0f5aa9ece9e6e3ca777a8e82fa7"} Jul 01 19:36:28.370720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.370329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"6b3f54d7d74c5f9b9e55b6f671dc20c31c617925b28feaa436b58bacecfe05a7"} Jul 01 19:36:28.370720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.370375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" event={"ID":"545d983a-76ca-4236-8ddb-68a7137f98a7","Type":"ContainerStarted","Data":"f3c5d1f1f6877406375a5cb99f7162105347a7cf3b0ef99e8d89169f94895ce3"} Jul 01 19:36:28.370720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.370425 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:28.374566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.374538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerStarted","Data":"ef2bb597624a7c3d99f3aac13e460a8f9f5db81696b3b84b7acca3e19435a8e4"} Jul 01 19:36:28.408802 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.408749 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" podStartSLOduration=2.450981346 podStartE2EDuration="8.408728048s" totalImagesPullingTime="5.957746702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:28.405438481 +0000 UTC m=+76.031877609" watchObservedRunningTime="2026-07-01 19:36:28.408728048 +0000 UTC m=+76.035167132" Jul 01 19:36:28.445656 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:28.445546 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.617221817 podStartE2EDuration="10.445527062s" totalImagesPullingTime="6.808176206s" totalInitContainerRuntime="20.129039ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:28.442052318 +0000 UTC m=+76.068491414" watchObservedRunningTime="2026-07-01 19:36:28.445527062 +0000 UTC m=+76.071966148" Jul 01 19:36:30.387033 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.386991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} Jul 01 19:36:30.387487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.387058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} Jul 01 19:36:30.387487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.387095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} Jul 01 19:36:30.387487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.387124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} Jul 01 19:36:30.387487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.387149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} Jul 01 19:36:30.387487 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.387183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerStarted","Data":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} Jul 01 19:36:30.426646 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:30.426594 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.3867572360000002 podStartE2EDuration="7.426575752s" totalImagesPullingTime="4.019542605s" totalInitContainerRuntime="20.275911ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:30.423104771 +0000 UTC m=+78.049543871" watchObservedRunningTime="2026-07-01 19:36:30.426575752 +0000 UTC m=+78.053014862" Jul 01 19:36:33.731300 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:33.731187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:36:34.385344 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:34.385314 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ff99fdcb8-8d2c4" Jul 01 19:36:42.055109 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:42.055068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:42.055712 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:42.055138 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:36:49.959769 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:49.959730 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6p7fz_f94c50d5-f964-4a33-b494-7a2a11ffceb2/serve-healthcheck-canary/0.log" Jul 01 19:36:55.336823 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:36:55.336779 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-75fb6" Jul 01 19:37:02.060443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:02.060414 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:37:02.065203 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:02.065172 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d4f8989b8-tgsj2" Jul 01 19:37:23.731916 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:23.731856 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:23.751074 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:23.751049 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:24.631879 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:24.631835 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:37.490530 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490480 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490788 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="alertmanager" containerID="cri-o://43d7da5ee77b4dc2b94eac3c54fe48bb48d71c301ad7e0ef6f6137c5046ed1e9" gracePeriod=120 Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490892 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-web" containerID="cri-o://fc335c9f7fee81465240c6919b4d3cb58875b0a674e5395f73f9774dd787fc35" gracePeriod=120 Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490937 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="prom-label-proxy" containerID="cri-o://ef2bb597624a7c3d99f3aac13e460a8f9f5db81696b3b84b7acca3e19435a8e4" gracePeriod=120 Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490949 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="config-reloader" containerID="cri-o://5f8e21563de7ceb251354d1e4f01f1d542bb22ee446d3f09f1eb2e9f57a95cbf" gracePeriod=120 Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490887 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-metric" containerID="cri-o://2afee5a4badc8749da51ee5f4e4d2e1c84bd7b0d2632b7d1231c108096736e9a" gracePeriod=120 Jul 01 19:37:37.491099 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.490902 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy" containerID="cri-o://803c09734ce19164a4cbedc1adf2b5cc9b60095ad213f165dafc7c9595f55b38" gracePeriod=120 Jul 01 19:37:37.670410 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670378 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="ef2bb597624a7c3d99f3aac13e460a8f9f5db81696b3b84b7acca3e19435a8e4" exitCode=0 Jul 01 19:37:37.670410 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670403 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="803c09734ce19164a4cbedc1adf2b5cc9b60095ad213f165dafc7c9595f55b38" exitCode=0 Jul 01 19:37:37.670410 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670409 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="5f8e21563de7ceb251354d1e4f01f1d542bb22ee446d3f09f1eb2e9f57a95cbf" exitCode=0 Jul 01 19:37:37.670410 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670414 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="43d7da5ee77b4dc2b94eac3c54fe48bb48d71c301ad7e0ef6f6137c5046ed1e9" exitCode=0 Jul 01 19:37:37.670666 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"ef2bb597624a7c3d99f3aac13e460a8f9f5db81696b3b84b7acca3e19435a8e4"} Jul 01 19:37:37.670666 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"803c09734ce19164a4cbedc1adf2b5cc9b60095ad213f165dafc7c9595f55b38"} Jul 01 19:37:37.670666 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"5f8e21563de7ceb251354d1e4f01f1d542bb22ee446d3f09f1eb2e9f57a95cbf"} Jul 01 19:37:37.670666 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:37.670578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"43d7da5ee77b4dc2b94eac3c54fe48bb48d71c301ad7e0ef6f6137c5046ed1e9"} Jul 01 19:37:38.680369 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.680337 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="2afee5a4badc8749da51ee5f4e4d2e1c84bd7b0d2632b7d1231c108096736e9a" exitCode=0 Jul 01 19:37:38.680369 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.680364 2579 generic.go:356] "Generic (PLEG): container finished" podID="92061990-1dc1-4251-a7c9-b766257f0465" containerID="fc335c9f7fee81465240c6919b4d3cb58875b0a674e5395f73f9774dd787fc35" exitCode=0 Jul 01 19:37:38.680780 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.680374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"2afee5a4badc8749da51ee5f4e4d2e1c84bd7b0d2632b7d1231c108096736e9a"} Jul 01 19:37:38.680780 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.680475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"fc335c9f7fee81465240c6919b4d3cb58875b0a674e5395f73f9774dd787fc35"} Jul 01 19:37:38.747932 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.747909 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:38.772295 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772259 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772295 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772298 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772317 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772346 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772384 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772407 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772430 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772471 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772504 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772538 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772567 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56bkp\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772628 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric\") pod \"92061990-1dc1-4251-a7c9-b766257f0465\" (UID: \"92061990-1dc1-4251-a7c9-b766257f0465\") " Jul 01 19:37:38.772969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772801 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:38.772969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772823 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:37:38.773202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772974 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-main-db\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.773202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.772996 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.773202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.773164 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:38.775725 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.775691 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:37:38.775886 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.775727 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.776348 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776319 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp" (OuterVolumeSpecName: "kube-api-access-56bkp") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "kube-api-access-56bkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:37:38.776513 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776437 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.776698 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776670 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.776804 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776769 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out" (OuterVolumeSpecName: "config-out") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:37:38.776804 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776781 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.776901 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.776841 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume" (OuterVolumeSpecName: "config-volume") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.782018 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.781971 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.791498 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.791462 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config" (OuterVolumeSpecName: "web-config") pod "92061990-1dc1-4251-a7c9-b766257f0465" (UID: "92061990-1dc1-4251-a7c9-b766257f0465"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874020 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874054 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-tls-assets\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874065 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-config-volume\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874073 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92061990-1dc1-4251-a7c9-b766257f0465-config-out\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874082 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874092 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92061990-1dc1-4251-a7c9-b766257f0465-metrics-client-ca\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874102 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-cluster-tls-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874114 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-web-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874122 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-main-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874119 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874132 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56bkp\" (UniqueName: \"kubernetes.io/projected/92061990-1dc1-4251-a7c9-b766257f0465-kube-api-access-56bkp\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:38.874550 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:38.874141 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92061990-1dc1-4251-a7c9-b766257f0465-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:39.688110 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.688074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92061990-1dc1-4251-a7c9-b766257f0465","Type":"ContainerDied","Data":"2c38362c8d7a949aca873f121e47240ee9722da813bb56825d270a29236aa795"} Jul 01 19:37:39.688528 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.688086 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.688528 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.688170 2579 scope.go:117] "RemoveContainer" containerID="ef2bb597624a7c3d99f3aac13e460a8f9f5db81696b3b84b7acca3e19435a8e4" Jul 01 19:37:39.696341 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.696320 2579 scope.go:117] "RemoveContainer" containerID="2afee5a4badc8749da51ee5f4e4d2e1c84bd7b0d2632b7d1231c108096736e9a" Jul 01 19:37:39.703534 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.703515 2579 scope.go:117] "RemoveContainer" containerID="803c09734ce19164a4cbedc1adf2b5cc9b60095ad213f165dafc7c9595f55b38" Jul 01 19:37:39.710146 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.710102 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:39.711021 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.710964 2579 scope.go:117] "RemoveContainer" containerID="fc335c9f7fee81465240c6919b4d3cb58875b0a674e5395f73f9774dd787fc35" Jul 01 19:37:39.715137 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.715117 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:39.717955 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.717928 2579 scope.go:117] "RemoveContainer" containerID="5f8e21563de7ceb251354d1e4f01f1d542bb22ee446d3f09f1eb2e9f57a95cbf" Jul 01 19:37:39.724627 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.724609 2579 scope.go:117] "RemoveContainer" containerID="43d7da5ee77b4dc2b94eac3c54fe48bb48d71c301ad7e0ef6f6137c5046ed1e9" Jul 01 19:37:39.731314 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.731298 2579 scope.go:117] "RemoveContainer" containerID="a0ab1f43e62c5078b4f423129e55fbc5fba43cf1f1ce0d2572ac995e89c80929" Jul 01 19:37:39.743353 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743292 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:39.743608 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743595 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="alertmanager" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743610 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="alertmanager" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743620 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="config-reloader" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743626 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="config-reloader" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743634 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743640 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy" Jul 01 19:37:39.743649 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743647 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-metric" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743652 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-metric" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743661 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-web" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743666 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-web" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743674 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="init-config-reloader" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743679 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="init-config-reloader" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743693 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="prom-label-proxy" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743698 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="prom-label-proxy" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743743 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-metric" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743752 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="config-reloader" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743758 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="prom-label-proxy" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743764 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy-web" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743771 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="kube-rbac-proxy" Jul 01 19:37:39.743824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.743777 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92061990-1dc1-4251-a7c9-b766257f0465" containerName="alertmanager" Jul 01 19:37:39.751196 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.751168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.754038 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:37:39.754141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:37:39.754141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754009 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:37:39.754141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754117 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:37:39.754299 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:37:39.754482 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754460 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-djptz\"" Jul 01 19:37:39.754562 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754507 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:37:39.754762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:37:39.754807 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.754775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:37:39.759707 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.759649 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:37:39.766565 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.766536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:39.780807 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.780807 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjts\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-kube-api-access-tmjts\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.780970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-out\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-volume\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.781212 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.781188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-web-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882491 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882491 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjts\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-kube-api-access-tmjts\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882491 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882491 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882491 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-out\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-volume\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.882894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.882685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-web-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.883291 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.883009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.883575 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.883508 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.884593 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.884569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747a95b2-9c3d-4f0f-83ae-adeef58e722e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.885669 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-web-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.885779 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.885845 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.885845 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.885845 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.886024 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.885931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.886778 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.886755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.887058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.887036 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-out\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.887545 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.887529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/747a95b2-9c3d-4f0f-83ae-adeef58e722e-config-volume\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:39.891816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:39.891790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjts\" (UniqueName: \"kubernetes.io/projected/747a95b2-9c3d-4f0f-83ae-adeef58e722e-kube-api-access-tmjts\") pod \"alertmanager-main-0\" (UID: \"747a95b2-9c3d-4f0f-83ae-adeef58e722e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:40.062406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.062365 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:37:40.227065 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.227035 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:37:40.228503 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:37:40.228475 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747a95b2_9c3d_4f0f_83ae_adeef58e722e.slice/crio-664bf9ff25be2b1b91cf67aec55c62ba7908871edd0f1356e444b5b7b8e3ece1 WatchSource:0}: Error finding container 664bf9ff25be2b1b91cf67aec55c62ba7908871edd0f1356e444b5b7b8e3ece1: Status 404 returned error can't find the container with id 664bf9ff25be2b1b91cf67aec55c62ba7908871edd0f1356e444b5b7b8e3ece1 Jul 01 19:37:40.693783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.693746 2579 generic.go:356] "Generic (PLEG): container finished" podID="747a95b2-9c3d-4f0f-83ae-adeef58e722e" containerID="c31b2de17112970f8843dde965ad784a3c05ba458f96943d263ca8b3de4fb11a" exitCode=0 Jul 01 19:37:40.694171 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.693834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerDied","Data":"c31b2de17112970f8843dde965ad784a3c05ba458f96943d263ca8b3de4fb11a"} Jul 01 19:37:40.694171 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.693926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"664bf9ff25be2b1b91cf67aec55c62ba7908871edd0f1356e444b5b7b8e3ece1"} Jul 01 19:37:40.927602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:40.927569 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92061990-1dc1-4251-a7c9-b766257f0465" path="/var/lib/kubelet/pods/92061990-1dc1-4251-a7c9-b766257f0465/volumes" Jul 01 19:37:41.545322 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.545280 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-854c75bffd-gj4t2"] Jul 01 19:37:41.547876 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.547847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.551243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.550835 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 19:37:41.551243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.551095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 19:37:41.551243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.551125 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6fd87\"" Jul 01 19:37:41.551461 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.551365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 19:37:41.551461 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.551402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 19:37:41.551557 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.551402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 19:37:41.557586 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.557387 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 19:37:41.567947 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.567921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854c75bffd-gj4t2"] Jul 01 19:37:41.597234 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597234 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skbd\" (UniqueName: \"kubernetes.io/projected/91cdcfcd-1055-48d3-959e-bcb16f4457f7-kube-api-access-8skbd\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-federate-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-serving-certs-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597563 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.597563 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.597461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-metrics-client-ca\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698221 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-serving-certs-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-metrics-client-ca\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skbd\" (UniqueName: \"kubernetes.io/projected/91cdcfcd-1055-48d3-959e-bcb16f4457f7-kube-api-access-8skbd\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.698676 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.698487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-federate-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.699159 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.699132 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-serving-certs-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.699257 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.699233 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.699799 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.699776 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cdcfcd-1055-48d3-959e-bcb16f4457f7-metrics-client-ca\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.708724 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.703749 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-federate-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.708724 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.703940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.708724 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.703948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-telemeter-client-tls\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.708724 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.703963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91cdcfcd-1055-48d3-959e-bcb16f4457f7-secret-telemeter-client\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.709944 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.709923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skbd\" (UniqueName: \"kubernetes.io/projected/91cdcfcd-1055-48d3-959e-bcb16f4457f7-kube-api-access-8skbd\") pod \"telemeter-client-854c75bffd-gj4t2\" (UID: \"91cdcfcd-1055-48d3-959e-bcb16f4457f7\") " pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:41.711314 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"7ade32f7ce56ecc0186e81d38ff7d0144f8fa778503cc6164343c681527a09b9"} Jul 01 19:37:41.711435 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"040b171b27381c73417839daac23a56c08a7ecdbf0fe4cf489934e7f2d52fd2c"} Jul 01 19:37:41.711506 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"43d3ffd3be89dacac9487b331ce3027b0c58226cdf5f1201e2af2ef8dfc9771c"} Jul 01 19:37:41.711569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711509 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"9350b12e5a36771ced81067c0edad193de15e39d8997f17ab8b92fd895fa4a69"} Jul 01 19:37:41.711569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"a164bb534cca7c1de189c01b23b9cc8f55383bf7fa4e56abbb74b7fe197281c2"} Jul 01 19:37:41.711659 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.711590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"747a95b2-9c3d-4f0f-83ae-adeef58e722e","Type":"ContainerStarted","Data":"981728eb6eec04f00083fadb6d68b5db7ebad71e13839903ee0a0d3337ec5fad"} Jul 01 19:37:41.745761 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.745674 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.728328835 podStartE2EDuration="2.745656125s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.32729ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:37:41.745566025 +0000 UTC m=+149.372005110" watchObservedRunningTime="2026-07-01 19:37:41.745656125 +0000 UTC m=+149.372095210" Jul 01 19:37:41.832616 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.832586 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:41.833007 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.832976 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="prometheus" containerID="cri-o://51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" gracePeriod=600 Jul 01 19:37:41.833132 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.833005 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" gracePeriod=600 Jul 01 19:37:41.833199 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.833158 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy" containerID="cri-o://99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" gracePeriod=600 Jul 01 19:37:41.833383 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.833269 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-web" containerID="cri-o://6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" gracePeriod=600 Jul 01 19:37:41.833383 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.833312 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="config-reloader" containerID="cri-o://62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" gracePeriod=600 Jul 01 19:37:41.833549 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.833345 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="thanos-sidecar" containerID="cri-o://eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" gracePeriod=600 Jul 01 19:37:41.859584 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:41.859553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" Jul 01 19:37:42.028957 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.028930 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854c75bffd-gj4t2"] Jul 01 19:37:42.030715 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:37:42.030683 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cdcfcd_1055_48d3_959e_bcb16f4457f7.slice/crio-1760a2643a45caa012694223e4016e143a6d4961308da52b3d849d91a4303626 WatchSource:0}: Error finding container 1760a2643a45caa012694223e4016e143a6d4961308da52b3d849d91a4303626: Status 404 returned error can't find the container with id 1760a2643a45caa012694223e4016e143a6d4961308da52b3d849d91a4303626 Jul 01 19:37:42.094121 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.094093 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.102314 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102284 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102314 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102316 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102339 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102368 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102395 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102533 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102513 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102543 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102582 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102618 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102652 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102688 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102713 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102730 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102741 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102752 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.102777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102773 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102897 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.102953 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103001 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcs4f\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103029 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls\") pod \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\" (UID: \"ba1af43b-bf35-4252-8a66-c930dbbf42dc\") " Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103133 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103308 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-metrics-client-ca\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103331 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.103347 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103345 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.103769 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103360 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.105266 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.103897 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.105266 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.104194 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.105266 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.104773 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:37:42.106084 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.105804 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:42.106889 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.106843 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out" (OuterVolumeSpecName: "config-out") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:37:42.107075 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.107043 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config" (OuterVolumeSpecName: "config") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.107788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.107740 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.109483 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109377 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.109634 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109550 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f" (OuterVolumeSpecName: "kube-api-access-rcs4f") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "kube-api-access-rcs4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:37:42.109634 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109555 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.109924 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109686 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.109924 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109702 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:37:42.109924 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.109805 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.110644 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.110623 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.110816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.110800 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.121750 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.121730 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config" (OuterVolumeSpecName: "web-config") pod "ba1af43b-bf35-4252-8a66-c930dbbf42dc" (UID: "ba1af43b-bf35-4252-8a66-c930dbbf42dc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:42.203978 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.203945 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-tls-assets\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.203978 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.203973 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config-out\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.203978 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.203982 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-web-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.203990 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-kube-rbac-proxy\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204000 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204009 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204017 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-db\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204025 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204036 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204045 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204055 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204063 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-metrics-client-certs\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204072 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1af43b-bf35-4252-8a66-c930dbbf42dc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204080 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204088 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcs4f\" (UniqueName: \"kubernetes.io/projected/ba1af43b-bf35-4252-8a66-c930dbbf42dc-kube-api-access-rcs4f\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.204206 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.204097 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1af43b-bf35-4252-8a66-c930dbbf42dc-secret-grpc-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:37:42.717702 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.717655 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" event={"ID":"91cdcfcd-1055-48d3-959e-bcb16f4457f7","Type":"ContainerStarted","Data":"1760a2643a45caa012694223e4016e143a6d4961308da52b3d849d91a4303626"} Jul 01 19:37:42.721321 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721291 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" exitCode=0 Jul 01 19:37:42.721321 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721317 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" exitCode=0 Jul 01 19:37:42.721321 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721326 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" exitCode=0 Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721332 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" exitCode=0 Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721338 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" exitCode=0 Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721346 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" exitCode=0 Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721393 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721517 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} Jul 01 19:37:42.721538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721534 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.721893 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} Jul 01 19:37:42.721893 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} Jul 01 19:37:42.721893 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} Jul 01 19:37:42.721893 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.721635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1af43b-bf35-4252-8a66-c930dbbf42dc","Type":"ContainerDied","Data":"d8d49c068efdac53e77fd46a034f8c2ba84fba60495426383eb4e5cbcbb5295f"} Jul 01 19:37:42.732161 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.732136 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.740481 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.740461 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.749189 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.749167 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.749419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.749398 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:42.755709 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.755685 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:42.758475 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.758455 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.766694 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.766671 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.777744 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.777436 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.788071 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788039 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:42.788482 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788461 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788485 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788505 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="thanos-sidecar" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788514 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="thanos-sidecar" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788524 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="init-config-reloader" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788533 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="init-config-reloader" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788471 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788552 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="prometheus" Jul 01 19:37:42.788559 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788559 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="prometheus" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788570 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-thanos" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788578 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-thanos" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788587 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-web" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788593 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-web" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788614 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="config-reloader" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788623 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="config-reloader" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788691 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788702 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-thanos" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788716 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="kube-rbac-proxy-web" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788726 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="prometheus" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788734 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="thanos-sidecar" Jul 01 19:37:42.788903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788743 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" containerName="config-reloader" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.788922 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.788963 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.789053 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.789388 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.789420 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.789458 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.789451 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.790201 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.790051 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.790201 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790084 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.790201 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790122 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.790543 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.790513 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.790656 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790550 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.790656 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790573 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.790899 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.790858 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.790979 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790905 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.790979 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.790928 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.791207 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.791188 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.791308 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.791214 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.791308 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.791234 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.791795 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:37:42.791756 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.791795 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.791786 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.791986 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.791807 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.792117 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792091 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.792196 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792120 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.792802 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792517 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.792802 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792544 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.792982 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792855 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.792982 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.792910 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.793272 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.793124 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.793272 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.793148 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.793433 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.793413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.793517 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.793416 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.793575 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.793520 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.794395 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.794365 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.794485 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.794398 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.794790 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.794764 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.794908 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.794790 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.795236 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795190 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.795236 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795216 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.795512 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795487 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.795615 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795513 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.795753 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795730 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.795822 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.795759 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.796102 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796076 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.796186 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796103 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.796455 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796427 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.796455 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796454 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.796613 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:37:42.796613 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:37:42.796613 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:37:42.796759 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796716 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:37:42.796806 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796750 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.796806 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796770 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.796922 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:37:42.796985 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.796942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:37:42.797057 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:37:42.797111 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797074 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:37:42.797425 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797267 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.797425 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797332 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.797425 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797389 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:37:42.797425 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:37:42.797801 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797728 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:37:42.797974 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:37:42.797974 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.797891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vshm5\"" Jul 01 19:37:42.798136 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.798108 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.798136 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.798131 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.798322 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.798272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lvhu02uroo40\"" Jul 01 19:37:42.798678 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.798649 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.798678 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.798677 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.799774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.799677 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.799774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.799720 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.800969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.800237 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.800969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.800269 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.800969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.800759 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.800969 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.800787 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.801405 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.801265 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.805118 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.805235 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.805730 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.805748 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.806250 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.806569 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.806318 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.806903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.806750 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.806903 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.806770 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.807566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.807484 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.807566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.807542 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.808112 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.808055 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.808211 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.808117 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.808598 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.808570 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.808679 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.808601 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.810962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.810305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.810962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.810889 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.810962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.810914 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.812328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812315 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.812566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812341 2579 scope.go:117] "RemoveContainer" containerID="a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7" Jul 01 19:37:42.812566 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng96j\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-kube-api-access-ng96j\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812658 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812765 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812704 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7"} err="failed to get container status \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": rpc error: code = NotFound desc = could not find container \"a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7\": container with ID starting with a20b87d844a465bc8b12910a122202cfb80619781b9d254979bd9dbe9d1ddce7 not found: ID does not exist" Jul 01 19:37:42.812765 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812765 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812727 2579 scope.go:117] "RemoveContainer" containerID="99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39" Jul 01 19:37:42.812765 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.812983 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.813279 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.813218 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39"} err="failed to get container status \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": rpc error: code = NotFound desc = could not find container \"99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39\": container with ID starting with 99a40c1cb07fd9fc8d40621c938b3b43d61c42c0b5a49989e42da78bcf1fdc39 not found: ID does not exist" Jul 01 19:37:42.813279 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.813259 2579 scope.go:117] "RemoveContainer" containerID="6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b" Jul 01 19:37:42.813795 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.812974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.813989 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.813792 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:37:42.814118 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.814204 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.814346 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.814467 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.814525 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.816520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814844 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b"} err="failed to get container status \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": rpc error: code = NotFound desc = could not find container \"6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b\": container with ID starting with 6452d119be1f090045d432c5adc1910f50e999734666e8b586b604864e12d93b not found: ID does not exist" Jul 01 19:37:42.816520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.816520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814886 2579 scope.go:117] "RemoveContainer" containerID="eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c" Jul 01 19:37:42.816520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.816520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.814992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.817407 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817263 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c"} err="failed to get container status \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": rpc error: code = NotFound desc = could not find container \"eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c\": container with ID starting with eccee317b366bb606682409d61ccff95abd8eee4f190b0c330ecb36355bc057c not found: ID does not exist" Jul 01 19:37:42.817407 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817311 2579 scope.go:117] "RemoveContainer" containerID="62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817" Jul 01 19:37:42.817626 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817599 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817"} err="failed to get container status \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": rpc error: code = NotFound desc = could not find container \"62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817\": container with ID starting with 62fc17f50320873ea329c2fa7e09524d29b73e1e4b18f9d4c09a7f052f6dd817 not found: ID does not exist" Jul 01 19:37:42.817701 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817627 2579 scope.go:117] "RemoveContainer" containerID="51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c" Jul 01 19:37:42.817945 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817920 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c"} err="failed to get container status \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": rpc error: code = NotFound desc = could not find container \"51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c\": container with ID starting with 51201ebae2facc399e53ac524286d2070f58b49da6c7a0c983e400c130634e7c not found: ID does not exist" Jul 01 19:37:42.818057 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.817947 2579 scope.go:117] "RemoveContainer" containerID="80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a" Jul 01 19:37:42.818141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.818121 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:42.818251 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.818172 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a"} err="failed to get container status \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": rpc error: code = NotFound desc = could not find container \"80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a\": container with ID starting with 80414c6bae382fa19d34494b6b43eb138b3fff52278fd56d2413d0381a0cde0a not found: ID does not exist" Jul 01 19:37:42.915645 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.915645 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.915645 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng96j\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-kube-api-access-ng96j\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.915967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.916762 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.916491 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.917345 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.917315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.918264 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.917948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.918391 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.918373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.919543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.919707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.919811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.919911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920612 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.920315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920612 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.920437 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920612 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.920602 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.920801 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.920775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9c502f-807b-4ced-a2e4-7b4b93613d95-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.921221 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.920946 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c9c502f-807b-4ced-a2e4-7b4b93613d95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.922260 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.922236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.923277 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.923250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.924538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.924514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.924636 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.924514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.924636 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.924543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.925753 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.925734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9c502f-807b-4ced-a2e4-7b4b93613d95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:42.927272 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.927249 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1af43b-bf35-4252-8a66-c930dbbf42dc" path="/var/lib/kubelet/pods/ba1af43b-bf35-4252-8a66-c930dbbf42dc/volumes" Jul 01 19:37:42.929273 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:42.929253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng96j\" (UniqueName: \"kubernetes.io/projected/9c9c502f-807b-4ced-a2e4-7b4b93613d95-kube-api-access-ng96j\") pod \"prometheus-k8s-0\" (UID: \"9c9c502f-807b-4ced-a2e4-7b4b93613d95\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:43.108537 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:43.108489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:37:43.692191 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:43.692160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:37:43.694131 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:37:43.694105 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9c502f_807b_4ced_a2e4_7b4b93613d95.slice/crio-21d7573ffa9367cc5e4dcbf828fb1729819e21c928b942a894c4e066075dcaa6 WatchSource:0}: Error finding container 21d7573ffa9367cc5e4dcbf828fb1729819e21c928b942a894c4e066075dcaa6: Status 404 returned error can't find the container with id 21d7573ffa9367cc5e4dcbf828fb1729819e21c928b942a894c4e066075dcaa6 Jul 01 19:37:43.728123 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:43.728029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"21d7573ffa9367cc5e4dcbf828fb1729819e21c928b942a894c4e066075dcaa6"} Jul 01 19:37:43.731214 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:43.731176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" event={"ID":"91cdcfcd-1055-48d3-959e-bcb16f4457f7","Type":"ContainerStarted","Data":"95d8006d27a92cc1bba611b95f75b9cbfe0bf0e2d30e03ac323b7766e7ae3f13"} Jul 01 19:37:43.731308 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:43.731239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" event={"ID":"91cdcfcd-1055-48d3-959e-bcb16f4457f7","Type":"ContainerStarted","Data":"b29ff5aa0e8837bcf33101415bc6fa7c5867cdd9e52e55e69aecfa3ada3dfa50"} Jul 01 19:37:44.736440 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:44.736408 2579 generic.go:356] "Generic (PLEG): container finished" podID="9c9c502f-807b-4ced-a2e4-7b4b93613d95" containerID="f766959bd57e0f9ca33540e3b3c16944a4c289cc55649f8a03d1a62b8c91a4ae" exitCode=0 Jul 01 19:37:44.736883 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:44.736496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerDied","Data":"f766959bd57e0f9ca33540e3b3c16944a4c289cc55649f8a03d1a62b8c91a4ae"} Jul 01 19:37:44.738602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:44.738578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" event={"ID":"91cdcfcd-1055-48d3-959e-bcb16f4457f7","Type":"ContainerStarted","Data":"24c8a1fd9358b4c772dd0719789d24b6654295aac27313264ec491cae829b8df"} Jul 01 19:37:44.800836 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:44.800790 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-854c75bffd-gj4t2" podStartSLOduration=2.259366153 podStartE2EDuration="3.800773802s" totalImagesPullingTime="1.541407649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:37:44.800117082 +0000 UTC m=+152.426556167" watchObservedRunningTime="2026-07-01 19:37:44.800773802 +0000 UTC m=+152.427212886" Jul 01 19:37:45.747382 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"788a66fd2b1299a7c03d84c405567e50ae27d8dc8598464215078d879014fb73"} Jul 01 19:37:45.747847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"4fecf306fb53e635e90eaae99a233eec780bc7fd2e219f63e10f149f2d0cd656"} Jul 01 19:37:45.747847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"3cf5c3243169ddbd3a2be0dc78d1a6d49c80eaaeb3dbae35ab68331d98c5dfc3"} Jul 01 19:37:45.747847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747514 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"f523ca3266842a651a890d75d1ea74a277572bc77c2e241b491ce3aa8cbbc672"} Jul 01 19:37:45.747847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"53aff1e2846ce0ece86ef6a109080d5c6d194d2fc181ad1b9ed07f258a1f4715"} Jul 01 19:37:45.747847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.747595 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9c502f-807b-4ced-a2e4-7b4b93613d95","Type":"ContainerStarted","Data":"8311b06367b7486d837ffe8f6bb5064dd9229e61540ed337e2a44790aefb881d"} Jul 01 19:37:45.780443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:45.780354 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.7599739789999997 podStartE2EDuration="3.780329799s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.35582ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:37:45.778517118 +0000 UTC m=+153.404956236" watchObservedRunningTime="2026-07-01 19:37:45.780329799 +0000 UTC m=+153.406768886" Jul 01 19:37:48.109188 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:37:48.109140 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:38:43.109630 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:38:43.109586 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:38:43.124879 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:38:43.124847 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:38:44.002588 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:38:44.002560 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:40:12.867140 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:12.867106 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:40:12.873939 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:12.873911 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:40:12.877620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:12.877595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:40:13.146328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.146261 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9"] Jul 01 19:40:13.149385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.149368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.152445 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.152421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kvvzb\"" Jul 01 19:40:13.153572 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.153552 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 19:40:13.153681 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.153552 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 19:40:13.170465 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.170427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9"] Jul 01 19:40:13.222782 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.222751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.222966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.222802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftgd\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-kube-api-access-wftgd\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.323766 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.323734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.323947 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.323783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftgd\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-kube-api-access-wftgd\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.333012 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.332988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.333192 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.333173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftgd\" (UniqueName: \"kubernetes.io/projected/3a05b98c-99b5-4653-a44d-b8c21e58a6b7-kube-api-access-wftgd\") pod \"cert-manager-webhook-7dc76cbb94-vdmd9\" (UID: \"3a05b98c-99b5-4653-a44d-b8c21e58a6b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.474443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.474337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:13.605480 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:13.605457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9"] Jul 01 19:40:13.608146 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:40:13.608111 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a05b98c_99b5_4653_a44d_b8c21e58a6b7.slice/crio-2fb04df2e04ab4f112197726fc2d331f5defc67053e22e069d485e46cbf91468 WatchSource:0}: Error finding container 2fb04df2e04ab4f112197726fc2d331f5defc67053e22e069d485e46cbf91468: Status 404 returned error can't find the container with id 2fb04df2e04ab4f112197726fc2d331f5defc67053e22e069d485e46cbf91468 Jul 01 19:40:14.353431 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:14.353397 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" event={"ID":"3a05b98c-99b5-4653-a44d-b8c21e58a6b7","Type":"ContainerStarted","Data":"2fb04df2e04ab4f112197726fc2d331f5defc67053e22e069d485e46cbf91468"} Jul 01 19:40:17.368638 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:17.368602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" event={"ID":"3a05b98c-99b5-4653-a44d-b8c21e58a6b7","Type":"ContainerStarted","Data":"e2ed6a6b57fc43dc5bccfb54f4c7b0a3ae0939de14ecdf0ac493097ef9a52804"} Jul 01 19:40:17.369059 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:17.368721 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:17.408228 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:17.408173 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" podStartSLOduration=1.307392894 podStartE2EDuration="4.408153985s" totalImagesPullingTime="3.100761091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:40:17.407378486 +0000 UTC m=+305.033817569" watchObservedRunningTime="2026-07-01 19:40:17.408153985 +0000 UTC m=+305.034593066" Jul 01 19:40:23.374998 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:23.374964 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-vdmd9" Jul 01 19:40:38.906048 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.906014 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9"] Jul 01 19:40:38.909384 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.909367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:38.912389 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.912369 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:40:38.912567 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.912555 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 19:40:38.913553 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.913535 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pnzzt\"" Jul 01 19:40:38.926919 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:38.926892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9"] Jul 01 19:40:39.050033 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.050000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6669-1947-419c-a236-ee9fa0fa88ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.050191 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.050041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vcjz\" (UniqueName: \"kubernetes.io/projected/bf3d6669-1947-419c-a236-ee9fa0fa88ba-kube-api-access-4vcjz\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.151159 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.151126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6669-1947-419c-a236-ee9fa0fa88ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.151159 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.151164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vcjz\" (UniqueName: \"kubernetes.io/projected/bf3d6669-1947-419c-a236-ee9fa0fa88ba-kube-api-access-4vcjz\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.151503 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.151484 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6669-1947-419c-a236-ee9fa0fa88ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.160116 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.160040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vcjz\" (UniqueName: \"kubernetes.io/projected/bf3d6669-1947-419c-a236-ee9fa0fa88ba-kube-api-access-4vcjz\") pod \"openshift-lws-operator-fd8ccff4c-cqfk9\" (UID: \"bf3d6669-1947-419c-a236-ee9fa0fa88ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.218975 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.218942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" Jul 01 19:40:39.357508 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.357454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9"] Jul 01 19:40:39.360761 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:40:39.360731 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf3d6669_1947_419c_a236_ee9fa0fa88ba.slice/crio-fc78de0ec094ec4640ed4abe408675040e879ed04e0508a5a9e7ca480b0404e1 WatchSource:0}: Error finding container fc78de0ec094ec4640ed4abe408675040e879ed04e0508a5a9e7ca480b0404e1: Status 404 returned error can't find the container with id fc78de0ec094ec4640ed4abe408675040e879ed04e0508a5a9e7ca480b0404e1 Jul 01 19:40:39.362180 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.362163 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:40:39.462833 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:39.462749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" event={"ID":"bf3d6669-1947-419c-a236-ee9fa0fa88ba","Type":"ContainerStarted","Data":"fc78de0ec094ec4640ed4abe408675040e879ed04e0508a5a9e7ca480b0404e1"} Jul 01 19:40:42.482724 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:42.482689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" event={"ID":"bf3d6669-1947-419c-a236-ee9fa0fa88ba","Type":"ContainerStarted","Data":"543caf4c53c4800be5c73d4013fe0b13584b641615bee521e02bfa46abcc05c7"} Jul 01 19:40:42.506431 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:42.506360 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cqfk9" podStartSLOduration=1.901733814 podStartE2EDuration="4.506342517s" totalImagesPullingTime="2.604608703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:40:42.504419498 +0000 UTC m=+330.130858583" watchObservedRunningTime="2026-07-01 19:40:42.506342517 +0000 UTC m=+330.132781600" Jul 01 19:40:59.671236 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.671196 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9"] Jul 01 19:40:59.676323 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.676302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.684078 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.684054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 19:40:59.684213 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.684108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nh5xm\"" Jul 01 19:40:59.684213 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.684166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 19:40:59.684321 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.684218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 19:40:59.700588 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.700551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9"] Jul 01 19:40:59.726824 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.726794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.726986 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.726831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ba83e4-23cf-43c1-9c34-dcea467bf719-manager-config\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.726986 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.726956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.727058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.726989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x88k\" (UniqueName: \"kubernetes.io/projected/a2ba83e4-23cf-43c1-9c34-dcea467bf719-kube-api-access-7x88k\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.827476 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.827437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.827476 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.827473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x88k\" (UniqueName: \"kubernetes.io/projected/a2ba83e4-23cf-43c1-9c34-dcea467bf719-kube-api-access-7x88k\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.827677 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.827524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.827677 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.827548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ba83e4-23cf-43c1-9c34-dcea467bf719-manager-config\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.828248 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.828225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ba83e4-23cf-43c1-9c34-dcea467bf719-manager-config\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.830030 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.830007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.830192 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.830169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ba83e4-23cf-43c1-9c34-dcea467bf719-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.840550 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.840523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x88k\" (UniqueName: \"kubernetes.io/projected/a2ba83e4-23cf-43c1-9c34-dcea467bf719-kube-api-access-7x88k\") pod \"lws-controller-manager-5b64dfc857-d55s9\" (UID: \"a2ba83e4-23cf-43c1-9c34-dcea467bf719\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.981665 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.981592 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j"] Jul 01 19:40:59.985162 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.985139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:40:59.986224 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.986201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:40:59.989300 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.989277 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:40:59.989404 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.989386 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:40:59.990087 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.990065 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:40:59.990189 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.990129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pmcvj\"" Jul 01 19:40:59.990951 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:40:59.990930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:41:00.029927 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.029889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.030086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.029991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kd5v\" (UniqueName: \"kubernetes.io/projected/090f97fb-71ca-41e0-aaad-f568aa4df25c-kube-api-access-6kd5v\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.030086 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.030040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.030199 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.030140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.030199 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.030174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.086788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.086749 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j"] Jul 01 19:41:00.131610 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.131572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.131876 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.131653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kd5v\" (UniqueName: \"kubernetes.io/projected/090f97fb-71ca-41e0-aaad-f568aa4df25c-kube-api-access-6kd5v\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.131876 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.131702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.131876 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.131758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.132078 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.132003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.132586 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.132535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.134448 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.134426 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9"] Jul 01 19:41:00.134560 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.134482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f97fb-71ca-41e0-aaad-f568aa4df25c-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.134615 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.134566 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.134615 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.134602 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/090f97fb-71ca-41e0-aaad-f568aa4df25c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.137502 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:41:00.137481 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ba83e4_23cf_43c1_9c34_dcea467bf719.slice/crio-a2b44f57fab686b168215935e8e9bb68330c9c975e204515b34c0435a9433634 WatchSource:0}: Error finding container a2b44f57fab686b168215935e8e9bb68330c9c975e204515b34c0435a9433634: Status 404 returned error can't find the container with id a2b44f57fab686b168215935e8e9bb68330c9c975e204515b34c0435a9433634 Jul 01 19:41:00.145777 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.145757 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kd5v\" (UniqueName: \"kubernetes.io/projected/090f97fb-71ca-41e0-aaad-f568aa4df25c-kube-api-access-6kd5v\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-kst7j\" (UID: \"090f97fb-71ca-41e0-aaad-f568aa4df25c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.298016 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.297920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:00.442132 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.442110 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j"] Jul 01 19:41:00.444311 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:41:00.444285 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090f97fb_71ca_41e0_aaad_f568aa4df25c.slice/crio-cdf4c424bd5c164602672010a118b4651e3619eae47e1217383a8cd6dee92c95 WatchSource:0}: Error finding container cdf4c424bd5c164602672010a118b4651e3619eae47e1217383a8cd6dee92c95: Status 404 returned error can't find the container with id cdf4c424bd5c164602672010a118b4651e3619eae47e1217383a8cd6dee92c95 Jul 01 19:41:00.558810 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.558714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" event={"ID":"090f97fb-71ca-41e0-aaad-f568aa4df25c","Type":"ContainerStarted","Data":"cdf4c424bd5c164602672010a118b4651e3619eae47e1217383a8cd6dee92c95"} Jul 01 19:41:00.559834 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:00.559802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" event={"ID":"a2ba83e4-23cf-43c1-9c34-dcea467bf719","Type":"ContainerStarted","Data":"a2b44f57fab686b168215935e8e9bb68330c9c975e204515b34c0435a9433634"} Jul 01 19:41:04.587504 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:04.587460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" event={"ID":"090f97fb-71ca-41e0-aaad-f568aa4df25c","Type":"ContainerStarted","Data":"fd9a615b651970da28ad7ab980946b19bc465028b9cbf05b5f6cafc1d744815f"} Jul 01 19:41:04.588898 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:04.588847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" event={"ID":"a2ba83e4-23cf-43c1-9c34-dcea467bf719","Type":"ContainerStarted","Data":"b0b008adb460de57c35566cfaa959d7d1e990aa97fc924c0444ba71d93616fed"} Jul 01 19:41:04.589022 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:04.589004 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:41:04.668609 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:04.668553 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" podStartSLOduration=2.020498032 podStartE2EDuration="5.668534606s" totalImagesPullingTime="3.648036574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:04.668144858 +0000 UTC m=+352.294583956" watchObservedRunningTime="2026-07-01 19:41:04.668534606 +0000 UTC m=+352.294973753" Jul 01 19:41:05.595287 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:05.595246 2579 generic.go:356] "Generic (PLEG): container finished" podID="090f97fb-71ca-41e0-aaad-f568aa4df25c" containerID="fd9a615b651970da28ad7ab980946b19bc465028b9cbf05b5f6cafc1d744815f" exitCode=0 Jul 01 19:41:05.595787 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:05.595379 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" event={"ID":"090f97fb-71ca-41e0-aaad-f568aa4df25c","Type":"ContainerDied","Data":"fd9a615b651970da28ad7ab980946b19bc465028b9cbf05b5f6cafc1d744815f"} Jul 01 19:41:06.601778 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:06.601744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" event={"ID":"090f97fb-71ca-41e0-aaad-f568aa4df25c","Type":"ContainerStarted","Data":"e49d7ddad833402bbce1c1bc637f9276b3b69ce19a9abde35e3fb5b66971ded7"} Jul 01 19:41:06.602160 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:06.601817 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:06.625795 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:06.625744 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" podStartSLOduration=2.983299681 podStartE2EDuration="7.625728697s" totalImagesPullingTime="3.670871786s" totalInitContainerRuntime="971.55723ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:06.623851901 +0000 UTC m=+354.250290985" watchObservedRunningTime="2026-07-01 19:41:06.625728697 +0000 UTC m=+354.252167854" Jul 01 19:41:15.598348 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:15.598315 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-d55s9" Jul 01 19:41:17.609562 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:17.609530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-kst7j" Jul 01 19:41:26.413462 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.413429 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp"] Jul 01 19:41:26.422152 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.422133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.429437 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.429407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hghzh\"" Jul 01 19:41:26.429558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.429450 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:41:26.429558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.429468 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 19:41:26.429558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.429453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 19:41:26.429558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.429408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:41:26.438996 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.438979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp"] Jul 01 19:41:26.573135 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.573091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7a8729-95c3-49d1-bf57-eaca9889d799-tls-certs\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.573300 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.573173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8729-95c3-49d1-bf57-eaca9889d799-tmp\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.573300 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.573200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlv6g\" (UniqueName: \"kubernetes.io/projected/bf7a8729-95c3-49d1-bf57-eaca9889d799-kube-api-access-xlv6g\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.673795 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.673713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8729-95c3-49d1-bf57-eaca9889d799-tmp\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.673795 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.673754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlv6g\" (UniqueName: \"kubernetes.io/projected/bf7a8729-95c3-49d1-bf57-eaca9889d799-kube-api-access-xlv6g\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.674005 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.673800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7a8729-95c3-49d1-bf57-eaca9889d799-tls-certs\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.676062 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.676024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7a8729-95c3-49d1-bf57-eaca9889d799-tmp\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.676217 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.676093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7a8729-95c3-49d1-bf57-eaca9889d799-tls-certs\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.683677 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.683647 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlv6g\" (UniqueName: \"kubernetes.io/projected/bf7a8729-95c3-49d1-bf57-eaca9889d799-kube-api-access-xlv6g\") pod \"kube-auth-proxy-59bb8589b5-s62xp\" (UID: \"bf7a8729-95c3-49d1-bf57-eaca9889d799\") " pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.731485 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.731454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" Jul 01 19:41:26.873902 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:26.873878 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp"] Jul 01 19:41:26.876401 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:41:26.876374 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7a8729_95c3_49d1_bf57_eaca9889d799.slice/crio-a41b984e0d1adf5e2e8da609483ed4a7b69f209e955e5d9ffcce8316c50e84ec WatchSource:0}: Error finding container a41b984e0d1adf5e2e8da609483ed4a7b69f209e955e5d9ffcce8316c50e84ec: Status 404 returned error can't find the container with id a41b984e0d1adf5e2e8da609483ed4a7b69f209e955e5d9ffcce8316c50e84ec Jul 01 19:41:27.705044 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:27.705010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" event={"ID":"bf7a8729-95c3-49d1-bf57-eaca9889d799","Type":"ContainerStarted","Data":"a41b984e0d1adf5e2e8da609483ed4a7b69f209e955e5d9ffcce8316c50e84ec"} Jul 01 19:41:29.715848 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:29.715815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" event={"ID":"bf7a8729-95c3-49d1-bf57-eaca9889d799","Type":"ContainerStarted","Data":"fc92a02205a5a571a21c42bbc1002ea1c448f31b63743d870dc64650b748ebc6"} Jul 01 19:41:29.736164 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:41:29.736107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59bb8589b5-s62xp" podStartSLOduration=1.05232914 podStartE2EDuration="3.736091344s" totalImagesPullingTime="2.683762204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:29.735098313 +0000 UTC m=+377.361537397" watchObservedRunningTime="2026-07-01 19:41:29.736091344 +0000 UTC m=+377.362530428" Jul 01 19:43:05.030438 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.030407 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92"] Jul 01 19:43:05.034192 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.034170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:05.040452 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.040390 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 19:43:05.040578 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.040455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-x4np2\"" Jul 01 19:43:05.041776 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.041476 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:43:05.041776 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.041678 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:43:05.059034 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.059010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92"] Jul 01 19:43:05.145125 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.145088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xshjm\" (UniqueName: \"kubernetes.io/projected/aa365dec-ef51-4031-9751-1c9fdb53300a-kube-api-access-xshjm\") pod \"dns-operator-controller-manager-864dd78c4c-7vp92\" (UID: \"aa365dec-ef51-4031-9751-1c9fdb53300a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:05.246593 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.246549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xshjm\" (UniqueName: \"kubernetes.io/projected/aa365dec-ef51-4031-9751-1c9fdb53300a-kube-api-access-xshjm\") pod \"dns-operator-controller-manager-864dd78c4c-7vp92\" (UID: \"aa365dec-ef51-4031-9751-1c9fdb53300a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:05.258552 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.258517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xshjm\" (UniqueName: \"kubernetes.io/projected/aa365dec-ef51-4031-9751-1c9fdb53300a-kube-api-access-xshjm\") pod \"dns-operator-controller-manager-864dd78c4c-7vp92\" (UID: \"aa365dec-ef51-4031-9751-1c9fdb53300a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:05.346160 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.346129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:05.489578 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:05.489545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92"] Jul 01 19:43:05.494340 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:43:05.494304 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa365dec_ef51_4031_9751_1c9fdb53300a.slice/crio-8b90893f3867538c94fa5f3830b363bffc8bd87686630b2262c73bd8bba3583d WatchSource:0}: Error finding container 8b90893f3867538c94fa5f3830b363bffc8bd87686630b2262c73bd8bba3583d: Status 404 returned error can't find the container with id 8b90893f3867538c94fa5f3830b363bffc8bd87686630b2262c73bd8bba3583d Jul 01 19:43:06.154188 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:06.154151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" event={"ID":"aa365dec-ef51-4031-9751-1c9fdb53300a","Type":"ContainerStarted","Data":"8b90893f3867538c94fa5f3830b363bffc8bd87686630b2262c73bd8bba3583d"} Jul 01 19:43:08.168057 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:08.168017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" event={"ID":"aa365dec-ef51-4031-9751-1c9fdb53300a","Type":"ContainerStarted","Data":"9609d37f69252c4aaef066efbbd7368e31fbe6eab5cb47ed9bfffd7c0c6351ab"} Jul 01 19:43:08.168506 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:08.168152 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:08.194394 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:08.194333 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" podStartSLOduration=1.97921115 podStartE2EDuration="4.194318083s" totalImagesPullingTime="2.215106933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:43:08.193014407 +0000 UTC m=+475.819453492" watchObservedRunningTime="2026-07-01 19:43:08.194318083 +0000 UTC m=+475.820757167" Jul 01 19:43:12.911288 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.911257 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm"] Jul 01 19:43:12.914774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.914752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:12.917966 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.917947 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-56whz\"" Jul 01 19:43:12.918199 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.918181 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 19:43:12.918413 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.918398 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 19:43:12.934358 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:12.934333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm"] Jul 01 19:43:13.018028 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.017994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wcqg\" (UniqueName: \"kubernetes.io/projected/80cea6e3-1198-48ad-8f76-6eb25ef27539-kube-api-access-7wcqg\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.018245 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.018060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80cea6e3-1198-48ad-8f76-6eb25ef27539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.018245 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.018214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80cea6e3-1198-48ad-8f76-6eb25ef27539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.118886 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.118841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcqg\" (UniqueName: \"kubernetes.io/projected/80cea6e3-1198-48ad-8f76-6eb25ef27539-kube-api-access-7wcqg\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.119064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.118904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80cea6e3-1198-48ad-8f76-6eb25ef27539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.119064 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.118975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80cea6e3-1198-48ad-8f76-6eb25ef27539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.119574 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.119551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80cea6e3-1198-48ad-8f76-6eb25ef27539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.121143 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.121121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80cea6e3-1198-48ad-8f76-6eb25ef27539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.132946 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.132925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcqg\" (UniqueName: \"kubernetes.io/projected/80cea6e3-1198-48ad-8f76-6eb25ef27539-kube-api-access-7wcqg\") pod \"kuadrant-console-plugin-66b5774985-jbbmm\" (UID: \"80cea6e3-1198-48ad-8f76-6eb25ef27539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.223796 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.223722 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" Jul 01 19:43:13.382856 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:13.382826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm"] Jul 01 19:43:13.386689 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:43:13.386654 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80cea6e3_1198_48ad_8f76_6eb25ef27539.slice/crio-5f185ef5a5160ef872761b75f71ea6a2f6dcbe4dff0342f924186ea1ec98e689 WatchSource:0}: Error finding container 5f185ef5a5160ef872761b75f71ea6a2f6dcbe4dff0342f924186ea1ec98e689: Status 404 returned error can't find the container with id 5f185ef5a5160ef872761b75f71ea6a2f6dcbe4dff0342f924186ea1ec98e689 Jul 01 19:43:14.197454 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:14.197415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" event={"ID":"80cea6e3-1198-48ad-8f76-6eb25ef27539","Type":"ContainerStarted","Data":"5f185ef5a5160ef872761b75f71ea6a2f6dcbe4dff0342f924186ea1ec98e689"} Jul 01 19:43:19.176167 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:19.176120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7vp92" Jul 01 19:43:22.986883 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:22.986838 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4"] Jul 01 19:43:23.007632 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.007590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4"] Jul 01 19:43:23.007798 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.007698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.011226 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.011189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gw9x9\"" Jul 01 19:43:23.109943 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.109906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wlb\" (UniqueName: \"kubernetes.io/projected/c60b37da-db19-4e8c-abac-54f5657c4189-kube-api-access-99wlb\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.110205 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.110180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60b37da-db19-4e8c-abac-54f5657c4189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.211243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.211204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99wlb\" (UniqueName: \"kubernetes.io/projected/c60b37da-db19-4e8c-abac-54f5657c4189-kube-api-access-99wlb\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.211439 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.211265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60b37da-db19-4e8c-abac-54f5657c4189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.211691 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.211671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60b37da-db19-4e8c-abac-54f5657c4189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.226358 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.226325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wlb\" (UniqueName: \"kubernetes.io/projected/c60b37da-db19-4e8c-abac-54f5657c4189-kube-api-access-99wlb\") pod \"kuadrant-operator-controller-manager-86878c769f-sz9x4\" (UID: \"c60b37da-db19-4e8c-abac-54f5657c4189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:23.320478 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:23.320449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:35.724580 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:35.721918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4"] Jul 01 19:43:35.805500 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:43:35.805469 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60b37da_db19_4e8c_abac_54f5657c4189.slice/crio-deed8180e4936db86ec77e389286a6c3c269ab7f696bb7953ad0ab4d4a0bd278 WatchSource:0}: Error finding container deed8180e4936db86ec77e389286a6c3c269ab7f696bb7953ad0ab4d4a0bd278: Status 404 returned error can't find the container with id deed8180e4936db86ec77e389286a6c3c269ab7f696bb7953ad0ab4d4a0bd278 Jul 01 19:43:36.322720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:36.322684 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" event={"ID":"80cea6e3-1198-48ad-8f76-6eb25ef27539","Type":"ContainerStarted","Data":"4843520ec623051d8051a5d25ba77a34bf203ad2ed633fdc39c7f400d14176a2"} Jul 01 19:43:36.324004 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:36.323981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" event={"ID":"c60b37da-db19-4e8c-abac-54f5657c4189","Type":"ContainerStarted","Data":"deed8180e4936db86ec77e389286a6c3c269ab7f696bb7953ad0ab4d4a0bd278"} Jul 01 19:43:36.342685 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:36.342640 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbbmm" podStartSLOduration=1.8785574779999998 podStartE2EDuration="24.342626728s" totalImagesPullingTime="22.46406925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:43:36.341628735 +0000 UTC m=+503.968067821" watchObservedRunningTime="2026-07-01 19:43:36.342626728 +0000 UTC m=+503.969065811" Jul 01 19:43:44.366415 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:44.366374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" event={"ID":"c60b37da-db19-4e8c-abac-54f5657c4189","Type":"ContainerStarted","Data":"3f45086971ad8d668e4aea07f91842851e1d64858f08aeac3d78f922dbef0ac1"} Jul 01 19:43:44.366964 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:44.366507 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:43:44.394690 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:44.394627 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" podStartSLOduration=14.912454816 podStartE2EDuration="22.394609176s" totalImagesPullingTime="7.48215436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:43:44.393514446 +0000 UTC m=+512.019953529" watchObservedRunningTime="2026-07-01 19:43:44.394609176 +0000 UTC m=+512.021048259" Jul 01 19:43:55.374404 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:43:55.374365 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sz9x4" Jul 01 19:45:12.900111 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:12.900079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:45:12.907987 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:12.907964 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:45:15.393035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.392999 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:45:15.396325 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.396304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:15.400783 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.400760 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-drzsr\"" Jul 01 19:45:15.400962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.400790 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 19:45:15.400962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.400828 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:45:15.400962 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.400764 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:45:15.412452 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.412424 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:45:15.449445 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.449416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgpz\" (UniqueName: \"kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz\") pod \"maas-keycloak-0\" (UID: \"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:15.550430 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.550395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgpz\" (UniqueName: \"kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz\") pod \"maas-keycloak-0\" (UID: \"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:15.565367 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.565330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgpz\" (UniqueName: \"kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz\") pod \"maas-keycloak-0\" (UID: \"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:15.706202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.706110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:15.849222 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:15.849199 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:45:15.851051 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:45:15.851024 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3966ddd1_d6f8_4003_9196_b60f0ad4d7a5.slice/crio-b5e5c40302a7039bceaf10fee4a22812037cddc13a2ef0200db6e0bccc88c2ca WatchSource:0}: Error finding container b5e5c40302a7039bceaf10fee4a22812037cddc13a2ef0200db6e0bccc88c2ca: Status 404 returned error can't find the container with id b5e5c40302a7039bceaf10fee4a22812037cddc13a2ef0200db6e0bccc88c2ca Jul 01 19:45:16.803116 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:16.803071 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5","Type":"ContainerStarted","Data":"b5e5c40302a7039bceaf10fee4a22812037cddc13a2ef0200db6e0bccc88c2ca"} Jul 01 19:45:21.835442 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:21.835350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5","Type":"ContainerStarted","Data":"b6975690196faa825c0a0357d1c12051cd588fe6882a35e9add6140146992d28"} Jul 01 19:45:21.862723 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:21.862660 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.147504598 podStartE2EDuration="6.862638568s" totalImagesPullingTime="5.71513397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:45:21.861767301 +0000 UTC m=+609.488206386" watchObservedRunningTime="2026-07-01 19:45:21.862638568 +0000 UTC m=+609.489077653" Jul 01 19:45:22.706316 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:22.706257 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:22.708299 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:22.708245 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:23.706549 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:23.706498 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:24.707081 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:24.707033 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:25.706583 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:25.706539 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:25.706893 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:25.706841 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:26.706913 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:26.706829 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:27.707359 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:27.707307 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:28.706976 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:28.706922 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:29.706997 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:29.706947 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:30.707108 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:30.707060 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:31.707027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:31.706974 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:32.707297 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:32.707248 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:33.707128 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:33.707016 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:34.707327 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:34.707261 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 19:45:35.833955 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:35.833913 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:35.853835 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:35.853761 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:45:45.839767 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:45.839736 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:45:53.440939 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.440902 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:45:53.448599 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.448579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.452032 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.452013 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-95jzn\"" Jul 01 19:45:53.452328 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.452305 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 19:45:53.452492 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.452475 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 19:45:53.466776 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.466746 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:45:53.537301 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.537267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.537471 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.537308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkrq\" (UniqueName: \"kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.638082 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.638043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.638082 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.638088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkrq\" (UniqueName: \"kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.640592 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.640568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.656385 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.656351 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkrq\" (UniqueName: \"kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq\") pod \"maas-controller-6c4db889fc-xs6cr\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.749469 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.749379 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65c67c674f-nz2ht"] Jul 01 19:45:53.752036 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.752013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.758485 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.758461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:53.773147 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.773114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c67c674f-nz2ht"] Jul 01 19:45:53.840619 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.840589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239fb88e-b6fa-483e-a549-f1778c28f96f-webhook-cert\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.840778 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.840658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76f4v\" (UniqueName: \"kubernetes.io/projected/239fb88e-b6fa-483e-a549-f1778c28f96f-kube-api-access-76f4v\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.906366 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.906338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:45:53.908542 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:45:53.908518 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffff64ae_fff0_4399_bb42_0024d62d3635.slice/crio-63c42ec080ddc9adda373f0c093c775a76c657af6093a319dcae07aba35bd67b WatchSource:0}: Error finding container 63c42ec080ddc9adda373f0c093c775a76c657af6093a319dcae07aba35bd67b: Status 404 returned error can't find the container with id 63c42ec080ddc9adda373f0c093c775a76c657af6093a319dcae07aba35bd67b Jul 01 19:45:53.909800 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.909782 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:45:53.941538 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.941507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76f4v\" (UniqueName: \"kubernetes.io/projected/239fb88e-b6fa-483e-a549-f1778c28f96f-kube-api-access-76f4v\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.941648 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.941587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239fb88e-b6fa-483e-a549-f1778c28f96f-webhook-cert\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.943814 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.943792 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239fb88e-b6fa-483e-a549-f1778c28f96f-webhook-cert\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:53.951331 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:53.951306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76f4v\" (UniqueName: \"kubernetes.io/projected/239fb88e-b6fa-483e-a549-f1778c28f96f-kube-api-access-76f4v\") pod \"maas-controller-65c67c674f-nz2ht\" (UID: \"239fb88e-b6fa-483e-a549-f1778c28f96f\") " pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:54.025648 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:54.025567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" event={"ID":"ffff64ae-fff0-4399-bb42-0024d62d3635","Type":"ContainerStarted","Data":"63c42ec080ddc9adda373f0c093c775a76c657af6093a319dcae07aba35bd67b"} Jul 01 19:45:54.062990 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:54.062953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:54.198755 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:54.198727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c67c674f-nz2ht"] Jul 01 19:45:54.201276 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:45:54.201246 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239fb88e_b6fa_483e_a549_f1778c28f96f.slice/crio-a394294ffba17d9f6c961ead8ff9cbcdbc1df0bb1e26af9388556f68381688f3 WatchSource:0}: Error finding container a394294ffba17d9f6c961ead8ff9cbcdbc1df0bb1e26af9388556f68381688f3: Status 404 returned error can't find the container with id a394294ffba17d9f6c961ead8ff9cbcdbc1df0bb1e26af9388556f68381688f3 Jul 01 19:45:55.039377 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:55.039343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c67c674f-nz2ht" event={"ID":"239fb88e-b6fa-483e-a549-f1778c28f96f","Type":"ContainerStarted","Data":"a394294ffba17d9f6c961ead8ff9cbcdbc1df0bb1e26af9388556f68381688f3"} Jul 01 19:45:57.051381 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.051269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" event={"ID":"ffff64ae-fff0-4399-bb42-0024d62d3635","Type":"ContainerStarted","Data":"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f"} Jul 01 19:45:57.051381 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.051343 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:45:57.052675 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.052652 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c67c674f-nz2ht" event={"ID":"239fb88e-b6fa-483e-a549-f1778c28f96f","Type":"ContainerStarted","Data":"5d3a38fdcba23b3ef68e54a16e009c5fb3066ea0c0fb8a5af00afa577996fd84"} Jul 01 19:45:57.052793 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.052777 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:45:57.087886 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.087823 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" podStartSLOduration=1.3887684 podStartE2EDuration="4.087807064s" totalImagesPullingTime="2.699038664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:45:57.087202984 +0000 UTC m=+644.713642069" watchObservedRunningTime="2026-07-01 19:45:57.087807064 +0000 UTC m=+644.714246148" Jul 01 19:45:57.115350 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:45:57.115288 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65c67c674f-nz2ht" podStartSLOduration=1.698916469 podStartE2EDuration="4.11526931s" totalImagesPullingTime="2.416352841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:45:57.113081536 +0000 UTC m=+644.739520625" watchObservedRunningTime="2026-07-01 19:45:57.11526931 +0000 UTC m=+644.741708394" Jul 01 19:46:08.063350 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.063315 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:46:08.063748 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.063402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65c67c674f-nz2ht" Jul 01 19:46:08.122520 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.122489 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:46:08.122696 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.122669 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" podUID="ffff64ae-fff0-4399-bb42-0024d62d3635" containerName="manager" containerID="cri-o://7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f" gracePeriod=30 Jul 01 19:46:08.375650 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.375619 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:46:08.475534 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.475498 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bkrq\" (UniqueName: \"kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq\") pod \"ffff64ae-fff0-4399-bb42-0024d62d3635\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " Jul 01 19:46:08.475712 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.475592 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert\") pod \"ffff64ae-fff0-4399-bb42-0024d62d3635\" (UID: \"ffff64ae-fff0-4399-bb42-0024d62d3635\") " Jul 01 19:46:08.477835 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.477807 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ffff64ae-fff0-4399-bb42-0024d62d3635" (UID: "ffff64ae-fff0-4399-bb42-0024d62d3635"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:46:08.477939 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.477831 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq" (OuterVolumeSpecName: "kube-api-access-9bkrq") pod "ffff64ae-fff0-4399-bb42-0024d62d3635" (UID: "ffff64ae-fff0-4399-bb42-0024d62d3635"). InnerVolumeSpecName "kube-api-access-9bkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:46:08.576407 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.576356 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffff64ae-fff0-4399-bb42-0024d62d3635-webhook-cert\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:46:08.576407 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:08.576402 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bkrq\" (UniqueName: \"kubernetes.io/projected/ffff64ae-fff0-4399-bb42-0024d62d3635-kube-api-access-9bkrq\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:46:09.116393 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.116356 2579 generic.go:356] "Generic (PLEG): container finished" podID="ffff64ae-fff0-4399-bb42-0024d62d3635" containerID="7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f" exitCode=0 Jul 01 19:46:09.116797 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.116406 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" Jul 01 19:46:09.116797 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.116440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" event={"ID":"ffff64ae-fff0-4399-bb42-0024d62d3635","Type":"ContainerDied","Data":"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f"} Jul 01 19:46:09.116797 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.116498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-xs6cr" event={"ID":"ffff64ae-fff0-4399-bb42-0024d62d3635","Type":"ContainerDied","Data":"63c42ec080ddc9adda373f0c093c775a76c657af6093a319dcae07aba35bd67b"} Jul 01 19:46:09.116797 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.116521 2579 scope.go:117] "RemoveContainer" containerID="7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f" Jul 01 19:46:09.125081 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.124894 2579 scope.go:117] "RemoveContainer" containerID="7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f" Jul 01 19:46:09.125170 ip-10-0-138-21 kubenswrapper[2579]: E0701 19:46:09.125153 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f\": container with ID starting with 7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f not found: ID does not exist" containerID="7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f" Jul 01 19:46:09.125216 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.125179 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f"} err="failed to get container status \"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f\": rpc error: code = NotFound desc = could not find container \"7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f\": container with ID starting with 7857a5dc2bd69b79e1a3f6c7547167bbbb95f2e79cb5a9e036975e3e986cf64f not found: ID does not exist" Jul 01 19:46:09.138733 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.138708 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:46:09.144833 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:09.144813 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-xs6cr"] Jul 01 19:46:10.926525 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:10.926491 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffff64ae-fff0-4399-bb42-0024d62d3635" path="/var/lib/kubelet/pods/ffff64ae-fff0-4399-bb42-0024d62d3635/volumes" Jul 01 19:46:27.613898 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.613851 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-86f58868c9-npnhw"] Jul 01 19:46:27.614363 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.614233 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffff64ae-fff0-4399-bb42-0024d62d3635" containerName="manager" Jul 01 19:46:27.614363 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.614244 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffff64ae-fff0-4399-bb42-0024d62d3635" containerName="manager" Jul 01 19:46:27.614363 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.614336 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffff64ae-fff0-4399-bb42-0024d62d3635" containerName="manager" Jul 01 19:46:27.618785 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.618766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.623828 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.623806 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 19:46:27.623935 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.623838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zgqpk\"" Jul 01 19:46:27.631817 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.631796 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86f58868c9-npnhw"] Jul 01 19:46:27.642393 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.642300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zrlj\" (UniqueName: \"kubernetes.io/projected/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-kube-api-access-5zrlj\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.642548 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.642464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-maas-api-tls\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.642605 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.642589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-openshift-service-ca\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.743243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.743205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zrlj\" (UniqueName: \"kubernetes.io/projected/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-kube-api-access-5zrlj\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.743443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.743296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-maas-api-tls\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.743443 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.743377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-openshift-service-ca\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.744071 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.744040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-openshift-service-ca\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.745720 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.745697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-maas-api-tls\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.754161 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.754136 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zrlj\" (UniqueName: \"kubernetes.io/projected/d13e7c78-4ed4-4c5a-97ed-6ad5136c1043-kube-api-access-5zrlj\") pod \"maas-api-86f58868c9-npnhw\" (UID: \"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043\") " pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:27.928419 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:27.928333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:28.081479 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.081443 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86f58868c9-npnhw"] Jul 01 19:46:28.085368 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:46:28.085336 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13e7c78_4ed4_4c5a_97ed_6ad5136c1043.slice/crio-3f4f91d844304e9136df67a68239904f4fbb9f82de66bcf052b02ab48c303baf WatchSource:0}: Error finding container 3f4f91d844304e9136df67a68239904f4fbb9f82de66bcf052b02ab48c303baf: Status 404 returned error can't find the container with id 3f4f91d844304e9136df67a68239904f4fbb9f82de66bcf052b02ab48c303baf Jul 01 19:46:28.207915 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.207803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86f58868c9-npnhw" event={"ID":"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043","Type":"ContainerStarted","Data":"3f4f91d844304e9136df67a68239904f4fbb9f82de66bcf052b02ab48c303baf"} Jul 01 19:46:28.268134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.268082 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf"] Jul 01 19:46:28.272635 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.272612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.278306 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.278281 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 19:46:28.278306 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.278291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4cc9d\"" Jul 01 19:46:28.290957 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.290930 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf"] Jul 01 19:46:28.348151 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.348118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bd7a798-3523-44d4-b031-bb40f335a19d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.348330 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.348227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jp4w\" (UniqueName: \"kubernetes.io/projected/1bd7a798-3523-44d4-b031-bb40f335a19d-kube-api-access-7jp4w\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.449059 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.449013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bd7a798-3523-44d4-b031-bb40f335a19d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.449215 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.449086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jp4w\" (UniqueName: \"kubernetes.io/projected/1bd7a798-3523-44d4-b031-bb40f335a19d-kube-api-access-7jp4w\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.449779 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.449760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bd7a798-3523-44d4-b031-bb40f335a19d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.461275 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.461207 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jp4w\" (UniqueName: \"kubernetes.io/projected/1bd7a798-3523-44d4-b031-bb40f335a19d-kube-api-access-7jp4w\") pod \"payload-pre-processing-59f49fd4f6-bswhf\" (UID: \"1bd7a798-3523-44d4-b031-bb40f335a19d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.584364 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.584327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:28.732375 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:28.732347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf"] Jul 01 19:46:28.735719 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:46:28.735690 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd7a798_3523_44d4_b031_bb40f335a19d.slice/crio-d78ff865e95147b723dd13330ceb1f23384e5bad3c5263b511896f95b1f0e7c2 WatchSource:0}: Error finding container d78ff865e95147b723dd13330ceb1f23384e5bad3c5263b511896f95b1f0e7c2: Status 404 returned error can't find the container with id d78ff865e95147b723dd13330ceb1f23384e5bad3c5263b511896f95b1f0e7c2 Jul 01 19:46:29.216459 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:29.216420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" event={"ID":"1bd7a798-3523-44d4-b031-bb40f335a19d","Type":"ContainerStarted","Data":"d78ff865e95147b723dd13330ceb1f23384e5bad3c5263b511896f95b1f0e7c2"} Jul 01 19:46:30.225700 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:30.225654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86f58868c9-npnhw" event={"ID":"d13e7c78-4ed4-4c5a-97ed-6ad5136c1043","Type":"ContainerStarted","Data":"fd613dfdb25ed1bd83047b671758c57fb57fbba584db96e4df0fa2c1cb8e24f3"} Jul 01 19:46:30.226185 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:30.225803 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:30.248628 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:30.248572 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-86f58868c9-npnhw" podStartSLOduration=1.872925758 podStartE2EDuration="3.248552013s" totalImagesPullingTime="1.375626255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:46:30.247190451 +0000 UTC m=+677.873629547" watchObservedRunningTime="2026-07-01 19:46:30.248552013 +0000 UTC m=+677.874991098" Jul 01 19:46:31.231781 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:31.231745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" event={"ID":"1bd7a798-3523-44d4-b031-bb40f335a19d","Type":"ContainerStarted","Data":"c94ce1c5f28889d21a3924e8e8652a5c9e6ddb3acfc30a4bc624193c75696960"} Jul 01 19:46:31.232161 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:31.231911 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:31.256857 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:31.256809 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" podStartSLOduration=0.851232435 podStartE2EDuration="3.256792246s" totalImagesPullingTime="2.405559811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:46:31.255928918 +0000 UTC m=+678.882368003" watchObservedRunningTime="2026-07-01 19:46:31.256792246 +0000 UTC m=+678.883231329" Jul 01 19:46:36.237624 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:36.237590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-86f58868c9-npnhw" Jul 01 19:46:37.805436 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:37.805393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:37.805919 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:37.805624 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" containerID="cri-o://b6975690196faa825c0a0357d1c12051cd588fe6882a35e9add6140146992d28" gracePeriod=30 Jul 01 19:46:39.271657 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.271622 2579 generic.go:356] "Generic (PLEG): container finished" podID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerID="b6975690196faa825c0a0357d1c12051cd588fe6882a35e9add6140146992d28" exitCode=143 Jul 01 19:46:39.272035 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.271697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5","Type":"ContainerDied","Data":"b6975690196faa825c0a0357d1c12051cd588fe6882a35e9add6140146992d28"} Jul 01 19:46:39.356845 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.356818 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:39.457620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.457583 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjgpz\" (UniqueName: \"kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz\") pod \"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5\" (UID: \"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5\") " Jul 01 19:46:39.459716 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.459686 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz" (OuterVolumeSpecName: "kube-api-access-gjgpz") pod "3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" (UID: "3966ddd1-d6f8-4003-9196-b60f0ad4d7a5"). InnerVolumeSpecName "kube-api-access-gjgpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:46:39.558562 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:39.558504 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjgpz\" (UniqueName: \"kubernetes.io/projected/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5-kube-api-access-gjgpz\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 01 19:46:40.283624 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.283595 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.283624 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.283612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3966ddd1-d6f8-4003-9196-b60f0ad4d7a5","Type":"ContainerDied","Data":"b5e5c40302a7039bceaf10fee4a22812037cddc13a2ef0200db6e0bccc88c2ca"} Jul 01 19:46:40.284155 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.283696 2579 scope.go:117] "RemoveContainer" containerID="b6975690196faa825c0a0357d1c12051cd588fe6882a35e9add6140146992d28" Jul 01 19:46:40.307475 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.307437 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:40.313580 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.313554 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:40.342420 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.342395 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:40.342779 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.342767 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" Jul 01 19:46:40.342821 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.342781 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" Jul 01 19:46:40.342855 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.342849 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" containerName="keycloak" Jul 01 19:46:40.346949 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.346927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.349750 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.349727 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 19:46:40.349897 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.349762 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-drzsr\"" Jul 01 19:46:40.349897 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.349729 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:46:40.350141 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.350125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 19:46:40.350180 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.350139 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:46:40.357732 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.357709 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:40.467515 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.467475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-test-realms\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.467712 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.467582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzrv\" (UniqueName: \"kubernetes.io/projected/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-kube-api-access-4mzrv\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.568398 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.568363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzrv\" (UniqueName: \"kubernetes.io/projected/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-kube-api-access-4mzrv\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.568558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.568485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-test-realms\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.569238 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.569217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-test-realms\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.582728 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.582695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzrv\" (UniqueName: \"kubernetes.io/projected/6eb0af40-c8aa-4c6c-b1c5-ab359188bce6-kube-api-access-4mzrv\") pod \"maas-keycloak-0\" (UID: \"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.657253 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.657210 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:40.794995 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.794967 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:46:40.797154 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:46:40.797125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb0af40_c8aa_4c6c_b1c5_ab359188bce6.slice/crio-be794ef5f435e8e031b1c8bcffdde859136d6495a61e583ef7ffd9f438fb87a8 WatchSource:0}: Error finding container be794ef5f435e8e031b1c8bcffdde859136d6495a61e583ef7ffd9f438fb87a8: Status 404 returned error can't find the container with id be794ef5f435e8e031b1c8bcffdde859136d6495a61e583ef7ffd9f438fb87a8 Jul 01 19:46:40.926899 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:40.926798 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3966ddd1-d6f8-4003-9196-b60f0ad4d7a5" path="/var/lib/kubelet/pods/3966ddd1-d6f8-4003-9196-b60f0ad4d7a5/volumes" Jul 01 19:46:41.293100 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:41.293001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6","Type":"ContainerStarted","Data":"fc9dc76d9234cecf5fc5b274199efb363f64ee3a5d96ce2cab16f896eebb45d7"} Jul 01 19:46:41.293100 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:41.293050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6eb0af40-c8aa-4c6c-b1c5-ab359188bce6","Type":"ContainerStarted","Data":"be794ef5f435e8e031b1c8bcffdde859136d6495a61e583ef7ffd9f438fb87a8"} Jul 01 19:46:41.317389 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:41.317335 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.034260683 podStartE2EDuration="1.317316872s" totalImagesPullingTime="283.056189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:46:41.316025148 +0000 UTC m=+688.942464241" watchObservedRunningTime="2026-07-01 19:46:41.317316872 +0000 UTC m=+688.943755955" Jul 01 19:46:41.658230 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:41.658184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:41.659800 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:41.659756 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:42.239483 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:42.239447 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-bswhf" Jul 01 19:46:42.657974 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:42.657918 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:43.658243 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:43.658177 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:44.658223 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:44.658164 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:45.658022 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:45.657966 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:46.658620 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:46.658568 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:47.658596 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:47.658549 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:48.658202 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:48.658143 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:49.657788 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:49.657733 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:50.657357 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:50.657308 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:50.657909 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:50.657673 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:51.658761 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:51.658700 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:52.658026 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:52.657973 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:53.657920 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:53.657852 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jul 01 19:46:54.767153 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:54.767111 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 19:46:54.785742 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:46:54.785698 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:47:04.771910 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:04.771773 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6eb0af40-c8aa-4c6c-b1c5-ab359188bce6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:47:14.773548 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:14.773508 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:47:34.294332 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.294302 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d"] Jul 01 19:47:34.299387 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.299361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.301952 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.301934 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 19:47:34.303128 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.303106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:47:34.303285 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.303143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:47:34.303285 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.303175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-672b9\"" Jul 01 19:47:34.312374 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.312352 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d"] Jul 01 19:47:34.313659 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.313638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.313752 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.313670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.313752 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.313687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b2681d-14f9-409b-a488-f901d73537f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.313752 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.313711 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vw4\" (UniqueName: \"kubernetes.io/projected/98b2681d-14f9-409b-a488-f901d73537f2-kube-api-access-75vw4\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.313856 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.313767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.414816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.414773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.414816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.414819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.415054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.414932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b2681d-14f9-409b-a488-f901d73537f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.415054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.414977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vw4\" (UniqueName: \"kubernetes.io/projected/98b2681d-14f9-409b-a488-f901d73537f2-kube-api-access-75vw4\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.415054 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.415029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.415195 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.415176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.415333 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.415315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.417163 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.417138 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b2681d-14f9-409b-a488-f901d73537f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.417335 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.417317 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b2681d-14f9-409b-a488-f901d73537f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.425366 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.425342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vw4\" (UniqueName: \"kubernetes.io/projected/98b2681d-14f9-409b-a488-f901d73537f2-kube-api-access-75vw4\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-v7w9d\" (UID: \"98b2681d-14f9-409b-a488-f901d73537f2\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.609596 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.609555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:34.765190 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:34.765163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d"] Jul 01 19:47:34.767094 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:47:34.767070 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b2681d_14f9_409b_a488_f901d73537f2.slice/crio-8b72cdaba2b04bf1316588e2e3419bbbf2097643d6ee09f46a8a88d32b4a36df WatchSource:0}: Error finding container 8b72cdaba2b04bf1316588e2e3419bbbf2097643d6ee09f46a8a88d32b4a36df: Status 404 returned error can't find the container with id 8b72cdaba2b04bf1316588e2e3419bbbf2097643d6ee09f46a8a88d32b4a36df Jul 01 19:47:35.609031 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:35.608992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" event={"ID":"98b2681d-14f9-409b-a488-f901d73537f2","Type":"ContainerStarted","Data":"8b72cdaba2b04bf1316588e2e3419bbbf2097643d6ee09f46a8a88d32b4a36df"} Jul 01 19:47:39.631567 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:39.631527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" event={"ID":"98b2681d-14f9-409b-a488-f901d73537f2","Type":"ContainerStarted","Data":"cb252c8721e9009a04c4a5825fccdda53480cdfce759cbfd8757b85b6b5ca4f5"} Jul 01 19:47:39.653462 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:39.653413 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" podStartSLOduration=1.364855454 podStartE2EDuration="5.653398535s" totalImagesPullingTime="4.288543081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:47:39.650766926 +0000 UTC m=+747.277206009" watchObservedRunningTime="2026-07-01 19:47:39.653398535 +0000 UTC m=+747.279837619" Jul 01 19:47:44.610027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:44.609988 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:44.610469 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:44.610068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:44.622509 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:44.622486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:47:44.667928 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:47:44.667889 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-v7w9d" Jul 01 19:48:02.113999 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.113959 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m"] Jul 01 19:48:02.117847 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.117830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.120660 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.120637 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 19:48:02.136925 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.136895 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m"] Jul 01 19:48:02.274551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.274509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.274551 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.274561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.274908 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.274592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzxrz\" (UniqueName: \"kubernetes.io/projected/1091d024-9e21-43a0-87f4-60c402ed9a05-kube-api-access-hzxrz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.274908 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.274660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.274908 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.274737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1091d024-9e21-43a0-87f4-60c402ed9a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.375807 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.375717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzxrz\" (UniqueName: \"kubernetes.io/projected/1091d024-9e21-43a0-87f4-60c402ed9a05-kube-api-access-hzxrz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.375807 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.375760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.376058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.375919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1091d024-9e21-43a0-87f4-60c402ed9a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.376058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.376032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.376169 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.376076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.376169 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.376111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.376362 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.376341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.378365 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.378333 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1091d024-9e21-43a0-87f4-60c402ed9a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.378640 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.378617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1091d024-9e21-43a0-87f4-60c402ed9a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.386325 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.386295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzxrz\" (UniqueName: \"kubernetes.io/projected/1091d024-9e21-43a0-87f4-60c402ed9a05-kube-api-access-hzxrz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m\" (UID: \"1091d024-9e21-43a0-87f4-60c402ed9a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.428690 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.428657 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:02.566934 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.566903 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m"] Jul 01 19:48:02.568963 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:48:02.568927 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1091d024_9e21_43a0_87f4_60c402ed9a05.slice/crio-683b7a1ca4bf72691aa3ef373198f3c5be35d3c4eb10969650082bcf56c1813d WatchSource:0}: Error finding container 683b7a1ca4bf72691aa3ef373198f3c5be35d3c4eb10969650082bcf56c1813d: Status 404 returned error can't find the container with id 683b7a1ca4bf72691aa3ef373198f3c5be35d3c4eb10969650082bcf56c1813d Jul 01 19:48:02.745449 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:02.745379 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" event={"ID":"1091d024-9e21-43a0-87f4-60c402ed9a05","Type":"ContainerStarted","Data":"683b7a1ca4bf72691aa3ef373198f3c5be35d3c4eb10969650082bcf56c1813d"} Jul 01 19:48:03.752353 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:03.752316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" event={"ID":"1091d024-9e21-43a0-87f4-60c402ed9a05","Type":"ContainerStarted","Data":"3d8942b37cc0a0e177e05fb251961b553e558f78c91b2e02713ccb572a829245"} Jul 01 19:48:03.774558 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:03.774498 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" podStartSLOduration=1.5826680560000002 podStartE2EDuration="1.774480075s" totalImagesPullingTime="191.812019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:03.771061293 +0000 UTC m=+771.397500380" watchObservedRunningTime="2026-07-01 19:48:03.774480075 +0000 UTC m=+771.400919209" Jul 01 19:48:12.428804 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:12.428756 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:12.429455 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:12.428841 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:12.441075 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:12.441049 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:48:12.807670 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:48:12.807580 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m" Jul 01 19:50:11.302406 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:11.302327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86f58868c9-npnhw_d13e7c78-4ed4-4c5a-97ed-6ad5136c1043/maas-api/0.log" Jul 01 19:50:11.420717 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:11.420688 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65c67c674f-nz2ht_239fb88e-b6fa-483e-a549-f1778c28f96f/manager/0.log" Jul 01 19:50:11.902013 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:11.901987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-kst7j_090f97fb-71ca-41e0-aaad-f568aa4df25c/copy-manifests/0.log" Jul 01 19:50:11.909548 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:11.909530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-kst7j_090f97fb-71ca-41e0-aaad-f568aa4df25c/manager/0.log" Jul 01 19:50:12.934771 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:12.934742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:50:12.940506 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:12.940480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-68kvf_56a952fa-6cbd-4b79-bf43-1d6a9ccfe52e/ovn-acl-logging/0.log" Jul 01 19:50:13.680512 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:13.680485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7vp92_aa365dec-ef51-4031-9751-1c9fdb53300a/manager/0.log" Jul 01 19:50:13.801958 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:13.801930 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jbbmm_80cea6e3-1198-48ad-8f76-6eb25ef27539/kuadrant-console-plugin/0.log" Jul 01 19:50:14.039236 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:14.039173 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sz9x4_c60b37da-db19-4e8c-abac-54f5657c4189/manager/0.log" Jul 01 19:50:15.001818 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:15.001789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bb8589b5-s62xp_bf7a8729-95c3-49d1-bf57-eaca9889d799/kube-auth-proxy/0.log" Jul 01 19:50:15.223774 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:15.223746 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-bswhf_1bd7a798-3523-44d4-b031-bb40f335a19d/payload-pre-processing/0.log" Jul 01 19:50:15.798818 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:15.798785 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-v7w9d_98b2681d-14f9-409b-a488-f901d73537f2/main/0.log" Jul 01 19:50:16.155349 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:16.155320 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649wzv7m_1091d024-9e21-43a0-87f4-60c402ed9a05/main/0.log" Jul 01 19:50:24.003140 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:24.003109 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mnjlh_576b371e-5d0d-4e6f-b162-e5966bd53b9c/global-pull-secret-syncer/0.log" Jul 01 19:50:24.235537 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:24.235506 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgdtt_8244bbf7-0229-4681-9611-71e7e63301cb/konnectivity-agent/0.log" Jul 01 19:50:24.446265 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:24.446239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-21.ec2.internal_a87c635a4fd37941e7463055cab2cf8a/haproxy/0.log" Jul 01 19:50:28.463145 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:28.463111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7vp92_aa365dec-ef51-4031-9751-1c9fdb53300a/manager/0.log" Jul 01 19:50:28.551946 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:28.551916 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jbbmm_80cea6e3-1198-48ad-8f76-6eb25ef27539/kuadrant-console-plugin/0.log" Jul 01 19:50:28.643298 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:28.643266 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sz9x4_c60b37da-db19-4e8c-abac-54f5657c4189/manager/0.log" Jul 01 19:50:30.195249 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.195222 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/alertmanager/0.log" Jul 01 19:50:30.222556 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.222526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/config-reloader/0.log" Jul 01 19:50:30.245027 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.245002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/kube-rbac-proxy-web/0.log" Jul 01 19:50:30.269657 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.269633 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/kube-rbac-proxy/0.log" Jul 01 19:50:30.295211 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.295182 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/kube-rbac-proxy-metric/0.log" Jul 01 19:50:30.319104 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.319075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/prom-label-proxy/0.log" Jul 01 19:50:30.348096 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.348074 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_747a95b2-9c3d-4f0f-83ae-adeef58e722e/init-config-reloader/0.log" Jul 01 19:50:30.427701 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.427672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-7zzfz_9c3c2559-6ddd-4a42-aee3-1ee0453546da/kube-state-metrics/0.log" Jul 01 19:50:30.447550 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.447530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-7zzfz_9c3c2559-6ddd-4a42-aee3-1ee0453546da/kube-rbac-proxy-main/0.log" Jul 01 19:50:30.472772 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.472744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-7zzfz_9c3c2559-6ddd-4a42-aee3-1ee0453546da/kube-rbac-proxy-self/0.log" Jul 01 19:50:30.501949 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.501920 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d4f8989b8-tgsj2_3a531825-b193-43d4-a09a-5031f1474f53/metrics-server/0.log" Jul 01 19:50:30.546290 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.546265 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-9k4p8_6069d65d-be58-4faa-b2ce-0f4370bf5340/monitoring-plugin/0.log" Jul 01 19:50:30.578813 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.578731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26j9v_4386e50b-7b89-42e3-9b41-9ca199262135/node-exporter/0.log" Jul 01 19:50:30.620023 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.620001 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26j9v_4386e50b-7b89-42e3-9b41-9ca199262135/kube-rbac-proxy/0.log" Jul 01 19:50:30.644917 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:30.644896 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26j9v_4386e50b-7b89-42e3-9b41-9ca199262135/init-textfile/0.log" Jul 01 19:50:31.025449 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.025421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbs9l_370c4859-30e0-4256-bb36-6fea7bc24fb5/kube-rbac-proxy-main/0.log" Jul 01 19:50:31.072894 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.072844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbs9l_370c4859-30e0-4256-bb36-6fea7bc24fb5/kube-rbac-proxy-self/0.log" Jul 01 19:50:31.099095 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.099060 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbs9l_370c4859-30e0-4256-bb36-6fea7bc24fb5/openshift-state-metrics/0.log" Jul 01 19:50:31.164563 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.164478 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/prometheus/0.log" Jul 01 19:50:31.197880 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.197848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/config-reloader/0.log" Jul 01 19:50:31.228038 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.228008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/thanos-sidecar/0.log" Jul 01 19:50:31.258590 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.258565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/kube-rbac-proxy-web/0.log" Jul 01 19:50:31.284734 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.284706 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/kube-rbac-proxy/0.log" Jul 01 19:50:31.313953 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.313927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/kube-rbac-proxy-thanos/0.log" Jul 01 19:50:31.338122 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.338100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9c502f-807b-4ced-a2e4-7b4b93613d95/init-config-reloader/0.log" Jul 01 19:50:31.372803 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.372770 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-87k7v_a8c037f3-2153-4920-8ed3-a4c2ca917c67/prometheus-operator/0.log" Jul 01 19:50:31.397786 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.397756 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-87k7v_a8c037f3-2153-4920-8ed3-a4c2ca917c67/kube-rbac-proxy/0.log" Jul 01 19:50:31.425497 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.425431 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-99cmr_ac7bbc51-ee83-44d0-bd57-c97516860b8f/prometheus-operator-admission-webhook/0.log" Jul 01 19:50:31.459098 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.459056 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854c75bffd-gj4t2_91cdcfcd-1055-48d3-959e-bcb16f4457f7/telemeter-client/0.log" Jul 01 19:50:31.483475 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.483427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854c75bffd-gj4t2_91cdcfcd-1055-48d3-959e-bcb16f4457f7/reload/0.log" Jul 01 19:50:31.509629 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.509602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854c75bffd-gj4t2_91cdcfcd-1055-48d3-959e-bcb16f4457f7/kube-rbac-proxy/0.log" Jul 01 19:50:31.557095 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.557068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/thanos-query/0.log" Jul 01 19:50:31.594409 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.594381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/kube-rbac-proxy-web/0.log" Jul 01 19:50:31.619704 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.619682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/kube-rbac-proxy/0.log" Jul 01 19:50:31.643642 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.643621 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/prom-label-proxy/0.log" Jul 01 19:50:31.670045 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.670013 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/kube-rbac-proxy-rules/0.log" Jul 01 19:50:31.695015 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:31.694931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff99fdcb8-8d2c4_545d983a-76ca-4236-8ddb-68a7137f98a7/kube-rbac-proxy-metrics/0.log" Jul 01 19:50:34.049229 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.049197 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w"] Jul 01 19:50:34.053058 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.053040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.059355 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.059325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jksd4\"/\"default-dockercfg-cc7rg\"" Jul 01 19:50:34.059525 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.059479 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jksd4\"/\"kube-root-ca.crt\"" Jul 01 19:50:34.060307 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.060080 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jksd4\"/\"openshift-service-ca.crt\"" Jul 01 19:50:34.084599 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.084563 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w"] Jul 01 19:50:34.091589 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.091556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-sys\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.091751 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.091594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-lib-modules\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.091751 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.091657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfwd\" (UniqueName: \"kubernetes.io/projected/7ee459c9-ecef-406d-bced-c712a8bd9a69-kube-api-access-ggfwd\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.091751 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.091746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-podres\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.091902 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.091769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-proc\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192378 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-sys\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192378 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-lib-modules\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfwd\" (UniqueName: \"kubernetes.io/projected/7ee459c9-ecef-406d-bced-c712a8bd9a69-kube-api-access-ggfwd\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-sys\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-podres\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-proc\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192562 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-podres\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192602 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-lib-modules\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.192827 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.192606 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ee459c9-ecef-406d-bced-c712a8bd9a69-proc\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.203133 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.203097 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfwd\" (UniqueName: \"kubernetes.io/projected/7ee459c9-ecef-406d-bced-c712a8bd9a69-kube-api-access-ggfwd\") pod \"perf-node-gather-daemonset-bmx9w\" (UID: \"7ee459c9-ecef-406d-bced-c712a8bd9a69\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.363745 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.363711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:34.503071 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.503043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w"] Jul 01 19:50:34.505885 ip-10-0-138-21 kubenswrapper[2579]: W0701 19:50:34.505845 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ee459c9_ecef_406d_bced_c712a8bd9a69.slice/crio-c921c0dd15eb09cb4f0c9dc61a23027b41137d9ffb4fc1bb9facf4fe6314f3c8 WatchSource:0}: Error finding container c921c0dd15eb09cb4f0c9dc61a23027b41137d9ffb4fc1bb9facf4fe6314f3c8: Status 404 returned error can't find the container with id c921c0dd15eb09cb4f0c9dc61a23027b41137d9ffb4fc1bb9facf4fe6314f3c8 Jul 01 19:50:34.515348 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:34.515313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" event={"ID":"7ee459c9-ecef-406d-bced-c712a8bd9a69","Type":"ContainerStarted","Data":"c921c0dd15eb09cb4f0c9dc61a23027b41137d9ffb4fc1bb9facf4fe6314f3c8"} Jul 01 19:50:35.521942 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:35.521898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" event={"ID":"7ee459c9-ecef-406d-bced-c712a8bd9a69","Type":"ContainerStarted","Data":"2dc3a331ca8c24573fbe7ef6b9d62f2d12923d8cd39b2d2374d52186a8f96c14"} Jul 01 19:50:35.522319 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:35.522063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:35.540369 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:35.540325 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" podStartSLOduration=1.540310171 podStartE2EDuration="1.540310171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:50:35.539065441 +0000 UTC m=+923.165504526" watchObservedRunningTime="2026-07-01 19:50:35.540310171 +0000 UTC m=+923.166749304" Jul 01 19:50:36.099016 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:36.098985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pzqv_fb2e73ab-4881-492c-ab73-b805844d1ec9/dns/0.log" Jul 01 19:50:36.119293 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:36.119272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pzqv_fb2e73ab-4881-492c-ab73-b805844d1ec9/kube-rbac-proxy/0.log" Jul 01 19:50:36.235173 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:36.235147 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2txg9_4d447735-9d53-4dc9-a240-968105c12d01/dns-node-resolver/0.log" Jul 01 19:50:36.977515 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:36.977489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8w54_fda9b5d9-62b1-4def-b8d0-41e6bf1d81cd/node-ca/0.log" Jul 01 19:50:38.214324 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:38.214297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bb8589b5-s62xp_bf7a8729-95c3-49d1-bf57-eaca9889d799/kube-auth-proxy/0.log" Jul 01 19:50:38.266445 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:38.266420 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-bswhf_1bd7a798-3523-44d4-b031-bb40f335a19d/payload-pre-processing/0.log" Jul 01 19:50:38.968675 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:38.968644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6p7fz_f94c50d5-f964-4a33-b494-7a2a11ffceb2/serve-healthcheck-canary/0.log" Jul 01 19:50:39.690139 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:39.690110 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhr52_f712ddd2-0b45-440d-aca2-e27c0cc88d1b/kube-rbac-proxy/0.log" Jul 01 19:50:39.717150 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:39.717121 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhr52_f712ddd2-0b45-440d-aca2-e27c0cc88d1b/exporter/0.log" Jul 01 19:50:39.741156 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:39.741133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhr52_f712ddd2-0b45-440d-aca2-e27c0cc88d1b/extractor/0.log" Jul 01 19:50:41.536134 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:41.536106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-bmx9w" Jul 01 19:50:42.276051 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:42.276019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86f58868c9-npnhw_d13e7c78-4ed4-4c5a-97ed-6ad5136c1043/maas-api/0.log" Jul 01 19:50:42.316006 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:42.315964 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65c67c674f-nz2ht_239fb88e-b6fa-483e-a549-f1778c28f96f/manager/0.log" Jul 01 19:50:42.517550 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:42.517519 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-kst7j_090f97fb-71ca-41e0-aaad-f568aa4df25c/manager/0.log" Jul 01 19:50:42.549031 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:42.548967 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-kst7j_090f97fb-71ca-41e0-aaad-f568aa4df25c/copy-manifests/0.log" Jul 01 19:50:43.820264 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:43.820231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bb8589b5-s62xp_bf7a8729-95c3-49d1-bf57-eaca9889d799/kube-auth-proxy/0.log" Jul 01 19:50:43.865315 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:43.865286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-bswhf_1bd7a798-3523-44d4-b031-bb40f335a19d/payload-pre-processing/0.log" Jul 01 19:50:44.464825 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:44.464792 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b64dfc857-d55s9_a2ba83e4-23cf-43c1-9c34-dcea467bf719/manager/0.log" Jul 01 19:50:44.533124 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:44.533047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cqfk9_bf3d6669-1947-419c-a236-ee9fa0fa88ba/openshift-lws-operator/0.log" Jul 01 19:50:45.094454 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:45.094425 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bb8589b5-s62xp_bf7a8729-95c3-49d1-bf57-eaca9889d799/kube-auth-proxy/0.log" Jul 01 19:50:45.133816 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:45.133795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-bswhf_1bd7a798-3523-44d4-b031-bb40f335a19d/payload-pre-processing/0.log" Jul 01 19:50:51.146598 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.146569 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/kube-multus-additional-cni-plugins/0.log" Jul 01 19:50:51.168672 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.168644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/egress-router-binary-copy/0.log" Jul 01 19:50:51.191957 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.191924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/cni-plugins/0.log" Jul 01 19:50:51.215199 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.215172 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/bond-cni-plugin/0.log" Jul 01 19:50:51.236434 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.236400 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/routeoverride-cni/0.log" Jul 01 19:50:51.258654 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.258573 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/whereabouts-cni-bincopy/0.log" Jul 01 19:50:51.278060 ip-10-0-138-21 kubenswrapper[2579]: I0701 19:50:51.278035 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ltx4_4081b4df-525a-43ae-9388-b39d564cadf7/whereabouts-cni/0.log"