Jul 07 14:28:25.133823 ip-10-0-142-89 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:28:25.133833 ip-10-0-142-89 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:28:25.133840 ip-10-0-142-89 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:28:25.134134 ip-10-0-142-89 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:28:35.187250 ip-10-0-142-89 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 14:28:35.187270 ip-10-0-142-89 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1d25848104be43d5bc0d3eb6dacd174e -- Jul 07 14:30:38.369124 ip-10-0-142-89 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:30:38.777688 ip-10-0-142-89 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.777688 ip-10-0-142-89 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:30:38.777688 ip-10-0-142-89 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.777688 ip-10-0-142-89 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:30:38.777688 ip-10-0-142-89 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.780169 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.780047 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:30:38.786499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786481 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.786499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786498 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786502 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786505 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786510 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786512 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786515 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786518 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786521 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786523 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786526 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786529 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786537 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786540 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786544 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786548 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786552 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786555 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786558 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786561 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.786573 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786564 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786566 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786569 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786572 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786575 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786577 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786580 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786583 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786586 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786588 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786591 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786594 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786596 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786599 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786601 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786604 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786606 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786608 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786611 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786614 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.787026 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786616 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786618 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786621 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786623 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786625 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786629 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786631 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786633 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786636 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786638 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786640 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786643 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786645 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786648 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786651 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786653 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786657 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786659 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786662 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786664 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786667 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.787499 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786670 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786672 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786675 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786677 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786680 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786682 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786685 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786687 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786690 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786694 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786697 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786700 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786703 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786706 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786708 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786711 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786713 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786716 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786718 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.788127 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786721 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786723 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786726 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786728 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786730 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786733 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786736 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786739 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786741 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786744 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786746 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786749 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786751 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786754 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786756 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786771 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786774 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786777 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.786779 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787462 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.788881 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787468 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787472 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787475 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787478 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787481 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787483 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787486 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787489 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787491 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787494 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787497 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787500 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787503 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787506 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787509 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787513 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787517 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787521 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.789500 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787526 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787530 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787533 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787536 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787539 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787541 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787544 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787546 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787549 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787552 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787555 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787557 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787560 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787562 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787565 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787567 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787570 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787572 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787574 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787577 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.790034 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787579 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787582 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787584 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787587 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787589 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787591 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787594 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787597 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787600 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787603 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787605 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787608 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787612 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787614 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787617 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787619 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787622 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787624 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787628 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787630 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.790605 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787633 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787635 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787638 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787640 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787643 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787645 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787647 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787650 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787653 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787655 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787657 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787660 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787662 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787665 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787667 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787670 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787672 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787674 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787677 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787680 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.791120 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787682 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787686 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787688 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787691 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787694 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787697 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787699 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787702 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787704 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787707 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787709 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787712 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787714 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787717 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787719 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787721 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787724 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787726 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787729 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.787731 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.791607 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790508 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790518 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790521 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790524 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790527 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790530 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790532 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790535 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790537 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790540 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790543 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790545 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790548 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790551 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790553 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790556 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790559 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790562 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790565 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.792103 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790567 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790570 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790574 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790578 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790581 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790584 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790586 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790593 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790596 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790598 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790601 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790604 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790607 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790610 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790612 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790615 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790618 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790621 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790623 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790626 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.792561 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790628 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790631 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790634 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790637 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790639 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790642 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790645 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790648 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790651 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790655 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790658 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790661 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790664 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790666 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790669 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790671 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790674 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790677 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790679 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790683 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.793055 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790685 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790688 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790690 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790693 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790695 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790698 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790701 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790705 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790707 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790710 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790713 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790715 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790718 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790720 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790723 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790725 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790728 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790730 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790733 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790735 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.793536 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790738 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790742 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790746 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790750 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790754 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790758 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790775 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790778 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790781 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790783 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790786 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790788 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790791 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790793 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790796 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790799 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790801 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790803 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.794021 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790806 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.790808 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790879 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790885 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790895 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790899 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790903 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790906 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790910 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790915 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790918 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790921 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790924 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790927 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790931 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790934 2562 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790937 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790940 2562 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790943 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790947 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790951 2562 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790954 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790957 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790961 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:30:38.794450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790964 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790968 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790971 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790974 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790977 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790980 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790983 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790985 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790989 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790991 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790996 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.790999 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791002 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791005 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791008 2562 flags.go:64] FLAG: --enable-server="true" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791010 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791015 2562 flags.go:64] FLAG: --event-burst="100" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791018 2562 flags.go:64] FLAG: --event-qps="50" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791021 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791024 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791027 2562 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791035 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791040 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791043 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791046 2562 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:30:38.795016 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791049 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791052 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791055 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791059 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791062 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791065 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791067 2562 flags.go:64] FLAG: --feature-gates="" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791071 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791074 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791077 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791080 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791083 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791086 2562 flags.go:64] FLAG: --help="false" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791088 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-142-89.ec2.internal" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791092 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791095 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791097 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791101 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791104 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791107 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791110 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791113 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791115 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:30:38.795644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791118 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791121 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791124 2562 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791128 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791131 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791134 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791139 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791142 2562 flags.go:64] FLAG: --lock-file="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791145 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791148 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791151 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791157 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791159 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791163 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791166 2562 flags.go:64] FLAG: --logging-format="text" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791168 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791172 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791174 2562 flags.go:64] FLAG: --manifest-url="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791177 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791181 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791185 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791188 2562 flags.go:64] FLAG: --max-pods="110" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791191 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791194 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791197 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:30:38.796241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791200 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791203 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791206 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791209 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791216 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791219 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791221 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791224 2562 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791227 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791232 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791235 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791239 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791242 2562 flags.go:64] FLAG: --port="10250" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791249 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791252 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b237e61151ddb148" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791255 2562 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791258 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791261 2562 flags.go:64] FLAG: --register-node="true" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791264 2562 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791273 2562 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791276 2562 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791279 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791282 2562 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791286 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791289 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:30:38.796871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791291 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791294 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791297 2562 flags.go:64] FLAG: --runonce="false" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791300 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791303 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791306 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791309 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791312 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791315 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791318 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791320 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791324 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791326 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791329 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791332 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791335 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791338 2562 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791340 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791346 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791348 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791353 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791357 2562 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791360 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791363 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791366 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:30:38.797487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791369 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791372 2562 flags.go:64] FLAG: --v="2" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791376 2562 flags.go:64] FLAG: --version="false" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791380 2562 flags.go:64] FLAG: --vmodule="" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791384 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.791388 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791503 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791506 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791510 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791513 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791515 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791518 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791522 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791526 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791529 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791532 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791535 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791537 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791540 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791542 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791545 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.798113 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791547 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791550 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791552 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791555 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791557 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791560 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791565 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791568 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791570 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791573 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791575 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791578 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791580 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791583 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791585 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791588 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791591 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791594 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791596 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791599 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.798628 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791601 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791604 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791606 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791609 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791611 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791614 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791616 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791619 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791622 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791624 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791627 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791629 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791632 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791634 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791637 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791639 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791642 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791644 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791649 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791651 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.799154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791654 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791656 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791659 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791661 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791664 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791667 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791669 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791672 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791674 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791677 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791680 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791682 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791685 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791687 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791690 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791692 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791695 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791697 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791700 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.799635 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791702 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791706 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791709 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791713 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791715 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791719 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791722 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791725 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791728 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791730 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791733 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791737 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791739 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791742 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791744 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791747 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791749 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791752 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791755 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.800108 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791757 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791772 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791775 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791777 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791781 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.791784 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.792408 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.798862 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.798879 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.798898 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.798904 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798958 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798963 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798968 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.800574 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798973 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798976 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798979 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798983 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798986 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798989 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798991 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798994 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798997 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.798999 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799002 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799005 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799007 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799010 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799012 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799014 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799018 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799020 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799022 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.800941 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799025 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799027 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799030 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799033 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799036 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799038 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799041 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799045 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799048 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799050 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799052 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799055 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799057 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799060 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799063 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799065 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799067 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799071 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799075 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.801403 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799078 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799081 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799083 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799086 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799089 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799092 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799094 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799097 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799099 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799102 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799105 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799107 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799109 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799112 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799114 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799117 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799119 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799122 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799125 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799128 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.801928 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799131 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799135 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799137 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799140 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799143 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799147 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799149 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799152 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799154 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799157 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799160 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799163 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799166 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799169 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799171 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799174 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799176 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799179 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799181 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799184 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.802405 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799187 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799189 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799192 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799194 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799197 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799199 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799202 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799205 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799207 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799210 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799213 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799215 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799218 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799221 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799224 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799226 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799229 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.802897 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799232 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.799236 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799345 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799350 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799353 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799356 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799358 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799361 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799364 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799367 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799369 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799372 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799374 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799377 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.803330 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799380 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799382 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799384 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799387 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799389 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799392 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799394 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799397 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799400 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799402 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799405 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799407 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799410 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799413 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799415 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799417 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799420 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799423 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799425 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799428 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.803676 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799430 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799433 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799435 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799437 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799440 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799442 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799445 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799447 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799450 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799452 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799454 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799457 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799461 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799464 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799466 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799469 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799472 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799475 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799478 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799481 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.804168 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799484 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799486 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799489 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799491 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799494 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799497 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799499 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799502 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799504 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799507 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799511 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799514 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799516 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799519 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799522 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799524 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799527 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799529 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799532 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.804670 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799534 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799536 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799539 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799541 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799543 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799546 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799548 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799551 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799554 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799556 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799559 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799561 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799564 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799566 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799570 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799573 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799576 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799579 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799581 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799584 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.805156 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799587 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799590 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799592 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799596 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799599 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799602 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799605 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:38.799607 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.799612 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.799716 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.801642 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.803019 2562 server.go:1019] "Starting client certificate rotation" Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.803115 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:30:38.805629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.803150 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:30:38.806700 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.806684 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:30:38.809802 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.809786 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:30:38.821026 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.821004 2562 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:30:38.824004 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.823987 2562 log.go:25] "Validated CRI v1 image API" Jul 07 14:30:38.825476 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.825461 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:30:38.827734 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.827711 2562 fs.go:135] Filesystem UUIDs: map[273df73c-aed8-4a6b-a71e-ee995c85792b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e7bbd3de-c3d4-4cdf-b9ef-bbb2d0059069:/dev/nvme0n1p4] Jul 07 14:30:38.827811 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.827732 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:30:38.832871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.832725 2562 manager.go:216] Machine: {Timestamp:2026-07-07 14:30:38.831402822 +0000 UTC m=+0.342012744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097551 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22131d0d9516331a62e2138bb75f67 SystemUUID:ec22131d-0d95-1633-1a62-e2138bb75f67 BootID:1d258481-04be-43d5-bc0d-3eb6dacd174e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:24:6d:0a:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:24:6d:0a:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:d3:4c:89:fb:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:30:38.832871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.832865 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:30:38.832999 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.832950 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:30:38.835403 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.835384 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:30:38.835974 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.835949 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:30:38.836119 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.835977 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:30:38.837212 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.837201 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:30:38.837246 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.837215 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:30:38.837246 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.837222 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:30:38.837884 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.837872 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:30:38.839192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.839181 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:30:38.841978 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.841966 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:30:38.842088 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842079 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:30:38.842119 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842108 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:30:38.842119 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842118 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:30:38.842175 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842128 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:30:38.842175 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842139 2562 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:30:38.842175 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842147 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:30:38.842499 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842487 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:30:38.842542 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.842506 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:30:38.845264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.845249 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:30:38.847146 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.847134 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:30:38.847186 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.847165 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:30:38.848350 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848339 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848358 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848366 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848371 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848379 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848385 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848393 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848399 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:30:38.848405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848405 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:30:38.848679 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848412 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:30:38.848679 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848426 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:30:38.848679 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.848431 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:30:38.849083 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.849073 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:30:38.849120 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.849084 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:30:38.852212 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.852196 2562 server.go:1268] "Started kubelet" Jul 07 14:30:38.852321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.852283 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:30:38.852432 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.852273 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:30:38.852535 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.852454 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:30:38.853073 ip-10-0-142-89 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:30:38.855468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.855442 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:30:38.856962 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.856944 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:30:38.857675 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.857655 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:30:38.857858 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.857835 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:30:38.857978 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.857953 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:30:38.858245 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.858223 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:30:38.862668 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.861417 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-89.ec2.internal.18c0085ae0e91960 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-89.ec2.internal,UID:ip-10-0-142-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-89.ec2.internal,},FirstTimestamp:2026-07-07 14:30:38.852168032 +0000 UTC m=+0.362777954,LastTimestamp:2026-07-07 14:30:38.852168032 +0000 UTC m=+0.362777954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-89.ec2.internal,}" Jul 07 14:30:38.864434 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.864415 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:30:38.864511 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.864434 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:30:38.864572 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.864511 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:38.865315 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865305 2562 factory.go:55] Registering systemd factory Jul 07 14:30:38.865373 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865321 2562 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:30:38.865589 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865508 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:30:38.865730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865716 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:30:38.865860 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865733 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:30:38.865912 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865882 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:30:38.865912 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865891 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:30:38.865981 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865938 2562 factory.go:153] Registering CRI-O factory Jul 07 14:30:38.865981 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.865951 2562 factory.go:223] Registration of the crio container factory successfully Jul 07 14:30:38.866035 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.866021 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:30:38.866077 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.866045 2562 factory.go:103] Registering Raw factory Jul 07 14:30:38.866077 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.866060 2562 manager.go:1196] Started watching for new ooms in manager Jul 07 14:30:38.866524 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.866509 2562 manager.go:349] Starting recovery of all containers Jul 07 14:30:38.868214 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.868193 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:30:38.868312 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.868295 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:30:38.878092 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.878074 2562 manager.go:354] Recovery completed Jul 07 14:30:38.878431 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.878416 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c6zz6" Jul 07 14:30:38.882413 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.882396 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.884732 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.884716 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.884809 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.884746 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.884809 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.884756 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.885275 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.885261 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:30:38.885275 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.885272 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:30:38.885275 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.885272 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.885453 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.885287 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:30:38.886298 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.886281 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.886399 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.886389 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.886488 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.886479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.886821 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.886800 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c6zz6" Jul 07 14:30:38.886987 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.886892 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-89.ec2.internal.18c0085ae2d9fa6f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-89.ec2.internal,UID:ip-10-0-142-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-89.ec2.internal,},FirstTimestamp:2026-07-07 14:30:38.884731503 +0000 UTC m=+0.395341425,LastTimestamp:2026-07-07 14:30:38.884731503 +0000 UTC m=+0.395341425,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-89.ec2.internal,}" Jul 07 14:30:38.887551 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.887519 2562 policy_none.go:49] "None policy: Start" Jul 07 14:30:38.887631 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.887559 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:30:38.887631 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.887573 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:30:38.888708 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.888692 2562 policy_none.go:47] "Start" Jul 07 14:30:38.924483 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924333 2562 manager.go:337] "Starting Device Plugin manager" Jul 07 14:30:38.924579 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.924495 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:30:38.924579 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924509 2562 server.go:87] "Starting device plugin registration server" Jul 07 14:30:38.924801 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924788 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:30:38.924846 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924805 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:30:38.924900 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924882 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:30:38.924975 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924963 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:30:38.925020 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:38.924976 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:30:38.925525 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.925506 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:30:38.925637 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:38.925561 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.025300 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.025270 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:39.026942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.026276 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:39.026942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.026306 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:39.026942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.026317 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:39.026942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.026343 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.031484 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.031436 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:30:39.032567 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.032547 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:30:39.032616 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.032601 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:30:39.032648 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.032633 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:30:39.032685 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.032676 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:30:39.035170 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.035147 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:39.036600 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.036585 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.036671 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.036606 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-89.ec2.internal\": node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.098489 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.098462 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.133599 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.133562 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal"] Jul 07 14:30:39.133670 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.133651 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:39.134623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.134607 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:39.134716 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.134643 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:39.134716 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.134658 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:39.136489 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.136474 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:39.136594 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.136579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.136644 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.136613 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:39.137270 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137256 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:39.137321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137284 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:39.137321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137295 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:39.137321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137256 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:39.137416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137334 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:39.137416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.137349 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:39.139092 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.139074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.139181 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.139097 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:39.139821 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.139804 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:39.139911 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.139836 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:39.139911 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.139850 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:39.167396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.167368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b30581dc755f3748ffdaa8433a2216-config\") pod \"kube-apiserver-proxy-ip-10-0-142-89.ec2.internal\" (UID: \"f9b30581dc755f3748ffdaa8433a2216\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.167490 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.167404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.167490 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.167414 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-89.ec2.internal\" not found" node="ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.167490 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.167430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.171756 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.171739 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-89.ec2.internal\" not found" node="ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.198735 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.198715 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.268228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.268228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.268406 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b30581dc755f3748ffdaa8433a2216-config\") pod \"kube-apiserver-proxy-ip-10-0-142-89.ec2.internal\" (UID: \"f9b30581dc755f3748ffdaa8433a2216\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.268406 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b30581dc755f3748ffdaa8433a2216-config\") pod \"kube-apiserver-proxy-ip-10-0-142-89.ec2.internal\" (UID: \"f9b30581dc755f3748ffdaa8433a2216\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.268406 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.268406 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.268301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/641f6286e16925038453a11fc5c3e351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal\" (UID: \"641f6286e16925038453a11fc5c3e351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.299170 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.299120 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.399923 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.399898 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.472445 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.472410 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.475400 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.475385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:39.500544 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.500519 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.601176 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.601091 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.701658 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.701627 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.789529 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.789496 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:39.801893 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.801861 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:39.801962 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.801911 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:30:39.802062 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.802041 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:30:39.802109 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.802063 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:30:39.889194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.889116 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:25:38 +0000 UTC" deadline="2028-01-18 17:20:01.504771701 +0000 UTC" Jul 07 14:30:39.889194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:39.889144 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13442h49m21.615631929s" Jul 07 14:30:39.902269 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:39.902248 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:40.002888 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.002860 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:40.103728 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.103685 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:40.139381 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:40.139281 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b30581dc755f3748ffdaa8433a2216.slice/crio-84f91de1184eba9d43a11f8868acd38c8fc4d0beb1c08a6d39bc0321b3ec7b5e WatchSource:0}: Error finding container 84f91de1184eba9d43a11f8868acd38c8fc4d0beb1c08a6d39bc0321b3ec7b5e: Status 404 returned error can't find the container with id 84f91de1184eba9d43a11f8868acd38c8fc4d0beb1c08a6d39bc0321b3ec7b5e Jul 07 14:30:40.139964 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:40.139941 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641f6286e16925038453a11fc5c3e351.slice/crio-0d049f55ad2d516f754a8b22a51a68ccf20a813c4e6d4992e20bfbf4f0f72612 WatchSource:0}: Error finding container 0d049f55ad2d516f754a8b22a51a68ccf20a813c4e6d4992e20bfbf4f0f72612: Status 404 returned error can't find the container with id 0d049f55ad2d516f754a8b22a51a68ccf20a813c4e6d4992e20bfbf4f0f72612 Jul 07 14:30:40.144341 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.144325 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:30:40.204783 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.204722 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-89.ec2.internal\" not found" Jul 07 14:30:40.231120 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.231098 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.265127 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.265099 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" Jul 07 14:30:40.276823 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.276805 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:30:40.277783 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.277757 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" Jul 07 14:30:40.281044 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.281028 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.287440 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.287426 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:30:40.832569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.832377 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.843350 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.843321 2562 apiserver.go:52] "Watching apiserver" Jul 07 14:30:40.850462 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.850372 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:30:40.850927 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.850905 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-jlzbx","openshift-multus/multus-additional-cni-plugins-9q5gb","openshift-multus/multus-vswj8","openshift-multus/network-metrics-daemon-kfnlt","kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lthm5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal","openshift-network-diagnostics/network-check-target-wnzlh","openshift-network-operator/iptables-alerter-7rgbx","openshift-ovn-kubernetes/ovnkube-node-pmxqn","kube-system/global-pull-secret-syncer-qr6db","kube-system/konnectivity-agent-p96tr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5","openshift-dns/node-resolver-4nvdd"] Jul 07 14:30:40.853922 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.853906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.856569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.856549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.856673 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.856648 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:40.857352 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.857325 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:30:40.857598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.857582 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5k77\"" Jul 07 14:30:40.860403 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.860381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.860585 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.860569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.860738 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.860717 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:30:40.860920 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.860882 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:30:40.861082 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.861054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:30:40.863290 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.863248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.865283 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.865264 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:30:40.865537 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.865503 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.865854 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.865865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.865934 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.866002 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.866055 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gpsxk\"" Jul 07 14:30:40.866508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.866162 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.869702 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.869122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.871582 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.871348 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.871582 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.871385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.871582 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.871533 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mwdf\"" Jul 07 14:30:40.871803 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.871696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.874198 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.873669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:40.875879 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.875857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.876263 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.875974 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.876426 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.876401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.877531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877275 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2ndp\"" Jul 07 14:30:40.877531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.877531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877471 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b9mkk\"" Jul 07 14:30:40.877826 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-var-lib-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.877876 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-node-log\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.877910 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-log-socket\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.877943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovn-node-metrics-cert\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.877977 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxh4d\" (UniqueName: \"kubernetes.io/projected/bd5bfabf-1f65-4085-8bff-d722ea96b547-kube-api-access-zxh4d\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878009 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.877994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-dbus\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.878040 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-system-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878088 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b160095-18db-4087-bb85-a36a8eef0bf2-hosts-file\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.878151 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b160095-18db-4087-bb85-a36a8eef0bf2-tmp-dir\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.878151 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-systemd-units\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878250 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878250 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878343 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.878343 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878436 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-os-release\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878436 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-kubelet\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878529 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878435 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.878603 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878438 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-ovn\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.878653 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878614 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:30:40.878653 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-bin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878753 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-multus-certs\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878753 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-etc-kubernetes\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.878987 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-systemd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.879042 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.878994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:30:40.879042 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-env-overrides\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.879042 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879033 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.879184 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.879184 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cnibin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879282 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-socket-dir-parent\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879282 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-k8s-cni-cncf-io\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879282 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-multus\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879418 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-hostroot\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879418 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6n4\" (UniqueName: \"kubernetes.io/projected/9430f75c-d8e7-4bf1-bb00-930ab3236af6-kube-api-access-hw6n4\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.879418 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-slash\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.879557 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-netd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.879557 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.879513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.881655 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.881636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:40.881753 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.881694 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:30:40.881876 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.881640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:30:40.882222 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-kubelet\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.882318 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:40.882318 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-netns\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.882318 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z5vqt\"" Jul 07 14:30:40.882468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-bin\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.882468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cni-binary-copy\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.884370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884088 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.884370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884216 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.884370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:30:40.884565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:40.884565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.882408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8nr\" (UniqueName: \"kubernetes.io/projected/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-kube-api-access-8d8nr\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:40.884565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-config\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.884565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-script-lib\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.884565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.884551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-etc-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.887174 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.886618 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:40.887174 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.887030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wbbgs\"" Jul 07 14:30:40.887174 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.887049 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4qcpb\"" Jul 07 14:30:40.887174 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.887052 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:30:40.887472 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.886901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.888226 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.888206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-kubelet-config\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.888412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.888395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-netns\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.888520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.888506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-conf-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.888625 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.888610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-daemon-config\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.888725 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.888710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvzn\" (UniqueName: \"kubernetes.io/projected/9b160095-18db-4087-bb85-a36a8eef0bf2-kube-api-access-qfvzn\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.889099 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.889075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:40.891393 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.891358 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:30:40.892335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.892043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:30:40.892335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.892147 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xmw2r\"" Jul 07 14:30:40.900272 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.900219 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4chs" Jul 07 14:30:40.905868 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.905845 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4chs" Jul 07 14:30:40.967284 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.967216 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:30:40.989463 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-config\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-script-lib\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-registration-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-os-release\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-tmp\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca72bfba-f08c-4beb-8782-936206fa0725-agent-certs\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:40.989598 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca72bfba-f08c-4beb-8782-936206fa0725-konnectivity-ca\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-conf-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xj4n\" (UniqueName: \"kubernetes.io/projected/baca779b-29ce-4c62-b103-92060d0a3104-kube-api-access-6xj4n\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-run\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-socket-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-node-log\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5m5\" (UniqueName: \"kubernetes.io/projected/a11ec7ce-35bd-492b-8015-07b3bee5bf56-kube-api-access-7h5m5\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.989915 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-multus-certs\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-binary-copy\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-kubelet\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.989976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-bin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-etc-kubernetes\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b574627a-a38a-46ab-ab89-2c57d34c5d9c-host-slash\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-systemd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-multus\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-hostroot\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-slash\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-kubelet\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-netns\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cni-binary-copy\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8nr\" (UniqueName: \"kubernetes.io/projected/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-kube-api-access-8d8nr\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-device-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.990485 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-lib-modules\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-tuned\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-etc-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-kubelet-config\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-netns\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-daemon-config\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-sys\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvzn\" (UniqueName: \"kubernetes.io/projected/9b160095-18db-4087-bb85-a36a8eef0bf2-kube-api-access-qfvzn\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-var-lib-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-log-socket\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovn-node-metrics-cert\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-bin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-etc-kubernetes\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-systemd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-cni-multus\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-hostroot\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-config\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.991259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-conf-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-slash\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-node-log\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991390 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991393 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-var-lib-kubelet\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovnkube-script-lib\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991433 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-netns\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.991463 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991494 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-etc-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.991512 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.491494597 +0000 UTC m=+3.002104506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-kubelet-config\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-netns\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-kubelet\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.990669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxh4d\" (UniqueName: \"kubernetes.io/projected/bd5bfabf-1f65-4085-8bff-d722ea96b547-kube-api-access-zxh4d\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-dbus\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.992189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-system-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-os-release\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b160095-18db-4087-bb85-a36a8eef0bf2-hosts-file\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b160095-18db-4087-bb85-a36a8eef0bf2-tmp-dir\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-systemd-units\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b574627a-a38a-46ab-ab89-2c57d34c5d9c-iptables-alerter-script\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-k8s-cni-cncf-io\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-system-cni-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.991982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-cnibin\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-ovn\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cni-binary-copy\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wcj\" (UniqueName: \"kubernetes.io/projected/b574627a-a38a-46ab-ab89-2c57d34c5d9c-kube-api-access-22wcj\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-daemon-config\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22ft\" (UniqueName: \"kubernetes.io/projected/b4839ff9-09a6-44a9-b212-02e7a856089e-kube-api-access-k22ft\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-multus-certs\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.992998 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2184369-b00f-42bd-b2f7-c44c7a551487-dbus\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysconfig\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-conf\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-var-lib-kubelet\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-host\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-env-overrides\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cnibin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-socket-dir-parent\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6n4\" (UniqueName: \"kubernetes.io/projected/9430f75c-d8e7-4bf1-bb00-930ab3236af6-kube-api-access-hw6n4\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-modprobe-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-systemd\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-system-cni-dir\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b160095-18db-4087-bb85-a36a8eef0bf2-tmp-dir\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-host\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-netd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-sys-fs\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-serviceca\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:40.993773 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.992590 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992617 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-bin\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:40.992641 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.492624571 +0000 UTC m=+3.003234499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-systemd-units\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-host-run-k8s-cni-cncf-io\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-run-ovn\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b160095-18db-4087-bb85-a36a8eef0bf2-hosts-file\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-os-release\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-bin\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.992901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-var-lib-openvswitch\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd5bfabf-1f65-4085-8bff-d722ea96b547-env-overrides\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-log-socket\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd5bfabf-1f65-4085-8bff-d722ea96b547-host-cni-netd\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-cnibin\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:40.994523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-kubernetes\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:40.995243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6sbv\" (UniqueName: \"kubernetes.io/projected/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-kube-api-access-w6sbv\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:40.995243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:40.995243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993323 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:30:40.995243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.993438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9430f75c-d8e7-4bf1-bb00-930ab3236af6-multus-socket-dir-parent\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:40.999530 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:40.998143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd5bfabf-1f65-4085-8bff-d722ea96b547-ovn-node-metrics-cert\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:41.002511 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.002486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6n4\" (UniqueName: \"kubernetes.io/projected/9430f75c-d8e7-4bf1-bb00-930ab3236af6-kube-api-access-hw6n4\") pod \"multus-vswj8\" (UID: \"9430f75c-d8e7-4bf1-bb00-930ab3236af6\") " pod="openshift-multus/multus-vswj8" Jul 07 14:30:41.003370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.003349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8nr\" (UniqueName: \"kubernetes.io/projected/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-kube-api-access-8d8nr\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:41.004159 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.004078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxh4d\" (UniqueName: \"kubernetes.io/projected/bd5bfabf-1f65-4085-8bff-d722ea96b547-kube-api-access-zxh4d\") pod \"ovnkube-node-pmxqn\" (UID: \"bd5bfabf-1f65-4085-8bff-d722ea96b547\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:41.006630 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.006600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvzn\" (UniqueName: \"kubernetes.io/projected/9b160095-18db-4087-bb85-a36a8eef0bf2-kube-api-access-qfvzn\") pod \"node-resolver-4nvdd\" (UID: \"9b160095-18db-4087-bb85-a36a8eef0bf2\") " pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:41.038577 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.038522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" event={"ID":"f9b30581dc755f3748ffdaa8433a2216","Type":"ContainerStarted","Data":"84f91de1184eba9d43a11f8868acd38c8fc4d0beb1c08a6d39bc0321b3ec7b5e"} Jul 07 14:30:41.039888 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.039833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" event={"ID":"641f6286e16925038453a11fc5c3e351","Type":"ContainerStarted","Data":"0d049f55ad2d516f754a8b22a51a68ccf20a813c4e6d4992e20bfbf4f0f72612"} Jul 07 14:30:41.093632 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-device-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.093632 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.093632 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-lib-modules\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.093632 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-tuned\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.093632 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-sys\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b574627a-a38a-46ab-ab89-2c57d34c5d9c-iptables-alerter-script\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-system-cni-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-cnibin\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wcj\" (UniqueName: \"kubernetes.io/projected/b574627a-a38a-46ab-ab89-2c57d34c5d9c-kube-api-access-22wcj\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k22ft\" (UniqueName: \"kubernetes.io/projected/b4839ff9-09a6-44a9-b212-02e7a856089e-kube-api-access-k22ft\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysconfig\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-conf\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-var-lib-kubelet\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-host\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-modprobe-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-systemd\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.093974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-host\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-sys-fs\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094027 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-serviceca\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-kubernetes\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6sbv\" (UniqueName: \"kubernetes.io/projected/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-kube-api-access-w6sbv\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysconfig\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-registration-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-conf\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-os-release\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-tmp\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca72bfba-f08c-4beb-8782-936206fa0725-agent-certs\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca72bfba-f08c-4beb-8782-936206fa0725-konnectivity-ca\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xj4n\" (UniqueName: \"kubernetes.io/projected/baca779b-29ce-4c62-b103-92060d0a3104-kube-api-access-6xj4n\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-run\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-socket-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.094756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5m5\" (UniqueName: \"kubernetes.io/projected/a11ec7ce-35bd-492b-8015-07b3bee5bf56-kube-api-access-7h5m5\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-os-release\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-binary-copy\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b574627a-a38a-46ab-ab89-2c57d34c5d9c-host-slash\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b574627a-a38a-46ab-ab89-2c57d34c5d9c-host-slash\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-device-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-sysctl-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-system-cni-dir\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.094910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-lib-modules\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-binary-copy\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-sys\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-systemd\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-modprobe-d\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-host\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.095560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-sys-fs\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b574627a-a38a-46ab-ab89-2c57d34c5d9c-iptables-alerter-script\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-serviceca\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-var-lib-kubelet\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.095920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-kubernetes\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.096437 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baca779b-29ce-4c62-b103-92060d0a3104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.096827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-registration-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.096827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-host\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.096827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a11ec7ce-35bd-492b-8015-07b3bee5bf56-run\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.096982 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4839ff9-09a6-44a9-b212-02e7a856089e-socket-dir\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.096982 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca72bfba-f08c-4beb-8782-936206fa0725-konnectivity-ca\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:41.097088 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.096992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baca779b-29ce-4c62-b103-92060d0a3104-cnibin\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.098455 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.098430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-tmp\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.098585 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.098566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca72bfba-f08c-4beb-8782-936206fa0725-agent-certs\") pod \"konnectivity-agent-p96tr\" (UID: \"ca72bfba-f08c-4beb-8782-936206fa0725\") " pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:41.099050 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.099031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a11ec7ce-35bd-492b-8015-07b3bee5bf56-etc-tuned\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.102687 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.102654 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:41.102687 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.102676 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:41.102687 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.102690 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.102908 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.102751 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.602732835 +0000 UTC m=+3.113342764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.106832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.106215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6sbv\" (UniqueName: \"kubernetes.io/projected/b0a6133e-0379-47ce-9bc4-7e5a8999c5a5-kube-api-access-w6sbv\") pod \"node-ca-jlzbx\" (UID: \"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5\") " pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.106832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.106253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5m5\" (UniqueName: \"kubernetes.io/projected/a11ec7ce-35bd-492b-8015-07b3bee5bf56-kube-api-access-7h5m5\") pod \"tuned-lthm5\" (UID: \"a11ec7ce-35bd-492b-8015-07b3bee5bf56\") " pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.106832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.106655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22ft\" (UniqueName: \"kubernetes.io/projected/b4839ff9-09a6-44a9-b212-02e7a856089e-kube-api-access-k22ft\") pod \"aws-ebs-csi-driver-node-kp7k5\" (UID: \"b4839ff9-09a6-44a9-b212-02e7a856089e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.107574 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.107556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wcj\" (UniqueName: \"kubernetes.io/projected/b574627a-a38a-46ab-ab89-2c57d34c5d9c-kube-api-access-22wcj\") pod \"iptables-alerter-7rgbx\" (UID: \"b574627a-a38a-46ab-ab89-2c57d34c5d9c\") " pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.108058 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.108039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xj4n\" (UniqueName: \"kubernetes.io/projected/baca779b-29ce-4c62-b103-92060d0a3104-kube-api-access-6xj4n\") pod \"multus-additional-cni-plugins-9q5gb\" (UID: \"baca779b-29ce-4c62-b103-92060d0a3104\") " pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.172973 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.172937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:30:41.186964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.186930 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vswj8" Jul 07 14:30:41.196117 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.196093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4nvdd" Jul 07 14:30:41.203134 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.203114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lthm5" Jul 07 14:30:41.212898 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.212872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rgbx" Jul 07 14:30:41.221666 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.221647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" Jul 07 14:30:41.230364 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.230343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" Jul 07 14:30:41.239014 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.238994 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlzbx" Jul 07 14:30:41.243676 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.243656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:30:41.497349 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.497261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:41.497496 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.497437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:41.497496 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.497445 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:41.497584 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.497521 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:42.497503482 +0000 UTC m=+4.008113414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:41.497584 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.497561 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:41.497663 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.497615 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:42.497599434 +0000 UTC m=+4.008209358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:41.699167 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.699132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:41.699353 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.699280 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:41.699353 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.699297 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:41.699353 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.699305 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.699515 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:41.699371 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:30:42.699353621 +0000 UTC m=+4.209963534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.909133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.909094 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:25:40 +0000 UTC" deadline="2028-04-11 09:39:18.644297902 +0000 UTC" Jul 07 14:30:41.909133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:41.909129 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15451h8m36.735172311s" Jul 07 14:30:42.106123 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.106034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b160095_18db_4087_bb85_a36a8eef0bf2.slice/crio-5eb5fffd9c999be6326e61bd5934c2df723c02ec8a11657af325bd80e66edd85 WatchSource:0}: Error finding container 5eb5fffd9c999be6326e61bd5934c2df723c02ec8a11657af325bd80e66edd85: Status 404 returned error can't find the container with id 5eb5fffd9c999be6326e61bd5934c2df723c02ec8a11657af325bd80e66edd85 Jul 07 14:30:42.108112 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.108086 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaca779b_29ce_4c62_b103_92060d0a3104.slice/crio-4d7985f951f592b7dcc93771fe34d73941d83c2381620c6692cfd8914c2a48a9 WatchSource:0}: Error finding container 4d7985f951f592b7dcc93771fe34d73941d83c2381620c6692cfd8914c2a48a9: Status 404 returned error can't find the container with id 4d7985f951f592b7dcc93771fe34d73941d83c2381620c6692cfd8914c2a48a9 Jul 07 14:30:42.130059 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.129928 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb574627a_a38a_46ab_ab89_2c57d34c5d9c.slice/crio-ef5fb57f169daba419f7672f87d7456d000fcbce463e051f7c892e3fb93dd2ab WatchSource:0}: Error finding container ef5fb57f169daba419f7672f87d7456d000fcbce463e051f7c892e3fb93dd2ab: Status 404 returned error can't find the container with id ef5fb57f169daba419f7672f87d7456d000fcbce463e051f7c892e3fb93dd2ab Jul 07 14:30:42.133447 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.132976 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a6133e_0379_47ce_9bc4_7e5a8999c5a5.slice/crio-7174c5e05d2cee40df10c0c1d33e44827e5d05c77fa64eb6a497fea08b0ce716 WatchSource:0}: Error finding container 7174c5e05d2cee40df10c0c1d33e44827e5d05c77fa64eb6a497fea08b0ce716: Status 404 returned error can't find the container with id 7174c5e05d2cee40df10c0c1d33e44827e5d05c77fa64eb6a497fea08b0ce716 Jul 07 14:30:42.134820 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.134799 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11ec7ce_35bd_492b_8015_07b3bee5bf56.slice/crio-9b6deccd4346d7f6b94780f33fe4dc7ff59343e8ff50eb82487c74165d1e472a WatchSource:0}: Error finding container 9b6deccd4346d7f6b94780f33fe4dc7ff59343e8ff50eb82487c74165d1e472a: Status 404 returned error can't find the container with id 9b6deccd4346d7f6b94780f33fe4dc7ff59343e8ff50eb82487c74165d1e472a Jul 07 14:30:42.135906 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.135677 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9430f75c_d8e7_4bf1_bb00_930ab3236af6.slice/crio-f85da7c494d8afb05468d830a7282f7af7377df0ca8f6d227e183410782869f1 WatchSource:0}: Error finding container f85da7c494d8afb05468d830a7282f7af7377df0ca8f6d227e183410782869f1: Status 404 returned error can't find the container with id f85da7c494d8afb05468d830a7282f7af7377df0ca8f6d227e183410782869f1 Jul 07 14:30:42.137395 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.137315 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5bfabf_1f65_4085_8bff_d722ea96b547.slice/crio-4ea9c9034835d32dafcc126c934562608bc974964cd0384d4735e805c47d955a WatchSource:0}: Error finding container 4ea9c9034835d32dafcc126c934562608bc974964cd0384d4735e805c47d955a: Status 404 returned error can't find the container with id 4ea9c9034835d32dafcc126c934562608bc974964cd0384d4735e805c47d955a Jul 07 14:30:42.138226 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.138202 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca72bfba_f08c_4beb_8782_936206fa0725.slice/crio-a8c5401149b66f6b842eb5a628842ad9ff07928dafed4e4a8ef9abf98df2fbfd WatchSource:0}: Error finding container a8c5401149b66f6b842eb5a628842ad9ff07928dafed4e4a8ef9abf98df2fbfd: Status 404 returned error can't find the container with id a8c5401149b66f6b842eb5a628842ad9ff07928dafed4e4a8ef9abf98df2fbfd Jul 07 14:30:42.142099 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:30:42.141229 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4839ff9_09a6_44a9_b212_02e7a856089e.slice/crio-271a2b297c7f6efa210f00b36628b5a46a93d59dd81210fa1689417977c9e91f WatchSource:0}: Error finding container 271a2b297c7f6efa210f00b36628b5a46a93d59dd81210fa1689417977c9e91f: Status 404 returned error can't find the container with id 271a2b297c7f6efa210f00b36628b5a46a93d59dd81210fa1689417977c9e91f Jul 07 14:30:42.440952 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.440729 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:42.505748 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.505715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:42.505922 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.505784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:42.505922 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.505869 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:42.505922 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.505869 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:42.505922 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.505924 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:44.505910587 +0000 UTC m=+6.016520500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:42.506053 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.505938 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:44.505931946 +0000 UTC m=+6.016541855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:42.707436 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.707335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:42.707592 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.707543 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:42.707592 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.707563 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:42.707592 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.707576 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:42.707834 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:42.707635 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:30:44.707617859 +0000 UTC m=+6.218227788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:42.910243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.910178 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:25:40 +0000 UTC" deadline="2028-03-31 13:50:52.385073488 +0000 UTC" Jul 07 14:30:42.910243 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:42.910241 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15191h20m9.474836585s" Jul 07 14:30:43.033967 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.033888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:43.034126 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.033899 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:43.034126 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:43.034023 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:43.034126 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:43.034096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:43.034318 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.034156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:43.034318 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:43.034238 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:43.070050 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.070012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" event={"ID":"f9b30581dc755f3748ffdaa8433a2216","Type":"ContainerStarted","Data":"f7d600861ff4e24cc33a2d067d296dbc0c697d88c94263ab440cc5e49c742da5"} Jul 07 14:30:43.074088 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.074055 2562 generic.go:356] "Generic (PLEG): container finished" podID="641f6286e16925038453a11fc5c3e351" containerID="880b5ceef7a9634bc8c2c735ac37e1a1b71e66bfb7ac1cb1a021b0aeb8ccfbf7" exitCode=0 Jul 07 14:30:43.074225 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.074138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" event={"ID":"641f6286e16925038453a11fc5c3e351","Type":"ContainerDied","Data":"880b5ceef7a9634bc8c2c735ac37e1a1b71e66bfb7ac1cb1a021b0aeb8ccfbf7"} Jul 07 14:30:43.083565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.083508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p96tr" event={"ID":"ca72bfba-f08c-4beb-8782-936206fa0725","Type":"ContainerStarted","Data":"a8c5401149b66f6b842eb5a628842ad9ff07928dafed4e4a8ef9abf98df2fbfd"} Jul 07 14:30:43.093560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.093531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" event={"ID":"b4839ff9-09a6-44a9-b212-02e7a856089e","Type":"ContainerStarted","Data":"271a2b297c7f6efa210f00b36628b5a46a93d59dd81210fa1689417977c9e91f"} Jul 07 14:30:43.103560 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.103512 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-89.ec2.internal" podStartSLOduration=3.103494262 podStartE2EDuration="3.103494262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:43.087686078 +0000 UTC m=+4.598296012" watchObservedRunningTime="2026-07-07 14:30:43.103494262 +0000 UTC m=+4.614104195" Jul 07 14:30:43.110227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.110202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlzbx" event={"ID":"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5","Type":"ContainerStarted","Data":"7174c5e05d2cee40df10c0c1d33e44827e5d05c77fa64eb6a497fea08b0ce716"} Jul 07 14:30:43.119523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.119496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4nvdd" event={"ID":"9b160095-18db-4087-bb85-a36a8eef0bf2","Type":"ContainerStarted","Data":"5eb5fffd9c999be6326e61bd5934c2df723c02ec8a11657af325bd80e66edd85"} Jul 07 14:30:43.127410 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.127305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"4ea9c9034835d32dafcc126c934562608bc974964cd0384d4735e805c47d955a"} Jul 07 14:30:43.129933 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.129871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vswj8" event={"ID":"9430f75c-d8e7-4bf1-bb00-930ab3236af6","Type":"ContainerStarted","Data":"f85da7c494d8afb05468d830a7282f7af7377df0ca8f6d227e183410782869f1"} Jul 07 14:30:43.140331 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.140249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lthm5" event={"ID":"a11ec7ce-35bd-492b-8015-07b3bee5bf56","Type":"ContainerStarted","Data":"9b6deccd4346d7f6b94780f33fe4dc7ff59343e8ff50eb82487c74165d1e472a"} Jul 07 14:30:43.154507 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.154481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rgbx" event={"ID":"b574627a-a38a-46ab-ab89-2c57d34c5d9c","Type":"ContainerStarted","Data":"ef5fb57f169daba419f7672f87d7456d000fcbce463e051f7c892e3fb93dd2ab"} Jul 07 14:30:43.160740 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:43.160206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerStarted","Data":"4d7985f951f592b7dcc93771fe34d73941d83c2381620c6692cfd8914c2a48a9"} Jul 07 14:30:44.183545 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:44.183500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" event={"ID":"641f6286e16925038453a11fc5c3e351","Type":"ContainerStarted","Data":"fb1c044cc3706b3d85c3bd650942f5ba491406762941dc4bc5b8652bc2677486"} Jul 07 14:30:44.522798 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:44.522696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:44.522798 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:44.522794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:44.523023 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.522928 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:44.523023 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.522989 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:48.522970631 +0000 UTC m=+10.033580559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:44.523395 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.523379 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:44.523463 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.523428 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:48.523414603 +0000 UTC m=+10.034024526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:44.724661 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:44.724056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:44.724661 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.724232 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:44.724661 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.724258 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:44.724661 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.724270 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:44.724661 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:44.724329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:30:48.724310411 +0000 UTC m=+10.234920336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:45.033606 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:45.033575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:45.033825 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:45.033695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:45.034109 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:45.034090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:45.034224 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:45.034185 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:45.034290 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:45.034243 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:45.036775 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:45.034328 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:47.037967 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:47.037725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:47.037967 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:47.037758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:47.037967 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:47.037784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:47.037967 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:47.037867 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:47.038723 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:47.038009 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:47.038723 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:47.038147 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:48.556810 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:48.556750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:48.557227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:48.556858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:48.557227 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.556887 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:48.557227 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.556965 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:48.557227 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.556972 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:56.556950906 +0000 UTC m=+18.067560819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:48.557227 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.557014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:56.557001877 +0000 UTC m=+18.067611787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:48.758925 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:48.758753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:48.758925 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.758915 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:48.759167 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.758938 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:48.759167 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.758955 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:48.759167 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:48.759018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:30:56.758998893 +0000 UTC m=+18.269608823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:49.034756 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:49.034631 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:49.034960 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:49.034750 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:49.034960 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:49.034758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:49.034960 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:49.034941 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:49.035123 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:49.035005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:49.035123 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:49.035108 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:51.033820 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:51.033577 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:51.033820 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:51.033697 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:51.033820 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:51.033586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:51.033820 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:51.033750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:51.034906 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:51.033872 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:51.035248 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:51.035156 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:53.033661 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:53.033634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:53.033661 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:53.033650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:53.034046 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:53.033634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:53.034046 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:53.033742 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:53.034046 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:53.033844 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:53.034046 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:53.033905 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:55.035811 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:55.035782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:55.035811 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:55.035806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:55.036228 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:55.035888 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:55.036228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:55.035947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:55.036228 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:55.036044 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:55.036228 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:55.036173 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:56.614807 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:56.614753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:56.615349 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:56.614848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:56.615349 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.614914 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:56.615349 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.614951 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:56.615349 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.614994 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.614974211 +0000 UTC m=+34.125584133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:56.615349 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.615014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.61500421 +0000 UTC m=+34.125614123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:56.816385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:56.816339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:56.816558 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.816491 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:56.816558 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.816513 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:56.816558 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.816524 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:56.816707 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:56.816581 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.816564876 +0000 UTC m=+34.327174785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:57.036568 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:57.036481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:57.036803 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:57.036589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:57.036803 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:57.036597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:30:57.036803 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:57.036696 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:57.036803 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:57.036756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:57.036995 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:57.036848 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:59.034031 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:59.033999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:30:59.034535 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:59.034100 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:30:59.034535 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:59.034181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:30:59.034535 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:59.034292 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:30:59.034535 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:30:59.034341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:30:59.034535 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:30:59.034393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:01.033650 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:01.033612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:01.034205 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:01.033612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:01.034205 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:01.033713 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:01.034205 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:01.033819 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:01.034205 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:01.033627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:01.034205 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:01.033912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:02.230124 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.229680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p96tr" event={"ID":"ca72bfba-f08c-4beb-8782-936206fa0725","Type":"ContainerStarted","Data":"46629ad28ad9c532ee1395b5d6f7490a89e775091c4561fa0a90377ec757d03f"} Jul 07 14:31:02.234267 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.234009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" event={"ID":"b4839ff9-09a6-44a9-b212-02e7a856089e","Type":"ContainerStarted","Data":"38e914991610b1e6cf1ebc9ebe8dc473b774396cfb9c8e818a7a745f19f94fbe"} Jul 07 14:31:02.235973 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.235925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlzbx" event={"ID":"b0a6133e-0379-47ce-9bc4-7e5a8999c5a5","Type":"ContainerStarted","Data":"7e4a5626097f9d263a49a70664d90d9e86663291676731ffe54362251008fbe6"} Jul 07 14:31:02.238488 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.238465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4nvdd" event={"ID":"9b160095-18db-4087-bb85-a36a8eef0bf2","Type":"ContainerStarted","Data":"f4085a805218cdb794cff286255f672af73d96562a654bb1d07621f4113a1041"} Jul 07 14:31:02.241219 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:31:02.241782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241533 2562 generic.go:356] "Generic (PLEG): container finished" podID="bd5bfabf-1f65-4085-8bff-d722ea96b547" containerID="34dc15036c88e2ae3adf28914476841ed1f4724ca27b0f378f714b2f15b2994d" exitCode=1 Jul 07 14:31:02.241782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"d78e857f71bbb2c165df508c29ff4704d0a00c0fc6950728dc316a90dd31badf"} Jul 07 14:31:02.241782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"cbfae2a5074ceac153e026e11da14436160c87350011f6862f35ec25ee2eb5b9"} Jul 07 14:31:02.241782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"cf0915119236666e96749b4dd0ab1a524cca30a26154bc9b52eac6799d8fcf42"} Jul 07 14:31:02.242012 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerDied","Data":"34dc15036c88e2ae3adf28914476841ed1f4724ca27b0f378f714b2f15b2994d"} Jul 07 14:31:02.242012 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.241854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"e551c529abea0cddbe19bb2b163b999f52022e46785b1b4d7d73fca5a9cbeb86"} Jul 07 14:31:02.243198 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.243179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vswj8" event={"ID":"9430f75c-d8e7-4bf1-bb00-930ab3236af6","Type":"ContainerStarted","Data":"6d83287868132a60381865e9d1e2216453edda6089cc07d30650eb7f12a21a77"} Jul 07 14:31:02.244755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.244723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lthm5" event={"ID":"a11ec7ce-35bd-492b-8015-07b3bee5bf56","Type":"ContainerStarted","Data":"24a91870e83c63cdeac50db63d155927451247e3238a8330a92a7609ab17db4d"} Jul 07 14:31:02.246370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.246347 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="2036e329b760cc422015b5a01c5fcd00368a71650e311d46cf2624067c197ebc" exitCode=0 Jul 07 14:31:02.246464 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.246381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"2036e329b760cc422015b5a01c5fcd00368a71650e311d46cf2624067c197ebc"} Jul 07 14:31:02.249443 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.249405 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-89.ec2.internal" podStartSLOduration=22.249393439 podStartE2EDuration="22.249393439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:44.200243232 +0000 UTC m=+5.710853164" watchObservedRunningTime="2026-07-07 14:31:02.249393439 +0000 UTC m=+23.760003369" Jul 07 14:31:02.249735 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.249700 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p96tr" podStartSLOduration=8.141567187 podStartE2EDuration="23.24969293s" totalImagesPullingTime="15.108125743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:02.249331268 +0000 UTC m=+23.759941199" watchObservedRunningTime="2026-07-07 14:31:02.24969293 +0000 UTC m=+23.760302861" Jul 07 14:31:02.271557 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.271505 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vswj8" podStartSLOduration=4.150920534 podStartE2EDuration="23.271489012s" totalImagesPullingTime="19.120568478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:02.271028604 +0000 UTC m=+23.781638535" watchObservedRunningTime="2026-07-07 14:31:02.271489012 +0000 UTC m=+23.782098944" Jul 07 14:31:02.309046 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.309008 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4nvdd" podStartSLOduration=4.227802915 podStartE2EDuration="23.308993738s" totalImagesPullingTime="19.081190823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:02.308705512 +0000 UTC m=+23.819315445" watchObservedRunningTime="2026-07-07 14:31:02.308993738 +0000 UTC m=+23.819603669" Jul 07 14:31:02.327554 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.327517 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lthm5" podStartSLOduration=4.238530061 podStartE2EDuration="23.3275016s" totalImagesPullingTime="19.088971539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:02.326906951 +0000 UTC m=+23.837516883" watchObservedRunningTime="2026-07-07 14:31:02.3275016 +0000 UTC m=+23.838111554" Jul 07 14:31:02.342000 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.341955 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jlzbx" podStartSLOduration=4.268138672 podStartE2EDuration="23.341941245s" totalImagesPullingTime="19.073802573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:02.341908145 +0000 UTC m=+23.852518075" watchObservedRunningTime="2026-07-07 14:31:02.341941245 +0000 UTC m=+23.852551176" Jul 07 14:31:02.583508 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.583482 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:31:02.938259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.938123 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:31:02.583503325Z","UUID":"bf2a9040-a44e-4d45-8735-0a71c306c06a","Handler":null,"Name":"","Endpoint":""} Jul 07 14:31:02.939579 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.939561 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:31:02.939688 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:02.939594 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:31:03.033542 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.033511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:03.033714 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.033519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:03.033714 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:03.033636 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:03.033714 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.033663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:03.033982 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:03.033753 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:03.033982 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:03.033858 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:03.250829 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.250793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rgbx" event={"ID":"b574627a-a38a-46ab-ab89-2c57d34c5d9c","Type":"ContainerStarted","Data":"dbdbf3b81cfaca75ce34eb48a6dacb2daa8674b6b2d8801b9b98ea315127c7dd"} Jul 07 14:31:03.253169 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.253105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" event={"ID":"b4839ff9-09a6-44a9-b212-02e7a856089e","Type":"ContainerStarted","Data":"baa224545f9bcbeca82f289712f17d498fe2fdd8cd7f0be2ea9151e5bacd0d87"} Jul 07 14:31:03.256450 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.256429 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:31:03.257007 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:03.256933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"1d2e1a87d50d981d1facc1868c4842702b2af059fe2c3923c030396b11017d93"} Jul 07 14:31:04.116861 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:04.116834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4nvdd_9b160095-18db-4087-bb85-a36a8eef0bf2/dns-node-resolver/0.log" Jul 07 14:31:04.260572 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:04.260534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" event={"ID":"b4839ff9-09a6-44a9-b212-02e7a856089e","Type":"ContainerStarted","Data":"85e543c29344720f80c8f5f787ed11c1bf855007c20135f7648e6716e043f36a"} Jul 07 14:31:04.279303 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:04.279263 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp7k5" podStartSLOduration=4.225132753 podStartE2EDuration="25.279251767s" totalImagesPullingTime="21.054119014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:04.278373417 +0000 UTC m=+25.788983348" watchObservedRunningTime="2026-07-07 14:31:04.279251767 +0000 UTC m=+25.789861751" Jul 07 14:31:04.279690 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:04.279669 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rgbx" podStartSLOduration=6.185312888 podStartE2EDuration="25.279662757s" totalImagesPullingTime="19.094349869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:03.265674805 +0000 UTC m=+24.776284735" watchObservedRunningTime="2026-07-07 14:31:04.279662757 +0000 UTC m=+25.790272708" Jul 07 14:31:05.033820 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.033785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:05.033820 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.033811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:05.034014 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.033799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:05.034014 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:05.033900 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:05.034014 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:05.033964 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:05.034126 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:05.034021 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:05.089862 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.089829 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlzbx_b0a6133e-0379-47ce-9bc4-7e5a8999c5a5/node-ca/0.log" Jul 07 14:31:05.266367 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.266344 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:31:05.266854 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.266796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"50bd0055ece498da169f3ebf9b4d2d5474e245f36b802f1e50285fc8f335be52"} Jul 07 14:31:05.847535 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.847341 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:31:05.848042 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:05.848026 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:31:06.269449 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:06.269421 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:31:06.269903 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:06.269889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p96tr" Jul 07 14:31:07.033455 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:07.033425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:07.033455 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:07.033458 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:07.033671 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:07.033425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:07.033671 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:07.033552 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:07.033671 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:07.033630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:07.033811 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:07.033715 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:08.278302 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.278148 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:31:08.279032 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.278711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"4ae01c174bccf03ca210a0b4c7cbfddb0c63cd432e9b967b9c023dc96bcf145d"} Jul 07 14:31:08.279032 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.278978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:08.279130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.279045 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:08.279229 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.279208 2562 scope.go:117] "RemoveContainer" containerID="34dc15036c88e2ae3adf28914476841ed1f4724ca27b0f378f714b2f15b2994d" Jul 07 14:31:08.280661 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.280633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerStarted","Data":"9b8affd55c56b88427cc1171b3bcc180d8df29e340a414c5794bcb88bc96f6e9"} Jul 07 14:31:08.294833 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.294803 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:08.296228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:08.296210 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:09.034522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.034461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:09.034724 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.034621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:09.034724 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:09.034638 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:09.034724 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.034713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:09.034870 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:09.034735 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:09.034870 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:09.034781 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:09.288077 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.288037 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:31:09.288552 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.288466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" event={"ID":"bd5bfabf-1f65-4085-8bff-d722ea96b547","Type":"ContainerStarted","Data":"7cdc7c0bd5d49bcac61227a51bae51187e73b4a8503336746d94778e65db1b20"} Jul 07 14:31:09.289055 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.289033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:09.290865 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.290840 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="9b8affd55c56b88427cc1171b3bcc180d8df29e340a414c5794bcb88bc96f6e9" exitCode=0 Jul 07 14:31:09.290967 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.290887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"9b8affd55c56b88427cc1171b3bcc180d8df29e340a414c5794bcb88bc96f6e9"} Jul 07 14:31:09.354459 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.354407 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" podStartSLOduration=10.946899095 podStartE2EDuration="30.35439388s" totalImagesPullingTime="19.407494785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:09.324406264 +0000 UTC m=+30.835016196" watchObservedRunningTime="2026-07-07 14:31:09.35439388 +0000 UTC m=+30.865003813" Jul 07 14:31:09.999488 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.999452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qr6db"] Jul 07 14:31:09.999659 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:09.999560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:09.999721 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:09.999659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:10.002710 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:10.002570 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfnlt"] Jul 07 14:31:10.002710 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:10.002676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:10.002919 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:10.002885 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:10.003240 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:10.003221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wnzlh"] Jul 07 14:31:10.003321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:10.003294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:10.003387 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:10.003370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:11.297212 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:11.297173 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="611def33d6fab28d0a1998b0b2b10c9e85129bfe1658b67572a32d206b929680" exitCode=0 Jul 07 14:31:11.297566 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:11.297223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"611def33d6fab28d0a1998b0b2b10c9e85129bfe1658b67572a32d206b929680"} Jul 07 14:31:12.032870 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.032844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:12.033013 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.032844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:12.033013 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.032939 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:12.033102 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.032844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:12.033102 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.033032 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:12.033164 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.033106 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:12.302236 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.302209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerStarted","Data":"c286f098fd16e46f86ccbc5793d393f9e8f2ebe16b7bac63ce0499b78d587bed"} Jul 07 14:31:12.631875 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.631841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:12.631875 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.631892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:12.632120 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.631980 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:31:12.632120 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.631983 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:31:12.632120 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.632035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs podName:b5b9395b-9d6a-47d3-bd13-595e8d06fbb5 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.632019356 +0000 UTC m=+66.142629265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs") pod "network-metrics-daemon-kfnlt" (UID: "b5b9395b-9d6a-47d3-bd13-595e8d06fbb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:31:12.632120 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.632051 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret podName:e2184369-b00f-42bd-b2f7-c44c7a551487 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.632042869 +0000 UTC m=+66.142652778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret") pod "global-pull-secret-syncer-qr6db" (UID: "e2184369-b00f-42bd-b2f7-c44c7a551487") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:31:12.832962 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:12.832930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:12.833121 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.833078 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:31:12.833121 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.833094 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:31:12.833121 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.833103 2562 projected.go:196] Error preparing data for projected volume kube-api-access-7mp47 for pod openshift-network-diagnostics/network-check-target-wnzlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:31:12.833224 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:12.833151 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47 podName:0d1b85e4-9cd3-41f8-a465-9e8463a171cb nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.833137757 +0000 UTC m=+66.343747665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mp47" (UniqueName: "kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47") pod "network-check-target-wnzlh" (UID: "0d1b85e4-9cd3-41f8-a465-9e8463a171cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:31:13.307012 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:13.306976 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="c286f098fd16e46f86ccbc5793d393f9e8f2ebe16b7bac63ce0499b78d587bed" exitCode=0 Jul 07 14:31:13.307381 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:13.307021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"c286f098fd16e46f86ccbc5793d393f9e8f2ebe16b7bac63ce0499b78d587bed"} Jul 07 14:31:14.033228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:14.033195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:14.033418 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:14.033234 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:14.033418 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:14.033243 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:14.033418 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:14.033331 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:14.033559 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:14.033485 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:14.033604 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:14.033582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:16.033209 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:16.033170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:16.033209 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:16.033207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:16.033853 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:16.033284 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:16.033853 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:16.033349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:16.033853 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:16.033457 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:16.033853 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:16.033562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:18.033123 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:18.033091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:18.033123 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:18.033128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:18.033596 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:18.033202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:18.033596 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:18.033253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:18.033596 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:18.033321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:18.033596 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:18.033418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:18.321412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:18.321334 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="bc7ef6f3a3a5a97c1222cc5a10c07833243d3d828fc2c41b32ac15ca21caa236" exitCode=0 Jul 07 14:31:18.321412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:18.321392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"bc7ef6f3a3a5a97c1222cc5a10c07833243d3d828fc2c41b32ac15ca21caa236"} Jul 07 14:31:19.326652 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:19.326615 2562 generic.go:356] "Generic (PLEG): container finished" podID="baca779b-29ce-4c62-b103-92060d0a3104" containerID="eb4ac66b2244f40563651cd568f40873e09435df06d5ebb22557fe936c3b5b86" exitCode=0 Jul 07 14:31:19.327154 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:19.326670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerDied","Data":"eb4ac66b2244f40563651cd568f40873e09435df06d5ebb22557fe936c3b5b86"} Jul 07 14:31:20.033221 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:20.033186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:20.033416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:20.033295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:20.033416 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:20.033307 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:20.033416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:20.033322 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:20.033416 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:20.033393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:20.033641 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:20.033468 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:20.332053 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:20.331969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" event={"ID":"baca779b-29ce-4c62-b103-92060d0a3104","Type":"ContainerStarted","Data":"e39bab1508b8d6d835b81635ff2bbcc64ecfc29e9ebb44a53da48d45463fba47"} Jul 07 14:31:20.359288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:20.359241 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9q5gb" podStartSLOduration=10.400901404 podStartE2EDuration="41.359229531s" totalImagesPullingTime="30.958328127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:20.358985961 +0000 UTC m=+41.869595891" watchObservedRunningTime="2026-07-07 14:31:20.359229531 +0000 UTC m=+41.869839463" Jul 07 14:31:22.033156 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:22.033122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:22.033627 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:22.033169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:22.033627 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:22.033141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:22.033627 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:22.033241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:22.033627 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:22.033295 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:22.033627 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:22.033380 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:24.033481 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:24.033447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:24.033882 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:24.033487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:24.033882 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:24.033537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:24.033882 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:24.033548 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:24.033882 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:24.033603 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:24.033882 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:24.033664 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:26.032937 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:26.032902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:26.033439 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:26.032902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:26.033439 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:26.033117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:26.033439 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:26.032904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:26.033439 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:26.033202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:26.033439 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:26.032999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:28.032956 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:28.032922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:28.032956 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:28.032961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:28.033344 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:28.033036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:28.033344 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:28.033045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:28.033344 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:28.033113 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:28.033344 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:28.033182 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:30.033106 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:30.033069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:30.033106 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:30.033089 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:30.033529 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:30.033097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:30.033529 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:30.033161 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:30.033529 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:30.033254 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:30.033529 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:30.033330 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:32.032835 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:32.032806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:32.033264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:32.032844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:32.033264 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:32.032892 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:32.033264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:32.032844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:32.033264 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:32.032940 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:32.033264 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:32.033008 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:34.032992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:34.032953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:34.033385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:34.032970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:34.033385 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:34.033066 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:34.033385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:34.033081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:34.033385 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:34.033184 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:34.033385 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:34.033261 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:36.033877 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:36.033842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:36.033877 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:36.033878 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:36.034389 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:36.033949 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:36.034389 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:36.033953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:36.034389 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:36.034049 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:36.034389 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:36.034156 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:38.032895 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.032865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:38.033269 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.032962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:38.033269 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.032992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:38.033269 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:38.032989 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wnzlh" podUID="0d1b85e4-9cd3-41f8-a465-9e8463a171cb" Jul 07 14:31:38.033269 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:38.033084 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfnlt" podUID="b5b9395b-9d6a-47d3-bd13-595e8d06fbb5" Jul 07 14:31:38.033269 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:38.033151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr6db" podUID="e2184369-b00f-42bd-b2f7-c44c7a551487" Jul 07 14:31:38.114370 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.114297 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-89.ec2.internal" event="NodeReady" Jul 07 14:31:38.114492 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.114424 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:31:38.204600 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.204572 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jvtn5"] Jul 07 14:31:38.223834 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.223806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.226785 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.226749 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:31:38.227113 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.227092 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-swbcl\"" Jul 07 14:31:38.227194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.227089 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:31:38.227336 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.227312 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:31:38.228593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.228570 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvtn5"] Jul 07 14:31:38.231332 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.231314 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:31:38.242530 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.242511 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4v87"] Jul 07 14:31:38.274490 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.274463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4v87"] Jul 07 14:31:38.274617 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.274554 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.283630 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.283610 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:31:38.283778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.283671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:31:38.283868 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.283809 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jh6qq\"" Jul 07 14:31:38.285046 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.285024 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4lgwn"] Jul 07 14:31:38.318456 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.318416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lgwn"] Jul 07 14:31:38.318608 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.318539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.320284 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-metrics-tls\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.320413 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-tmp-dir\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.320413 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxs2\" (UniqueName: \"kubernetes.io/projected/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-kube-api-access-mrxs2\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.320482 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.320482 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djj52\" (UniqueName: \"kubernetes.io/projected/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-api-access-djj52\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.320482 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-crio-socket\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.320593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-config-volume\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.320593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-data-volume\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.320593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.320581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.329452 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.329433 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:31:38.329452 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.329441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8shmn\"" Jul 07 14:31:38.329604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.329441 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:31:38.329604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.329544 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:31:38.421787 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.421787 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djj52\" (UniqueName: \"kubernetes.io/projected/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-api-access-djj52\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65818df9-6f62-4e55-aafc-a2c1b34381e4-cert\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-crio-socket\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-config-volume\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-data-volume\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-metrics-tls\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.422010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.421983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-tmp-dir\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.422334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxs2\" (UniqueName: \"kubernetes.io/projected/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-kube-api-access-mrxs2\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.422334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-crio-socket\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plh74\" (UniqueName: \"kubernetes.io/projected/65818df9-6f62-4e55-aafc-a2c1b34381e4-kube-api-access-plh74\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.422334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-data-volume\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-tmp-dir\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.422536 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422370 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.422536 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.422442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-config-volume\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.425987 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.425964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-metrics-tls\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.426094 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.425998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.449743 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.449671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxs2\" (UniqueName: \"kubernetes.io/projected/c3011c07-ddb6-47d6-aa0d-7c74fcca2481-kube-api-access-mrxs2\") pod \"dns-default-n4v87\" (UID: \"c3011c07-ddb6-47d6-aa0d-7c74fcca2481\") " pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.450239 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.450222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djj52\" (UniqueName: \"kubernetes.io/projected/a8e2e783-a1ae-4284-98f4-f2ecf009e4a5-kube-api-access-djj52\") pod \"insights-runtime-extractor-jvtn5\" (UID: \"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5\") " pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.522386 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.522351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plh74\" (UniqueName: \"kubernetes.io/projected/65818df9-6f62-4e55-aafc-a2c1b34381e4-kube-api-access-plh74\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.522537 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.522407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65818df9-6f62-4e55-aafc-a2c1b34381e4-cert\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.524569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.524549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65818df9-6f62-4e55-aafc-a2c1b34381e4-cert\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.530691 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.530671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plh74\" (UniqueName: \"kubernetes.io/projected/65818df9-6f62-4e55-aafc-a2c1b34381e4-kube-api-access-plh74\") pod \"ingress-canary-4lgwn\" (UID: \"65818df9-6f62-4e55-aafc-a2c1b34381e4\") " pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.533462 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.533447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvtn5" Jul 07 14:31:38.582869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.582844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:38.627249 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.627219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lgwn" Jul 07 14:31:38.788895 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.788874 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4v87"] Jul 07 14:31:38.791002 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:38.790951 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3011c07_ddb6_47d6_aa0d_7c74fcca2481.slice/crio-56881dd7bc5bc1d1df7ef56a7448d1aa2b4f582aaf6e071376c9847d7928eab2 WatchSource:0}: Error finding container 56881dd7bc5bc1d1df7ef56a7448d1aa2b4f582aaf6e071376c9847d7928eab2: Status 404 returned error can't find the container with id 56881dd7bc5bc1d1df7ef56a7448d1aa2b4f582aaf6e071376c9847d7928eab2 Jul 07 14:31:38.800782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.800744 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvtn5"] Jul 07 14:31:38.804228 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:38.804205 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e2e783_a1ae_4284_98f4_f2ecf009e4a5.slice/crio-f542a85e9471bf88d84017e5ca50425e32a191c44fc961d54108645672fd0077 WatchSource:0}: Error finding container f542a85e9471bf88d84017e5ca50425e32a191c44fc961d54108645672fd0077: Status 404 returned error can't find the container with id f542a85e9471bf88d84017e5ca50425e32a191c44fc961d54108645672fd0077 Jul 07 14:31:38.826227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:38.826198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lgwn"] Jul 07 14:31:38.830778 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:38.830733 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65818df9_6f62_4e55_aafc_a2c1b34381e4.slice/crio-aa29f75537954335bda8faff124d53f1f66ee4925b161c86f26282c778f42fa6 WatchSource:0}: Error finding container aa29f75537954335bda8faff124d53f1f66ee4925b161c86f26282c778f42fa6: Status 404 returned error can't find the container with id aa29f75537954335bda8faff124d53f1f66ee4925b161c86f26282c778f42fa6 Jul 07 14:31:39.375420 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:39.375384 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lgwn" event={"ID":"65818df9-6f62-4e55-aafc-a2c1b34381e4","Type":"ContainerStarted","Data":"aa29f75537954335bda8faff124d53f1f66ee4925b161c86f26282c778f42fa6"} Jul 07 14:31:39.376801 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:39.376753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4v87" event={"ID":"c3011c07-ddb6-47d6-aa0d-7c74fcca2481","Type":"ContainerStarted","Data":"56881dd7bc5bc1d1df7ef56a7448d1aa2b4f582aaf6e071376c9847d7928eab2"} Jul 07 14:31:39.377891 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:39.377864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvtn5" event={"ID":"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5","Type":"ContainerStarted","Data":"f542a85e9471bf88d84017e5ca50425e32a191c44fc961d54108645672fd0077"} Jul 07 14:31:40.033432 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.033385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:40.033874 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.033855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:40.034330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.034313 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:40.038523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.038497 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:31:40.038854 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.038835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:31:40.038942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.038904 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r5ldv\"" Jul 07 14:31:40.039096 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.039077 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:31:40.039157 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.039123 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:31:40.039274 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.039252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pt9ld\"" Jul 07 14:31:40.322447 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:40.322346 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmxqn" Jul 07 14:31:41.649417 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.649387 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:31:41.692596 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.692562 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:31:41.692786 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.692683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.695963 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.695927 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:31:41.696171 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696012 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sd4hz\"" Jul 07 14:31:41.696171 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:31:41.696815 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696653 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:31:41.696815 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696725 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:31:41.696815 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696720 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:31:41.696815 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.696657 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:31:41.697219 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.697200 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:31:41.702024 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.702006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:31:41.755386 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755547 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755547 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755547 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv45x\" (UniqueName: \"kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755677 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755677 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.755677 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.755637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856558 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856558 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856558 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856558 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856788 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.856788 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.856601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv45x\" (UniqueName: \"kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.857143 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.857119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.857490 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.857461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.857649 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.857624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.857944 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.857921 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.859680 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.859656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.859781 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.859743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:41.866637 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:41.866612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv45x\" (UniqueName: \"kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x\") pod \"console-b5db8559b-ss7zs\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:42.004169 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:42.004125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:31:44.259326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.259141 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:31:44.393022 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.392920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvtn5" event={"ID":"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5","Type":"ContainerStarted","Data":"28f7dc40f125f9795750dcb48781ffc2ae9033ed65cc5ed4e9b664b0ed6e4404"} Jul 07 14:31:44.394683 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.394660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4v87" event={"ID":"c3011c07-ddb6-47d6-aa0d-7c74fcca2481","Type":"ContainerStarted","Data":"649682ad06e0eabcff64fdd992683e1a51f4d55a9b17322f5f05ae2617e6d93e"} Jul 07 14:31:44.394829 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.394699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4v87" event={"ID":"c3011c07-ddb6-47d6-aa0d-7c74fcca2481","Type":"ContainerStarted","Data":"65ef3d4919efa7b8fef4e96326b320774ba0230078f2699e1c2fc8b15fc89f68"} Jul 07 14:31:44.394897 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.394875 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:44.399927 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.399890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5db8559b-ss7zs" event={"ID":"eeb445b3-4477-44f0-a722-79a149fc735d","Type":"ContainerStarted","Data":"8b2dea97f9f25e234a36a14460d4e597d92730d59a4d91463f1b058cc8c256f7"} Jul 07 14:31:44.401273 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.401251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lgwn" event={"ID":"65818df9-6f62-4e55-aafc-a2c1b34381e4","Type":"ContainerStarted","Data":"e5970147df3b2073ab2b1888009889269106e85633e50feb3c77801c6bc03f9a"} Jul 07 14:31:44.424358 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.424308 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4v87" podStartSLOduration=1.105397556 podStartE2EDuration="6.424293241s" totalImagesPullingTime="5.318895685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:44.424226193 +0000 UTC m=+65.934836125" watchObservedRunningTime="2026-07-07 14:31:44.424293241 +0000 UTC m=+65.934903172" Jul 07 14:31:44.465865 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.465811 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4lgwn" podStartSLOduration=1.185299359 podStartE2EDuration="6.465795199s" totalImagesPullingTime="5.28049584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:44.465391927 +0000 UTC m=+65.976001872" watchObservedRunningTime="2026-07-07 14:31:44.465795199 +0000 UTC m=+65.976405130" Jul 07 14:31:44.680292 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.680195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:44.680292 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.680258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:44.683076 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.683052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2184369-b00f-42bd-b2f7-c44c7a551487-original-pull-secret\") pod \"global-pull-secret-syncer-qr6db\" (UID: \"e2184369-b00f-42bd-b2f7-c44c7a551487\") " pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:44.683174 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.683104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b9395b-9d6a-47d3-bd13-595e8d06fbb5-metrics-certs\") pod \"network-metrics-daemon-kfnlt\" (UID: \"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5\") " pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:44.864969 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.864932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfnlt" Jul 07 14:31:44.874049 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.874016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr6db" Jul 07 14:31:44.882481 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.882388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:44.886038 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:44.885969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mp47\" (UniqueName: \"kubernetes.io/projected/0d1b85e4-9cd3-41f8-a465-9e8463a171cb-kube-api-access-7mp47\") pod \"network-check-target-wnzlh\" (UID: \"0d1b85e4-9cd3-41f8-a465-9e8463a171cb\") " pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:45.026024 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.025628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfnlt"] Jul 07 14:31:45.047245 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.047169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qr6db"] Jul 07 14:31:45.055143 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:45.055077 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b9395b_9d6a_47d3_bd13_595e8d06fbb5.slice/crio-e6c7806af99bc468f367a9df171162d232c75ec7be7c67d84ea2f7894a537730 WatchSource:0}: Error finding container e6c7806af99bc468f367a9df171162d232c75ec7be7c67d84ea2f7894a537730: Status 404 returned error can't find the container with id e6c7806af99bc468f367a9df171162d232c75ec7be7c67d84ea2f7894a537730 Jul 07 14:31:45.055400 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:45.055366 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2184369_b00f_42bd_b2f7_c44c7a551487.slice/crio-2d0991740daa6df41b3d67b255e634ba8eb021f56baf16bed9c33a530c0f72ff WatchSource:0}: Error finding container 2d0991740daa6df41b3d67b255e634ba8eb021f56baf16bed9c33a530c0f72ff: Status 404 returned error can't find the container with id 2d0991740daa6df41b3d67b255e634ba8eb021f56baf16bed9c33a530c0f72ff Jul 07 14:31:45.155823 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.155799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:45.299326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.299297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wnzlh"] Jul 07 14:31:45.302267 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:45.302239 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1b85e4_9cd3_41f8_a465_9e8463a171cb.slice/crio-c4c141c0c7706490bf67c18c2ed3b8682f2911977abeeae44a7480f4dba19d05 WatchSource:0}: Error finding container c4c141c0c7706490bf67c18c2ed3b8682f2911977abeeae44a7480f4dba19d05: Status 404 returned error can't find the container with id c4c141c0c7706490bf67c18c2ed3b8682f2911977abeeae44a7480f4dba19d05 Jul 07 14:31:45.407326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.407287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qr6db" event={"ID":"e2184369-b00f-42bd-b2f7-c44c7a551487","Type":"ContainerStarted","Data":"2d0991740daa6df41b3d67b255e634ba8eb021f56baf16bed9c33a530c0f72ff"} Jul 07 14:31:45.408611 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.408582 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfnlt" event={"ID":"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5","Type":"ContainerStarted","Data":"e6c7806af99bc468f367a9df171162d232c75ec7be7c67d84ea2f7894a537730"} Jul 07 14:31:45.410482 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.410459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvtn5" event={"ID":"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5","Type":"ContainerStarted","Data":"bbcd08b49686b418b9d5b6e012e007f99917e8bd7a11cfa2aba72f89467d6a3b"} Jul 07 14:31:45.411675 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:45.411649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wnzlh" event={"ID":"0d1b85e4-9cd3-41f8-a465-9e8463a171cb","Type":"ContainerStarted","Data":"c4c141c0c7706490bf67c18c2ed3b8682f2911977abeeae44a7480f4dba19d05"} Jul 07 14:31:47.176946 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.176901 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s"] Jul 07 14:31:47.183416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.183391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.187541 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.187516 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:31:47.187692 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.187635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 14:31:47.188056 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.188007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5xm6m\"" Jul 07 14:31:47.188257 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.188241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 14:31:47.188486 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.188471 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:31:47.189640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.189620 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:31:47.193885 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.193555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s"] Jul 07 14:31:47.303498 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.303267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.303498 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.303332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6hnm\" (UniqueName: \"kubernetes.io/projected/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-kube-api-access-q6hnm\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.303498 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.303366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.303498 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.303396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.404123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.404182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6hnm\" (UniqueName: \"kubernetes.io/projected/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-kube-api-access-q6hnm\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.404212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.404249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:47.404731 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 14:31:47.404992 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:31:47.404817 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls podName:c7f8dbdd-4a94-4777-85c6-fc27ccd54b03 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:47.904795531 +0000 UTC m=+69.415405443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-brn9s" (UID: "c7f8dbdd-4a94-4777-85c6-fc27ccd54b03") : secret "prometheus-operator-tls" not found Jul 07 14:31:47.405408 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.405029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.407808 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.407784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.425422 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.424980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6hnm\" (UniqueName: \"kubernetes.io/projected/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-kube-api-access-q6hnm\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.909294 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.909260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:47.911667 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:47.911640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7f8dbdd-4a94-4777-85c6-fc27ccd54b03-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brn9s\" (UID: \"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:48.097471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:48.097437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" Jul 07 14:31:51.677315 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:51.677289 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s"] Jul 07 14:31:51.681639 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:51.681598 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f8dbdd_4a94_4777_85c6_fc27ccd54b03.slice/crio-fc285c5bf7ddc5630969f67485ea853d1857e4cd63f929420b4706a319880aee WatchSource:0}: Error finding container fc285c5bf7ddc5630969f67485ea853d1857e4cd63f929420b4706a319880aee: Status 404 returned error can't find the container with id fc285c5bf7ddc5630969f67485ea853d1857e4cd63f929420b4706a319880aee Jul 07 14:31:52.441099 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.441059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" event={"ID":"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03","Type":"ContainerStarted","Data":"fc285c5bf7ddc5630969f67485ea853d1857e4cd63f929420b4706a319880aee"} Jul 07 14:31:52.442872 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.442788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qr6db" event={"ID":"e2184369-b00f-42bd-b2f7-c44c7a551487","Type":"ContainerStarted","Data":"32a308ef49e83b84762c486931539d29968ed1dad4640bdfb1809c6f031ca77a"} Jul 07 14:31:52.444900 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.444869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfnlt" event={"ID":"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5","Type":"ContainerStarted","Data":"1d41faead9663c6c21337920e6470e8d87baeb55650221d53fca59f181a3f3d1"} Jul 07 14:31:52.445029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.444925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfnlt" event={"ID":"b5b9395b-9d6a-47d3-bd13-595e8d06fbb5","Type":"ContainerStarted","Data":"68a566e4d4d93e6d07c43d15e5811d4651419686aef14b736b90b69b85c2a745"} Jul 07 14:31:52.447112 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.447082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvtn5" event={"ID":"a8e2e783-a1ae-4284-98f4-f2ecf009e4a5","Type":"ContainerStarted","Data":"d5ec1fe100b7c7f2e2e98c264f6f49afe5b5bc570bae2756ffb998050ad8214b"} Jul 07 14:31:52.448675 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.448646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wnzlh" event={"ID":"0d1b85e4-9cd3-41f8-a465-9e8463a171cb","Type":"ContainerStarted","Data":"cced71c4d66df5e6f23c59ad34b87095a775236c2c41366f53163501cc5af987"} Jul 07 14:31:52.448797 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.448722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:31:52.450258 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.450239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5db8559b-ss7zs" event={"ID":"eeb445b3-4477-44f0-a722-79a149fc735d","Type":"ContainerStarted","Data":"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4"} Jul 07 14:31:52.460569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.460529 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qr6db" podStartSLOduration=66.949454602 podStartE2EDuration="1m13.460514857s" totalImagesPullingTime="6.511060255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:52.459522965 +0000 UTC m=+73.970132896" watchObservedRunningTime="2026-07-07 14:31:52.460514857 +0000 UTC m=+73.971124787" Jul 07 14:31:52.478739 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.478686 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kfnlt" podStartSLOduration=67.013929227 podStartE2EDuration="1m13.47866827s" totalImagesPullingTime="6.464739043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:52.477224405 +0000 UTC m=+73.987834337" watchObservedRunningTime="2026-07-07 14:31:52.47866827 +0000 UTC m=+73.989278203" Jul 07 14:31:52.496449 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.496346 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jvtn5" podStartSLOduration=1.9354829599999999 podStartE2EDuration="14.496327034s" totalImagesPullingTime="12.560844074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:52.495968263 +0000 UTC m=+74.006578196" watchObservedRunningTime="2026-07-07 14:31:52.496327034 +0000 UTC m=+74.006936963" Jul 07 14:31:52.517487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:52.517432 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5db8559b-ss7zs" podStartSLOduration=4.242645618 podStartE2EDuration="11.517413404s" totalImagesPullingTime="7.274767786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:52.517127807 +0000 UTC m=+74.027737739" watchObservedRunningTime="2026-07-07 14:31:52.517413404 +0000 UTC m=+74.028023335" Jul 07 14:31:53.456376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:53.456273 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" event={"ID":"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03","Type":"ContainerStarted","Data":"7cde226cdfda9875e05726315113115f4cc5f5d7d7c8c84782cbc098f0725e18"} Jul 07 14:31:53.456376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:53.456338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" event={"ID":"c7f8dbdd-4a94-4777-85c6-fc27ccd54b03","Type":"ContainerStarted","Data":"7168ed88e1f2dec4b18432df0cd668145382949ee705717b4e34d49e8f102fa9"} Jul 07 14:31:53.477000 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:53.476949 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brn9s" podStartSLOduration=5.004083444 podStartE2EDuration="6.476932993s" totalImagesPullingTime="1.472849549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:53.47689498 +0000 UTC m=+74.987504911" watchObservedRunningTime="2026-07-07 14:31:53.476932993 +0000 UTC m=+74.987542923" Jul 07 14:31:53.477125 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:53.477034 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wnzlh" podStartSLOduration=68.236291022 podStartE2EDuration="1m14.477029592s" totalImagesPullingTime="6.24073857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:52.535781839 +0000 UTC m=+74.046391775" watchObservedRunningTime="2026-07-07 14:31:53.477029592 +0000 UTC m=+74.987639523" Jul 07 14:31:54.413778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:54.413730 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4v87" Jul 07 14:31:55.745193 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.745160 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm"] Jul 07 14:31:55.747225 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.747210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.751547 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.751528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 14:31:55.751547 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.751537 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7qxm4\"" Jul 07 14:31:55.752426 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.752405 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 14:31:55.788012 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.787980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm"] Jul 07 14:31:55.863013 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.862981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ls2w\" (UniqueName: \"kubernetes.io/projected/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-kube-api-access-5ls2w\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.863013 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.863014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.863207 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.863033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.863207 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.863087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.915225 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.915194 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lv8vv"] Jul 07 14:31:55.917234 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.917215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:55.922906 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.922886 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:31:55.923368 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.923233 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:31:55.923368 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.923339 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:31:55.923493 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.923417 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7sznj\"" Jul 07 14:31:55.963412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.963386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ls2w\" (UniqueName: \"kubernetes.io/projected/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-kube-api-access-5ls2w\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.963609 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.963425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.963609 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.963451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.963609 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.963482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.964247 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.964219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.965883 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.965859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:55.965883 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:55.965870 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:56.003446 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.003379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ls2w\" (UniqueName: \"kubernetes.io/projected/7d27e2f3-c4e0-441e-b8c0-0892446fdebc-kube-api-access-5ls2w\") pod \"openshift-state-metrics-54cf96dfcf-b6dlm\" (UID: \"7d27e2f3-c4e0-441e-b8c0-0892446fdebc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:56.056210 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.056168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" Jul 07 14:31:56.064425 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-tls\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-sys\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064653 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr2fv\" (UniqueName: \"kubernetes.io/projected/a35ab640-974c-48b7-a73c-d06106c18d20-kube-api-access-cr2fv\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064653 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-wtmp\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-metrics-client-ca\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-textfile\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.064924 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.064795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-root\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165120 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr2fv\" (UniqueName: \"kubernetes.io/projected/a35ab640-974c-48b7-a73c-d06106c18d20-kube-api-access-cr2fv\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-wtmp\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-metrics-client-ca\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-textfile\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-root\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-tls\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-sys\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165288 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165694 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-wtmp\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165694 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-sys\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165694 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35ab640-974c-48b7-a73c-d06106c18d20-root\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165694 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-textfile\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165901 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-metrics-client-ca\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.165957 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.165906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.167553 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.167531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.167635 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.167623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35ab640-974c-48b7-a73c-d06106c18d20-node-exporter-tls\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.181758 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.181735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr2fv\" (UniqueName: \"kubernetes.io/projected/a35ab640-974c-48b7-a73c-d06106c18d20-kube-api-access-cr2fv\") pod \"node-exporter-lv8vv\" (UID: \"a35ab640-974c-48b7-a73c-d06106c18d20\") " pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.185939 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.185915 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm"] Jul 07 14:31:56.188087 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:56.188064 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d27e2f3_c4e0_441e_b8c0_0892446fdebc.slice/crio-325e1fe998cabe4c3b80516dee25e997367c4ad14cdc4896b13ea4cf57d83dc9 WatchSource:0}: Error finding container 325e1fe998cabe4c3b80516dee25e997367c4ad14cdc4896b13ea4cf57d83dc9: Status 404 returned error can't find the container with id 325e1fe998cabe4c3b80516dee25e997367c4ad14cdc4896b13ea4cf57d83dc9 Jul 07 14:31:56.225548 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.225500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lv8vv" Jul 07 14:31:56.236132 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:56.236102 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35ab640_974c_48b7_a73c_d06106c18d20.slice/crio-ce106a71d82a288e207052b6c30b6eadbeff8548b2d3a3cc1481a9524305bca8 WatchSource:0}: Error finding container ce106a71d82a288e207052b6c30b6eadbeff8548b2d3a3cc1481a9524305bca8: Status 404 returned error can't find the container with id ce106a71d82a288e207052b6c30b6eadbeff8548b2d3a3cc1481a9524305bca8 Jul 07 14:31:56.468392 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.468350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" event={"ID":"7d27e2f3-c4e0-441e-b8c0-0892446fdebc","Type":"ContainerStarted","Data":"37aef01b041125b2babe02754b999662b3f22fd4470438f0efb3211ea3b6d7b1"} Jul 07 14:31:56.468868 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.468470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" event={"ID":"7d27e2f3-c4e0-441e-b8c0-0892446fdebc","Type":"ContainerStarted","Data":"d278e98ea4a2088d337fba111567dd8e2ff9dcfe7d33e69782f78ee91594386f"} Jul 07 14:31:56.468868 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.468515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" event={"ID":"7d27e2f3-c4e0-441e-b8c0-0892446fdebc","Type":"ContainerStarted","Data":"325e1fe998cabe4c3b80516dee25e997367c4ad14cdc4896b13ea4cf57d83dc9"} Jul 07 14:31:56.470057 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.470030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lv8vv" event={"ID":"a35ab640-974c-48b7-a73c-d06106c18d20","Type":"ContainerStarted","Data":"ce106a71d82a288e207052b6c30b6eadbeff8548b2d3a3cc1481a9524305bca8"} Jul 07 14:31:56.653664 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.653584 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:31:56.656146 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.656121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.658663 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.658640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:31:56.658823 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.658803 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:31:56.659212 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659189 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:31:56.659212 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7k72l\"" Jul 07 14:31:56.659383 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659221 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:31:56.659383 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:31:56.659383 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659201 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:31:56.659527 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659513 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:31:56.659563 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659535 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:31:56.659819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.659806 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:31:56.677829 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.677809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:31:56.768758 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.768758 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2s5m\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.768998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.769082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.769124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.769306 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.769151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2s5m\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.870750 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.870923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.871399 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.871234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.872250 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.871890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.872250 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.871984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.873895 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.873849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.874510 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.874450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.875622 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.875569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.875974 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.875927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.876077 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.875979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.876440 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.876186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.876440 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.876302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.876935 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.876914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.877010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.876994 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.880755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.880737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2s5m\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m\") pod \"alertmanager-main-0\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:56.965522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:56.965447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:31:57.115274 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:57.115180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:31:57.250329 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:57.250291 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4ed3bf_0e4a_4ed4_8ae6_91dff4ad7065.slice/crio-cbf486bb6b4dc5fb0216cab04b44444d89121a34ad87828cb06ee25f36c25c56 WatchSource:0}: Error finding container cbf486bb6b4dc5fb0216cab04b44444d89121a34ad87828cb06ee25f36c25c56: Status 404 returned error can't find the container with id cbf486bb6b4dc5fb0216cab04b44444d89121a34ad87828cb06ee25f36c25c56 Jul 07 14:31:57.476725 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:57.476689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lv8vv" event={"ID":"a35ab640-974c-48b7-a73c-d06106c18d20","Type":"ContainerStarted","Data":"282d7f7fc3be681eccb707e763b4c03d9ed6d86ee489540247549c60ed7334c3"} Jul 07 14:31:57.478126 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:57.478098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"cbf486bb6b4dc5fb0216cab04b44444d89121a34ad87828cb06ee25f36c25c56"} Jul 07 14:31:58.485934 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.485899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" event={"ID":"7d27e2f3-c4e0-441e-b8c0-0892446fdebc","Type":"ContainerStarted","Data":"f25f60525d5996e246ec08e20a33be6b981c842b6b686a71c06c813f0a09b13b"} Jul 07 14:31:58.488118 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.488084 2562 generic.go:356] "Generic (PLEG): container finished" podID="a35ab640-974c-48b7-a73c-d06106c18d20" containerID="282d7f7fc3be681eccb707e763b4c03d9ed6d86ee489540247549c60ed7334c3" exitCode=0 Jul 07 14:31:58.488256 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.488164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lv8vv" event={"ID":"a35ab640-974c-48b7-a73c-d06106c18d20","Type":"ContainerDied","Data":"282d7f7fc3be681eccb707e763b4c03d9ed6d86ee489540247549c60ed7334c3"} Jul 07 14:31:58.511153 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.511103 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-b6dlm" podStartSLOduration=2.164788711 podStartE2EDuration="3.511083452s" totalImagesPullingTime="1.346294741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:58.510227626 +0000 UTC m=+80.020837559" watchObservedRunningTime="2026-07-07 14:31:58.511083452 +0000 UTC m=+80.021693383" Jul 07 14:31:58.650710 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.650643 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5598f999d7-nfj5w"] Jul 07 14:31:58.655235 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.655216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.658639 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.658622 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 14:31:58.658962 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.658943 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 14:31:58.659165 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.659150 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tbqw6\"" Jul 07 14:31:58.659311 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.659291 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dp4ir2a377tk2\"" Jul 07 14:31:58.659555 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.659537 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 14:31:58.662491 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.662294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 14:31:58.662585 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.662318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 14:31:58.666276 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.666258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5598f999d7-nfj5w"] Jul 07 14:31:58.785754 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.785928 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.785928 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.785928 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.785928 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-grpc-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.786091 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae06dc57-5a10-4b77-96c5-0f4b450073f3-metrics-client-ca\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.786091 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.786091 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.785990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppcmb\" (UniqueName: \"kubernetes.io/projected/ae06dc57-5a10-4b77-96c5-0f4b450073f3-kube-api-access-ppcmb\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886512 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886672 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886672 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-grpc-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886672 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae06dc57-5a10-4b77-96c5-0f4b450073f3-metrics-client-ca\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886824 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886824 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppcmb\" (UniqueName: \"kubernetes.io/projected/ae06dc57-5a10-4b77-96c5-0f4b450073f3-kube-api-access-ppcmb\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886923 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.886923 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.886913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.887530 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.887501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae06dc57-5a10-4b77-96c5-0f4b450073f3-metrics-client-ca\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889341 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889446 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-grpc-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889549 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-tls\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889685 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.889739 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.889707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae06dc57-5a10-4b77-96c5-0f4b450073f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.897252 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.897234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppcmb\" (UniqueName: \"kubernetes.io/projected/ae06dc57-5a10-4b77-96c5-0f4b450073f3-kube-api-access-ppcmb\") pod \"thanos-querier-5598f999d7-nfj5w\" (UID: \"ae06dc57-5a10-4b77-96c5-0f4b450073f3\") " pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:58.965817 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:58.965781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:31:59.125118 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.125004 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5598f999d7-nfj5w"] Jul 07 14:31:59.129205 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:31:59.129178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae06dc57_5a10_4b77_96c5_0f4b450073f3.slice/crio-e819bd651f91960ec6d6a3e782e60e955b620bed3445472472879301e18704a4 WatchSource:0}: Error finding container e819bd651f91960ec6d6a3e782e60e955b620bed3445472472879301e18704a4: Status 404 returned error can't find the container with id e819bd651f91960ec6d6a3e782e60e955b620bed3445472472879301e18704a4 Jul 07 14:31:59.493829 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.493718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lv8vv" event={"ID":"a35ab640-974c-48b7-a73c-d06106c18d20","Type":"ContainerStarted","Data":"1a89d298a3c2d8614be0b20d45bc0a8511967ea1cdd899d389613ce01eb87634"} Jul 07 14:31:59.493829 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.493806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lv8vv" event={"ID":"a35ab640-974c-48b7-a73c-d06106c18d20","Type":"ContainerStarted","Data":"2c292582801d9c58cd05cd5df337df612f863bc42be06cd7e2cb04e30a1be38b"} Jul 07 14:31:59.494942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.494919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"e819bd651f91960ec6d6a3e782e60e955b620bed3445472472879301e18704a4"} Jul 07 14:31:59.496311 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.496289 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8" exitCode=0 Jul 07 14:31:59.496404 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.496371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8"} Jul 07 14:31:59.516336 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:31:59.516288 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lv8vv" podStartSLOduration=3.389806729 podStartE2EDuration="4.516272095s" totalImagesPullingTime="1.048949856s" totalInitContainerRuntime="77.51551ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:59.514930356 +0000 UTC m=+81.025540289" watchObservedRunningTime="2026-07-07 14:31:59.516272095 +0000 UTC m=+81.026882026" Jul 07 14:32:01.428304 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.428268 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:32:01.822660 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.822635 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:32:01.828412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.828393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.831180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.831158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 14:32:01.831658 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.831636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlml9\"" Jul 07 14:32:01.833014 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.832435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833190 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833246 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833200 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:32:01.833359 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833324 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 14:32:01.833861 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2r6jrh36be8gs\"" Jul 07 14:32:01.833957 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.833917 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 14:32:01.834468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.834291 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 14:32:01.834468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.834330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 14:32:01.834468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.834294 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 14:32:01.837621 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.836668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 14:32:01.842020 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.841999 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 14:32:01.847833 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.847811 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:32:01.915248 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915351 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915351 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915351 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjbgf\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.915812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:01.916246 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:01.915866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.005006 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.004972 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:32:02.016396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.016623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.016522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017151 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017241 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017401 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjbgf\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017401 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017401 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017401 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017401 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017618 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017618 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017618 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.017618 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.017550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.018161 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.018135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.019237 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.018267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.019237 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.019095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.019667 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.019510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.019936 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.019913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.019936 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.019916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.020588 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.020255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.020588 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.020451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.020588 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.020534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.020822 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.020596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.021503 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.021476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.022681 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.022631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.022681 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.022652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.023310 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.023288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.023498 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.023451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.023602 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.023550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.023602 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.023583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.024891 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.024872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.032138 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.032118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjbgf\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf\") pod \"prometheus-k8s-0\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.151248 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.151208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:02.350775 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.350679 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:32:02.354812 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:32:02.354784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b53f729_97b0_4393_b214_5c09bb9949f7.slice/crio-c9e95a2ec7f89a5f1299e472cdb86750a81b12d367f120128f5f35ac415fd9d3 WatchSource:0}: Error finding container c9e95a2ec7f89a5f1299e472cdb86750a81b12d367f120128f5f35ac415fd9d3: Status 404 returned error can't find the container with id c9e95a2ec7f89a5f1299e472cdb86750a81b12d367f120128f5f35ac415fd9d3 Jul 07 14:32:02.510342 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.510308 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" exitCode=0 Jul 07 14:32:02.510832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.510389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} Jul 07 14:32:02.510832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.510484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"c9e95a2ec7f89a5f1299e472cdb86750a81b12d367f120128f5f35ac415fd9d3"} Jul 07 14:32:02.513499 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.513469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"7d7387ef5dfc72945c31d77ab49fa81bb960c789a524c0df78a922117ba0d4c2"} Jul 07 14:32:02.513593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.513543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"45a64e87c359bcaaa985521e0294bd56a5569aca97273de41d6cfa3943c3b8af"} Jul 07 14:32:02.513593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.513588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"41d2a5aeb1df879e5f6cef1a079f01293b3bcb3922f342de640bef4b174a0fa5"} Jul 07 14:32:02.517383 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.517362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089"} Jul 07 14:32:02.517512 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.517422 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d"} Jul 07 14:32:02.517512 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.517449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1"} Jul 07 14:32:02.517512 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.517474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113"} Jul 07 14:32:02.517512 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:02.517507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492"} Jul 07 14:32:03.524047 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.524006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"ed59085a0c1b5b590b68f4291c80873db906f5433f4997f11fd3f6682aee54cb"} Jul 07 14:32:03.524504 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.524084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"2ff77208ebd862ed55f32805dd22b64e66b42ec66674ebe9fe32292f03ce42a9"} Jul 07 14:32:03.524504 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.524127 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:32:03.524504 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.524165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" event={"ID":"ae06dc57-5a10-4b77-96c5-0f4b450073f3","Type":"ContainerStarted","Data":"fdf806bb01773eb8fc6e0a60a77a556d119aa1be96e8a293606de56f571355f2"} Jul 07 14:32:03.531433 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.531390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerStarted","Data":"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2"} Jul 07 14:32:03.555960 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.555901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" podStartSLOduration=2.072096441 podStartE2EDuration="5.555885232s" totalImagesPullingTime="3.483788791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:03.55487796 +0000 UTC m=+85.065487891" watchObservedRunningTime="2026-07-07 14:32:03.555885232 +0000 UTC m=+85.066495163" Jul 07 14:32:03.588796 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:03.588729 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.264405862 podStartE2EDuration="7.588712782s" totalImagesPullingTime="4.304382235s" totalInitContainerRuntime="19.924685ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:03.587291095 +0000 UTC m=+85.097901025" watchObservedRunningTime="2026-07-07 14:32:03.588712782 +0000 UTC m=+85.099322713" Jul 07 14:32:07.553007 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.552973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} Jul 07 14:32:07.553442 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.553041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} Jul 07 14:32:07.553442 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.553069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} Jul 07 14:32:07.553442 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.553094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} Jul 07 14:32:07.553442 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.553117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} Jul 07 14:32:07.553442 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.553141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerStarted","Data":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} Jul 07 14:32:07.606593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:07.606526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.398092877 podStartE2EDuration="6.606505211s" totalImagesPullingTime="4.192227618s" totalInitContainerRuntime="16.184716ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:07.6046261 +0000 UTC m=+89.115236067" watchObservedRunningTime="2026-07-07 14:32:07.606505211 +0000 UTC m=+89.117115168" Jul 07 14:32:09.541802 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:09.541754 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5598f999d7-nfj5w" Jul 07 14:32:12.152226 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:12.152190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:32:23.459197 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:23.459168 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wnzlh" Jul 07 14:32:26.450454 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:26.450402 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b5db8559b-ss7zs" podUID="eeb445b3-4477-44f0-a722-79a149fc735d" containerName="console" containerID="cri-o://8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4" gracePeriod=15 Jul 07 14:32:27.232004 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.231972 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:32:27.327827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327744 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.327827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327801 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv45x\" (UniqueName: \"kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327845 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327861 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327878 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327906 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328029 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.327931 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert\") pod \"eeb445b3-4477-44f0-a722-79a149fc735d\" (UID: \"eeb445b3-4477-44f0-a722-79a149fc735d\") " Jul 07 14:32:27.328376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328311 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config" (OuterVolumeSpecName: "console-config") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:27.328492 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328455 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:27.328736 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328715 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-console-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.328736 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328725 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:27.328926 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328734 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-trusted-ca-bundle\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.328926 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.328828 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca" (OuterVolumeSpecName: "service-ca") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:27.330383 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.330362 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:32:27.330542 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.330521 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:32:27.330604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.330583 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x" (OuterVolumeSpecName: "kube-api-access-xv45x") pod "eeb445b3-4477-44f0-a722-79a149fc735d" (UID: "eeb445b3-4477-44f0-a722-79a149fc735d"). InnerVolumeSpecName "kube-api-access-xv45x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:32:27.429698 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.429664 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-serving-cert\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.429698 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.429692 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-service-ca\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.429698 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.429702 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eeb445b3-4477-44f0-a722-79a149fc735d-oauth-serving-cert\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.429961 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.429711 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eeb445b3-4477-44f0-a722-79a149fc735d-console-oauth-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.429961 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.429719 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv45x\" (UniqueName: \"kubernetes.io/projected/eeb445b3-4477-44f0-a722-79a149fc735d-kube-api-access-xv45x\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:32:27.635130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.635042 2562 generic.go:356] "Generic (PLEG): container finished" podID="eeb445b3-4477-44f0-a722-79a149fc735d" containerID="8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4" exitCode=0 Jul 07 14:32:27.635130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.635112 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5db8559b-ss7zs" Jul 07 14:32:27.635600 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.635109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5db8559b-ss7zs" event={"ID":"eeb445b3-4477-44f0-a722-79a149fc735d","Type":"ContainerDied","Data":"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4"} Jul 07 14:32:27.635600 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.635256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5db8559b-ss7zs" event={"ID":"eeb445b3-4477-44f0-a722-79a149fc735d","Type":"ContainerDied","Data":"8b2dea97f9f25e234a36a14460d4e597d92730d59a4d91463f1b058cc8c256f7"} Jul 07 14:32:27.635600 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.635285 2562 scope.go:117] "RemoveContainer" containerID="8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4" Jul 07 14:32:27.654066 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.654049 2562 scope.go:117] "RemoveContainer" containerID="8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4" Jul 07 14:32:27.654360 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:32:27.654335 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4\": container with ID starting with 8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4 not found: ID does not exist" containerID="8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4" Jul 07 14:32:27.654414 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.654374 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4"} err="failed to get container status \"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4\": rpc error: code = NotFound desc = could not find container \"8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4\": container with ID starting with 8a45ff027bd8ad7cd1fa05c095ba300d630d0c3f38ca7b5883e4cb717992abc4 not found: ID does not exist" Jul 07 14:32:27.656521 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.656497 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:32:27.662984 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:27.662965 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5db8559b-ss7zs"] Jul 07 14:32:29.037971 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:32:29.037940 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb445b3-4477-44f0-a722-79a149fc735d" path="/var/lib/kubelet/pods/eeb445b3-4477-44f0-a722-79a149fc735d/volumes" Jul 07 14:33:02.152376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:02.152320 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:02.171279 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:02.171252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:02.783530 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:02.783504 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:15.871119 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871082 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871373 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="alertmanager" containerID="cri-o://75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" gracePeriod=120 Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871431 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-metric" containerID="cri-o://bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" gracePeriod=120 Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871434 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-web" containerID="cri-o://0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" gracePeriod=120 Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871497 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="config-reloader" containerID="cri-o://90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" gracePeriod=120 Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871526 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy" containerID="cri-o://6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" gracePeriod=120 Jul 07 14:33:15.871640 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:15.871543 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="prom-label-proxy" containerID="cri-o://660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" gracePeriod=120 Jul 07 14:33:16.826003 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.825970 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" exitCode=0 Jul 07 14:33:16.826003 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.825996 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" exitCode=0 Jul 07 14:33:16.826003 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826003 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" exitCode=0 Jul 07 14:33:16.826003 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826008 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" exitCode=0 Jul 07 14:33:16.826335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826049 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2"} Jul 07 14:33:16.826335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d"} Jul 07 14:33:16.826335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113"} Jul 07 14:33:16.826335 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:16.826236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492"} Jul 07 14:33:17.114586 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.114564 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:17.229904 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.229865 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.229904 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.229910 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230158 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.229927 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230158 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.229953 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2s5m\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230158 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230090 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230175 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230206 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230282 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230330 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230307 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230519 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230356 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230519 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230411 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230519 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230478 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.230674 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.230517 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca\") pod \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\" (UID: \"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065\") " Jul 07 14:33:17.231426 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.231157 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:17.231426 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.231285 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:17.231821 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.231715 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:17.232799 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.232744 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:17.232799 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.232784 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m" (OuterVolumeSpecName: "kube-api-access-t2s5m") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "kube-api-access-t2s5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:17.233671 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.233636 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume" (OuterVolumeSpecName: "config-volume") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.233782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.233708 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out" (OuterVolumeSpecName: "config-out") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:17.233782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.233737 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.233898 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.233877 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.233939 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.233920 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.234166 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.234147 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.238608 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.238582 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.244365 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.244346 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config" (OuterVolumeSpecName: "web-config") pod "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" (UID: "6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:17.331325 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331288 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2s5m\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-kube-api-access-t2s5m\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331325 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331320 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-tls-assets\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331325 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331335 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331343 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-out\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331352 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-web-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331360 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-config-volume\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331367 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331376 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331384 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-alertmanager-main-db\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331391 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-metrics-client-ca\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331399 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-cluster-tls-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331408 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.331559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.331416 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065-secret-alertmanager-main-tls\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:17.832968 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.832934 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" exitCode=0 Jul 07 14:33:17.832968 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.832963 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerID="0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" exitCode=0 Jul 07 14:33:17.833227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.833018 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:17.833227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.833030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089"} Jul 07 14:33:17.833227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.833123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1"} Jul 07 14:33:17.833227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.833167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065","Type":"ContainerDied","Data":"cbf486bb6b4dc5fb0216cab04b44444d89121a34ad87828cb06ee25f36c25c56"} Jul 07 14:33:17.833227 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.833184 2562 scope.go:117] "RemoveContainer" containerID="660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" Jul 07 14:33:17.840885 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.840868 2562 scope.go:117] "RemoveContainer" containerID="bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" Jul 07 14:33:17.847610 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.847591 2562 scope.go:117] "RemoveContainer" containerID="6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" Jul 07 14:33:17.854349 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.854331 2562 scope.go:117] "RemoveContainer" containerID="0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" Jul 07 14:33:17.859063 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.859042 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:17.863279 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.863261 2562 scope.go:117] "RemoveContainer" containerID="90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" Jul 07 14:33:17.868167 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.868145 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:17.871005 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.870990 2562 scope.go:117] "RemoveContainer" containerID="75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" Jul 07 14:33:17.877715 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.877699 2562 scope.go:117] "RemoveContainer" containerID="3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8" Jul 07 14:33:17.884456 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.884441 2562 scope.go:117] "RemoveContainer" containerID="660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" Jul 07 14:33:17.884687 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.884669 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2\": container with ID starting with 660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2 not found: ID does not exist" containerID="660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" Jul 07 14:33:17.884731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.884696 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2"} err="failed to get container status \"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2\": rpc error: code = NotFound desc = could not find container \"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2\": container with ID starting with 660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2 not found: ID does not exist" Jul 07 14:33:17.884731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.884716 2562 scope.go:117] "RemoveContainer" containerID="bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" Jul 07 14:33:17.884968 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.884951 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089\": container with ID starting with bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089 not found: ID does not exist" containerID="bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" Jul 07 14:33:17.885013 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.884972 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089"} err="failed to get container status \"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089\": rpc error: code = NotFound desc = could not find container \"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089\": container with ID starting with bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089 not found: ID does not exist" Jul 07 14:33:17.885013 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.884986 2562 scope.go:117] "RemoveContainer" containerID="6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" Jul 07 14:33:17.885185 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.885168 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d\": container with ID starting with 6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d not found: ID does not exist" containerID="6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" Jul 07 14:33:17.885228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885188 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d"} err="failed to get container status \"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d\": rpc error: code = NotFound desc = could not find container \"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d\": container with ID starting with 6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d not found: ID does not exist" Jul 07 14:33:17.885228 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885202 2562 scope.go:117] "RemoveContainer" containerID="0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" Jul 07 14:33:17.885440 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.885424 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1\": container with ID starting with 0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1 not found: ID does not exist" containerID="0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" Jul 07 14:33:17.885502 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885449 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1"} err="failed to get container status \"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1\": rpc error: code = NotFound desc = could not find container \"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1\": container with ID starting with 0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1 not found: ID does not exist" Jul 07 14:33:17.885502 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885472 2562 scope.go:117] "RemoveContainer" containerID="90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" Jul 07 14:33:17.885745 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.885725 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113\": container with ID starting with 90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113 not found: ID does not exist" containerID="90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" Jul 07 14:33:17.885813 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885751 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113"} err="failed to get container status \"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113\": rpc error: code = NotFound desc = could not find container \"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113\": container with ID starting with 90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113 not found: ID does not exist" Jul 07 14:33:17.885813 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885782 2562 scope.go:117] "RemoveContainer" containerID="75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" Jul 07 14:33:17.885985 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.885967 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492\": container with ID starting with 75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492 not found: ID does not exist" containerID="75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" Jul 07 14:33:17.886048 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.885993 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492"} err="failed to get container status \"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492\": rpc error: code = NotFound desc = could not find container \"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492\": container with ID starting with 75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492 not found: ID does not exist" Jul 07 14:33:17.886048 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886012 2562 scope.go:117] "RemoveContainer" containerID="3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8" Jul 07 14:33:17.886228 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:17.886210 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8\": container with ID starting with 3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8 not found: ID does not exist" containerID="3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8" Jul 07 14:33:17.886264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886232 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8"} err="failed to get container status \"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8\": rpc error: code = NotFound desc = could not find container \"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8\": container with ID starting with 3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8 not found: ID does not exist" Jul 07 14:33:17.886264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886245 2562 scope.go:117] "RemoveContainer" containerID="660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2" Jul 07 14:33:17.886448 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886433 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2"} err="failed to get container status \"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2\": rpc error: code = NotFound desc = could not find container \"660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2\": container with ID starting with 660a8cf486d3a1dfd1750292601a33d9137b703bc439e24305556a4850fe62e2 not found: ID does not exist" Jul 07 14:33:17.886448 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886448 2562 scope.go:117] "RemoveContainer" containerID="bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089" Jul 07 14:33:17.886648 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886631 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089"} err="failed to get container status \"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089\": rpc error: code = NotFound desc = could not find container \"bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089\": container with ID starting with bfaaa738b07acbfd73c5fc7a4519e8a5afb53b75e3b578b2c55962cc8e45f089 not found: ID does not exist" Jul 07 14:33:17.886714 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886651 2562 scope.go:117] "RemoveContainer" containerID="6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d" Jul 07 14:33:17.886867 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886851 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d"} err="failed to get container status \"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d\": rpc error: code = NotFound desc = could not find container \"6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d\": container with ID starting with 6007f876517e4ebd0591359fb22f2c8893a2066cd5cedad7751d1e35f53e108d not found: ID does not exist" Jul 07 14:33:17.886921 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.886869 2562 scope.go:117] "RemoveContainer" containerID="0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1" Jul 07 14:33:17.887051 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887037 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1"} err="failed to get container status \"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1\": rpc error: code = NotFound desc = could not find container \"0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1\": container with ID starting with 0701d115af52fd359fff37badcb8b7c2514fbd38c2cdadc35bab3141c48b64d1 not found: ID does not exist" Jul 07 14:33:17.887095 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887052 2562 scope.go:117] "RemoveContainer" containerID="90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113" Jul 07 14:33:17.887242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887225 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113"} err="failed to get container status \"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113\": rpc error: code = NotFound desc = could not find container \"90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113\": container with ID starting with 90f52869edae8f298029aad2f76ee3d43c736b2e0f07c4b33f3d58209ffb6113 not found: ID does not exist" Jul 07 14:33:17.887302 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887243 2562 scope.go:117] "RemoveContainer" containerID="75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492" Jul 07 14:33:17.887444 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887420 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492"} err="failed to get container status \"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492\": rpc error: code = NotFound desc = could not find container \"75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492\": container with ID starting with 75264f07262f2f07110c0b6a9e76a12d180294d38b4e01f2f3c0babe9fb5d492 not found: ID does not exist" Jul 07 14:33:17.887444 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887436 2562 scope.go:117] "RemoveContainer" containerID="3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8" Jul 07 14:33:17.887623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.887606 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8"} err="failed to get container status \"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8\": rpc error: code = NotFound desc = could not find container \"3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8\": container with ID starting with 3b89fd8484bca7449fd42bcf573d4a836a74cb70daa6a05f04111c7d8cb229f8 not found: ID does not exist" Jul 07 14:33:17.900264 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900239 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:17.900514 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900502 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="config-reloader" Jul 07 14:33:17.900561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900516 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="config-reloader" Jul 07 14:33:17.900561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900530 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="init-config-reloader" Jul 07 14:33:17.900561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900536 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="init-config-reloader" Jul 07 14:33:17.900561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900545 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="prom-label-proxy" Jul 07 14:33:17.900561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900558 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="prom-label-proxy" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900568 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-web" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900574 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-web" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900581 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-metric" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900586 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-metric" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900595 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900600 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900606 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="alertmanager" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900610 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="alertmanager" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900617 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb445b3-4477-44f0-a722-79a149fc735d" containerName="console" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900622 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb445b3-4477-44f0-a722-79a149fc735d" containerName="console" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900661 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb445b3-4477-44f0-a722-79a149fc735d" containerName="console" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900671 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-web" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900677 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy-metric" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900682 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="alertmanager" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900687 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="config-reloader" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900691 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="kube-rbac-proxy" Jul 07 14:33:17.900722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.900699 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" containerName="prom-label-proxy" Jul 07 14:33:17.905943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.904360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:17.908685 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.908665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:33:17.909051 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909033 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:33:17.909217 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909196 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:33:17.909332 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:33:17.909453 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:33:17.909645 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7k72l\"" Jul 07 14:33:17.909719 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:33:17.909865 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.909715 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:33:17.910142 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.910128 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:33:17.915613 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.915595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:33:17.923932 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:17.923904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:18.036710 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.036710 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.036944 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.036944 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.036944 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.036944 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.036993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lwsh\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-kube-api-access-9lwsh\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.037017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.037057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.037083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037312 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.037136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.037312 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.037168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.138596 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.138596 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.138596 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lwsh\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-kube-api-access-9lwsh\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139133 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.138996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.139143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.139657 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.139629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.140548 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.140520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.141407 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.141377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.141741 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.141591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.141741 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.141687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.141886 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.141817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.142139 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.142115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.142573 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.142556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.143033 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.143010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.143279 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.143258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.143375 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.143358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.147573 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.147556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lwsh\" (UniqueName: \"kubernetes.io/projected/254f7634-3fa7-427d-97e7-1ba2e8cbb0c2-kube-api-access-9lwsh\") pod \"alertmanager-main-0\" (UID: \"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.215156 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.215119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:33:18.356430 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.356404 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:33:18.358302 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:33:18.358277 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254f7634_3fa7_427d_97e7_1ba2e8cbb0c2.slice/crio-65bdd110b82f4382058962561537b8686f5c6a09d947af71764d4f2225bb4eee WatchSource:0}: Error finding container 65bdd110b82f4382058962561537b8686f5c6a09d947af71764d4f2225bb4eee: Status 404 returned error can't find the container with id 65bdd110b82f4382058962561537b8686f5c6a09d947af71764d4f2225bb4eee Jul 07 14:33:18.838965 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.838926 2562 generic.go:356] "Generic (PLEG): container finished" podID="254f7634-3fa7-427d-97e7-1ba2e8cbb0c2" containerID="ddc12703f2f83af35323789d7d4fc0936a7c7c030bd0a863f2ef6551256b2808" exitCode=0 Jul 07 14:33:18.839132 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.838993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerDied","Data":"ddc12703f2f83af35323789d7d4fc0936a7c7c030bd0a863f2ef6551256b2808"} Jul 07 14:33:18.839132 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:18.839095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"65bdd110b82f4382058962561537b8686f5c6a09d947af71764d4f2225bb4eee"} Jul 07 14:33:19.039218 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.039184 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065" path="/var/lib/kubelet/pods/6d4ed3bf-0e4a-4ed4-8ae6-91dff4ad7065/volumes" Jul 07 14:33:19.848376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"b50800876928aa97a54aef1000420829fbf15c4b077b5c636e9e5d74427d0848"} Jul 07 14:33:19.848376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"dee140aeebd1afe007f980f709cb7690d7a622720bcc40629b4f625a0c19c6ef"} Jul 07 14:33:19.848778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"34f1d1d33a8584f66a1bebe9e20b77ebf723028ff2cf74102b022d4e11fc8c5b"} Jul 07 14:33:19.848778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"b06f9e0692062a05f75521661328727b13ead9e42552ea2d71ddea2f0afa1e5a"} Jul 07 14:33:19.848778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"4bf57ccfa3880d6859acf48eeaf9996c07a90b358429b27d85d5b51cfc309616"} Jul 07 14:33:19.848778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:19.848453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"254f7634-3fa7-427d-97e7-1ba2e8cbb0c2","Type":"ContainerStarted","Data":"080657516d57d73d53d89026da5a4a76a2397626ccc7bf0c894e6350db422c70"} Jul 07 14:33:20.286952 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.286891 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.271863045 podStartE2EDuration="3.286867796s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.004751ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:19.90308908 +0000 UTC m=+161.413699026" watchObservedRunningTime="2026-07-07 14:33:20.286867796 +0000 UTC m=+161.797477764" Jul 07 14:33:20.288472 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.288446 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:20.289008 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.288979 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="prometheus" containerID="cri-o://0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" gracePeriod=600 Jul 07 14:33:20.289564 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.289144 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy" containerID="cri-o://5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" gracePeriod=600 Jul 07 14:33:20.289730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.289346 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" gracePeriod=600 Jul 07 14:33:20.289860 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.289359 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-web" containerID="cri-o://7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" gracePeriod=600 Jul 07 14:33:20.289917 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.289367 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="config-reloader" containerID="cri-o://58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" gracePeriod=600 Jul 07 14:33:20.289978 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.289395 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="thanos-sidecar" containerID="cri-o://d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" gracePeriod=600 Jul 07 14:33:20.555974 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.555950 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:20.662569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662535 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.662731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662582 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.662731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662611 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.662848 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662788 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.662848 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662828 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.662953 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662867 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662980 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.663010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.662997 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663041 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjbgf\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663065 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663093 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663133 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663180 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663161 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663201 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663217 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663226 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663302 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663323 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663329 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663381 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663416 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663408 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2\") pod \"8b53f729-97b0-4393-b214-5c09bb9949f7\" (UID: \"8b53f729-97b0-4393-b214-5c09bb9949f7\") " Jul 07 14:33:20.663893 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663660 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.663893 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663680 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.663893 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.663696 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.664060 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.664037 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.664387 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.664360 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.665222 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.665176 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.665317 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.665255 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666124 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666088 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666373 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666334 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.666563 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666500 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666563 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666552 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:20.666816 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666757 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666899 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666832 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666960 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666928 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.666960 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.666952 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config" (OuterVolumeSpecName: "config") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.667433 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.667410 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:20.667531 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.667514 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf" (OuterVolumeSpecName: "kube-api-access-xjbgf") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "kube-api-access-xjbgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:20.667653 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.667631 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:20.668412 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.668395 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out" (OuterVolumeSpecName: "config-out") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:20.677040 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.677011 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config" (OuterVolumeSpecName: "web-config") pod "8b53f729-97b0-4393-b214-5c09bb9949f7" (UID: "8b53f729-97b0-4393-b214-5c09bb9949f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:33:20.764991 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.764957 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-config-out\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.764991 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.764982 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjbgf\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-kube-api-access-xjbgf\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.764991 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.764992 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765001 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765011 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-configmap-metrics-client-ca\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765020 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-db\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765029 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-web-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765038 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765046 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765055 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b53f729-97b0-4393-b214-5c09bb9949f7-tls-assets\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765062 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-config\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765070 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765078 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b53f729-97b0-4393-b214-5c09bb9949f7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765085 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-metrics-client-certs\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765095 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-kube-rbac-proxy\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765103 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-secret-grpc-tls\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.765192 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.765113 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b53f729-97b0-4393-b214-5c09bb9949f7-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855708 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" exitCode=0 Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855732 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" exitCode=0 Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855740 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" exitCode=0 Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855746 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" exitCode=0 Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855751 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" exitCode=0 Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855797 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:20.855819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855756 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" exitCode=0 Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855967 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.855978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.856016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.856056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} Jul 07 14:33:20.856556 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.856097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b53f729-97b0-4393-b214-5c09bb9949f7","Type":"ContainerDied","Data":"c9e95a2ec7f89a5f1299e472cdb86750a81b12d367f120128f5f35ac415fd9d3"} Jul 07 14:33:20.864343 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.864321 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.871447 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.871420 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.878238 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.878204 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.883469 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.883436 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:20.885590 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.885561 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.889310 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.889289 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:20.892435 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.892413 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.899478 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.899462 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.905824 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.905808 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.906082 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.906062 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.906129 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906090 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.906129 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906107 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.906351 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.906335 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.906393 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906355 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.906393 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906371 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.906559 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.906544 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.906599 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906561 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.906599 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.906573 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.907049 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.907028 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.907134 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907056 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.907134 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907078 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.907341 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.907325 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.907385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907344 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.907385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907356 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.907562 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.907544 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.907623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907569 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.907623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907592 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.907861 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:33:20.907846 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.907908 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907864 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.907908 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.907877 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.908066 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908051 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.908066 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908065 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.908261 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908242 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.908309 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908262 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.908511 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908491 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.908577 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908512 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.908716 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908700 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.908795 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908716 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.908927 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908908 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.908983 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.908928 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.909152 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909136 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.909198 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909153 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.909336 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909318 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.909378 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909337 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.909516 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909495 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.909581 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909520 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.909737 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909721 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.909803 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909737 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.909961 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909944 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.910026 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.909962 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.910166 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910150 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.910210 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910167 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.910361 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910346 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.910409 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910361 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.910528 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910512 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.910578 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910528 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.910682 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910667 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.910682 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910681 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.910872 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910858 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.910872 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.910872 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.911046 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911029 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.911046 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911046 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.911224 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911202 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.911287 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911225 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.911449 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911433 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.911505 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911448 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.911663 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911645 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.911706 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911664 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.912001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.911956 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.912098 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912008 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.912252 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912234 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.912252 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912252 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.912549 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912530 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.912606 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912551 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.912822 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912799 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.912864 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.912824 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.913043 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913025 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.913095 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913044 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.913279 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913261 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.913339 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913279 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.913493 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913478 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.913537 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913493 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.913733 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913718 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.913795 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913734 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.913963 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913946 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.914010 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.913962 2562 scope.go:117] "RemoveContainer" containerID="84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf" Jul 07 14:33:20.914125 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914112 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf"} err="failed to get container status \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": rpc error: code = NotFound desc = could not find container \"84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf\": container with ID starting with 84a9d4d642adcf7513236b27e8622643d9ce83021153993d1e9a9ad5a97c9aaf not found: ID does not exist" Jul 07 14:33:20.914170 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914125 2562 scope.go:117] "RemoveContainer" containerID="5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee" Jul 07 14:33:20.914324 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914311 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee"} err="failed to get container status \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": rpc error: code = NotFound desc = could not find container \"5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee\": container with ID starting with 5622083323ca75d501091586098cb0746718af4757777db5a3b47de3a810fcee not found: ID does not exist" Jul 07 14:33:20.914363 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914324 2562 scope.go:117] "RemoveContainer" containerID="7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75" Jul 07 14:33:20.914522 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914505 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75"} err="failed to get container status \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": rpc error: code = NotFound desc = could not find container \"7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75\": container with ID starting with 7d397ecc0d26ece0ba31e954bd7cf63de8cdf82ed69def6d541d0e6d00d1bc75 not found: ID does not exist" Jul 07 14:33:20.914567 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914524 2562 scope.go:117] "RemoveContainer" containerID="d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30" Jul 07 14:33:20.914700 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914687 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30"} err="failed to get container status \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": rpc error: code = NotFound desc = could not find container \"d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30\": container with ID starting with d2dd8128068ae42e4ec5a77b36937db21c6cf53bf37522b5999e13157e2b8f30 not found: ID does not exist" Jul 07 14:33:20.914736 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914700 2562 scope.go:117] "RemoveContainer" containerID="58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae" Jul 07 14:33:20.914908 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914887 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae"} err="failed to get container status \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": rpc error: code = NotFound desc = could not find container \"58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae\": container with ID starting with 58b42e06cd4709db29137042933b9517d0ed041a8074396642587156cacf94ae not found: ID does not exist" Jul 07 14:33:20.914908 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.914907 2562 scope.go:117] "RemoveContainer" containerID="0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818" Jul 07 14:33:20.915139 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.915121 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818"} err="failed to get container status \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": rpc error: code = NotFound desc = could not find container \"0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818\": container with ID starting with 0b9f6ad56a507cb9579713a192d2903c5af09ea0356db71deb846be60d3b2818 not found: ID does not exist" Jul 07 14:33:20.915189 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.915139 2562 scope.go:117] "RemoveContainer" containerID="176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee" Jul 07 14:33:20.915344 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.915330 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee"} err="failed to get container status \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": rpc error: code = NotFound desc = could not find container \"176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee\": container with ID starting with 176681b272982fc78def381c1e43d71393a398534f4025b1146dc3e230f07aee not found: ID does not exist" Jul 07 14:33:20.922552 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922530 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:20.922818 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922806 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="prometheus" Jul 07 14:33:20.922857 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922820 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="prometheus" Jul 07 14:33:20.922857 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922831 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="init-config-reloader" Jul 07 14:33:20.922857 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922837 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="init-config-reloader" Jul 07 14:33:20.922857 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922845 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="config-reloader" Jul 07 14:33:20.922857 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922855 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="config-reloader" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922862 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-web" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922868 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-web" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922874 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922878 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922888 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="thanos-sidecar" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922893 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="thanos-sidecar" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-thanos" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922914 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-thanos" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922979 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="prometheus" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922988 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.922993 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-thanos" Jul 07 14:33:20.923001 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.923002 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="thanos-sidecar" Jul 07 14:33:20.923313 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.923010 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="kube-rbac-proxy-web" Jul 07 14:33:20.923313 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.923018 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" containerName="config-reloader" Jul 07 14:33:20.926719 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.926704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:20.929374 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.929352 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 14:33:20.929969 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.929952 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 14:33:20.930187 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 14:33:20.930326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 14:33:20.930326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 14:33:20.930326 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930245 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:33:20.930483 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 14:33:20.930483 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 14:33:20.930587 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930528 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 14:33:20.930587 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930564 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 14:33:20.930587 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.930566 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 14:33:20.931206 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.931153 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2r6jrh36be8gs\"" Jul 07 14:33:20.931206 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.931161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 14:33:20.931352 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.931191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 14:33:20.931393 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.931363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlml9\"" Jul 07 14:33:20.934817 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.934800 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 14:33:20.941682 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.941665 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 14:33:20.959729 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:20.959706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:21.041079 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.041037 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b53f729-97b0-4393-b214-5c09bb9949f7" path="/var/lib/kubelet/pods/8b53f729-97b0-4393-b214-5c09bb9949f7/volumes" Jul 07 14:33:21.066381 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7jt\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-kube-api-access-lv7jt\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066730 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.066943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.066887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.167334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.167334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7jt\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-kube-api-access-lv7jt\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.167334 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168039 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.167622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.168543 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.168539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.170584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.170754 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.170982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.171067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.171263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.171471 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.171429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172323 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.171901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172323 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.171902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172323 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.172268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172509 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.172452 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172754 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.172733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172845 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.172830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.172989 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.172969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.173314 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.173298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.173448 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.173431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.178975 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.178959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7jt\" (UniqueName: \"kubernetes.io/projected/ba32fcc8-359d-4c40-b87a-b6a2d510d20b-kube-api-access-lv7jt\") pod \"prometheus-k8s-0\" (UID: \"ba32fcc8-359d-4c40-b87a-b6a2d510d20b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.236970 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.236943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:33:21.384254 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.384221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:33:21.387245 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:33:21.387220 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba32fcc8_359d_4c40_b87a_b6a2d510d20b.slice/crio-27a866d159f6d00bc73555aef32a92d98970e75edafd402a14f8388e71467990 WatchSource:0}: Error finding container 27a866d159f6d00bc73555aef32a92d98970e75edafd402a14f8388e71467990: Status 404 returned error can't find the container with id 27a866d159f6d00bc73555aef32a92d98970e75edafd402a14f8388e71467990 Jul 07 14:33:21.863130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.863093 2562 generic.go:356] "Generic (PLEG): container finished" podID="ba32fcc8-359d-4c40-b87a-b6a2d510d20b" containerID="78d331737d534590c67113fe72e9c480647f37b0855307e05382a07c4f70b3fe" exitCode=0 Jul 07 14:33:21.863520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.863150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerDied","Data":"78d331737d534590c67113fe72e9c480647f37b0855307e05382a07c4f70b3fe"} Jul 07 14:33:21.863520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:21.863215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"27a866d159f6d00bc73555aef32a92d98970e75edafd402a14f8388e71467990"} Jul 07 14:33:22.870472 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"353c2c15ccd6b3f1ccda34c563d289ff93f25a9648af8eba310c071a2e5baa22"} Jul 07 14:33:22.870869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"7169e082a3cf237fe3dedf635f58d78352bc569b56dc0a6582fbd9de0be4325e"} Jul 07 14:33:22.870869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"0730d5e4e9de0dcfbedf4e141553b86f7912a75c6e80abe99452f5528576e91f"} Jul 07 14:33:22.870869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"b59f83af480e17092428744cac601dc88cb76ee826eb5ceb3d3bf25091b72f8c"} Jul 07 14:33:22.870869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"0f023c6493bf3fffe318e94652f594543ba3143ac3e8eded997582e14b0edaa7"} Jul 07 14:33:22.870869 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.870625 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba32fcc8-359d-4c40-b87a-b6a2d510d20b","Type":"ContainerStarted","Data":"8ee8193f6125c2c4bd4215aba45bd3d5c7d21008b0b1e1b891cc23a07b0d43d6"} Jul 07 14:33:22.907130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:22.907080 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.88919924 podStartE2EDuration="2.907063147s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.863907ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:22.90529758 +0000 UTC m=+164.415907512" watchObservedRunningTime="2026-07-07 14:33:22.907063147 +0000 UTC m=+164.417673078" Jul 07 14:33:26.237913 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:33:26.237866 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:34:21.237469 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:34:21.237433 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:34:21.252569 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:34:21.252541 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:34:22.111054 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:34:22.111025 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:35:38.876057 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:35:38.876026 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:35:38.882628 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:35:38.882606 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:35:38.884090 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:35:38.884072 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:36:17.604409 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.604376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d"] Jul 07 14:36:17.608004 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.607989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.610430 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.610412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 14:36:17.611321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.611306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:36:17.611377 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.611343 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mvsg9\"" Jul 07 14:36:17.616351 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.616327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d"] Jul 07 14:36:17.670432 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.670401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqtrc\" (UniqueName: \"kubernetes.io/projected/b7dd8c97-ce71-46ec-bd09-1364bb00337f-kube-api-access-dqtrc\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.670568 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.670470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7dd8c97-ce71-46ec-bd09-1364bb00337f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.771733 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.771697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqtrc\" (UniqueName: \"kubernetes.io/projected/b7dd8c97-ce71-46ec-bd09-1364bb00337f-kube-api-access-dqtrc\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.771906 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.771792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7dd8c97-ce71-46ec-bd09-1364bb00337f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.772151 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.772132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7dd8c97-ce71-46ec-bd09-1364bb00337f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.779968 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.779937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqtrc\" (UniqueName: \"kubernetes.io/projected/b7dd8c97-ce71-46ec-bd09-1364bb00337f-kube-api-access-dqtrc\") pod \"openshift-lws-operator-fd8ccff4c-5lh8d\" (UID: \"b7dd8c97-ce71-46ec-bd09-1364bb00337f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:17.930417 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:17.930323 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" Jul 07 14:36:18.058865 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:18.058839 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d"] Jul 07 14:36:18.061250 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:36:18.061217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7dd8c97_ce71_46ec_bd09_1364bb00337f.slice/crio-697b0a21ddd527cbd9fe49b906cac5cc76ae7d74879bbcf3ffe595226ceb2cb0 WatchSource:0}: Error finding container 697b0a21ddd527cbd9fe49b906cac5cc76ae7d74879bbcf3ffe595226ceb2cb0: Status 404 returned error can't find the container with id 697b0a21ddd527cbd9fe49b906cac5cc76ae7d74879bbcf3ffe595226ceb2cb0 Jul 07 14:36:18.062801 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:18.062786 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:36:18.514342 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:18.514308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" event={"ID":"b7dd8c97-ce71-46ec-bd09-1364bb00337f","Type":"ContainerStarted","Data":"697b0a21ddd527cbd9fe49b906cac5cc76ae7d74879bbcf3ffe595226ceb2cb0"} Jul 07 14:36:21.533226 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:21.533188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" event={"ID":"b7dd8c97-ce71-46ec-bd09-1364bb00337f","Type":"ContainerStarted","Data":"ca8b0a51db05d5691b619fa523bc9f3ceed52b073d5a67999f48c6afbc6ca942"} Jul 07 14:36:21.553693 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:21.553642 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lh8d" podStartSLOduration=1.611115251 podStartE2EDuration="4.553627539s" totalImagesPullingTime="2.942512288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:21.552382928 +0000 UTC m=+343.062992858" watchObservedRunningTime="2026-07-07 14:36:21.553627539 +0000 UTC m=+343.064237469" Jul 07 14:36:37.041008 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.040931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9"] Jul 07 14:36:37.047143 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.047119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.050239 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.050220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 14:36:37.050958 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.050939 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 14:36:37.051242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.051227 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 14:36:37.051296 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.051280 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dnrkb\"" Jul 07 14:36:37.051593 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.051579 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 14:36:37.059278 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.059256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9"] Jul 07 14:36:37.126695 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.126663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4pz\" (UniqueName: \"kubernetes.io/projected/7c394094-0bad-4b60-b496-460fa6b95287-kube-api-access-bt4pz\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.126873 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.126710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.126873 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.126729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.126873 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.126747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.126873 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.126818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.227753 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.227722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4pz\" (UniqueName: \"kubernetes.io/projected/7c394094-0bad-4b60-b496-460fa6b95287-kube-api-access-bt4pz\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.227964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.227790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.227964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.227806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.227964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.227824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.227964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.227843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.228253 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.228118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.230068 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.230047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c394094-0bad-4b60-b496-460fa6b95287-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.230171 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.230158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.230429 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.230410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c394094-0bad-4b60-b496-460fa6b95287-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.251353 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.251318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4pz\" (UniqueName: \"kubernetes.io/projected/7c394094-0bad-4b60-b496-460fa6b95287-kube-api-access-bt4pz\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-979q9\" (UID: \"7c394094-0bad-4b60-b496-460fa6b95287\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.357822 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.357715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:37.494321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.494299 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9"] Jul 07 14:36:37.497154 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:36:37.497128 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c394094_0bad_4b60_b496_460fa6b95287.slice/crio-a23fe553417f6a3de993797e914c15a491472be4e84633e0413c32abf626f984 WatchSource:0}: Error finding container a23fe553417f6a3de993797e914c15a491472be4e84633e0413c32abf626f984: Status 404 returned error can't find the container with id a23fe553417f6a3de993797e914c15a491472be4e84633e0413c32abf626f984 Jul 07 14:36:37.592468 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:37.592429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" event={"ID":"7c394094-0bad-4b60-b496-460fa6b95287","Type":"ContainerStarted","Data":"a23fe553417f6a3de993797e914c15a491472be4e84633e0413c32abf626f984"} Jul 07 14:36:41.609782 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:41.609721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" event={"ID":"7c394094-0bad-4b60-b496-460fa6b95287","Type":"ContainerStarted","Data":"10b6ab0b5a8641fb12a2b6cc3a281fc0a4819f13efaad8a3111847408f5225eb"} Jul 07 14:36:42.614580 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:42.614547 2562 generic.go:356] "Generic (PLEG): container finished" podID="7c394094-0bad-4b60-b496-460fa6b95287" containerID="10b6ab0b5a8641fb12a2b6cc3a281fc0a4819f13efaad8a3111847408f5225eb" exitCode=0 Jul 07 14:36:42.615071 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:42.614615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" event={"ID":"7c394094-0bad-4b60-b496-460fa6b95287","Type":"ContainerDied","Data":"10b6ab0b5a8641fb12a2b6cc3a281fc0a4819f13efaad8a3111847408f5225eb"} Jul 07 14:36:43.620984 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:43.620952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" event={"ID":"7c394094-0bad-4b60-b496-460fa6b95287","Type":"ContainerStarted","Data":"30a6d5c65590c065f64109c9cc13261f6122e78be8b5f12d22d9cd6abbbc854c"} Jul 07 14:36:43.621385 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:43.621062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:43.645874 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:43.645819 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" podStartSLOduration=2.122076373 podStartE2EDuration="6.645802632s" totalImagesPullingTime="3.515627104s" totalInitContainerRuntime="1.008099155s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:43.644286387 +0000 UTC m=+365.154896319" watchObservedRunningTime="2026-07-07 14:36:43.645802632 +0000 UTC m=+365.156412564" Jul 07 14:36:54.632146 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:54.632115 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-979q9" Jul 07 14:36:57.319549 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.319515 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl"] Jul 07 14:36:57.327721 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.327700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.330604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.330582 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 14:36:57.330715 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.330609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 14:36:57.332514 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.332485 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:36:57.332654 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.332637 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:36:57.348798 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.348755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl"] Jul 07 14:36:57.409087 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.409049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d340abe5-93e7-4651-9242-a967bf3d0e47-tmp\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.409251 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.409107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9tkf\" (UniqueName: \"kubernetes.io/projected/d340abe5-93e7-4651-9242-a967bf3d0e47-kube-api-access-w9tkf\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.409251 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.409203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.510271 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.510238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d340abe5-93e7-4651-9242-a967bf3d0e47-tmp\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.510443 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.510289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9tkf\" (UniqueName: \"kubernetes.io/projected/d340abe5-93e7-4651-9242-a967bf3d0e47-kube-api-access-w9tkf\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.510443 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.510319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.510519 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:36:57.510439 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 14:36:57.510519 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:36:57.510506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs podName:d340abe5-93e7-4651-9242-a967bf3d0e47 nodeName:}" failed. No retries permitted until 2026-07-07 14:36:58.010491185 +0000 UTC m=+379.521101097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs") pod "kube-auth-proxy-67499f45fb-pj5rl" (UID: "d340abe5-93e7-4651-9242-a967bf3d0e47") : secret "kube-auth-proxy-tls" not found Jul 07 14:36:57.512435 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.512413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d340abe5-93e7-4651-9242-a967bf3d0e47-tmp\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.540623 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.540589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9tkf\" (UniqueName: \"kubernetes.io/projected/d340abe5-93e7-4651-9242-a967bf3d0e47-kube-api-access-w9tkf\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:57.692709 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.692635 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq"] Jul 07 14:36:57.695991 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.695974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.699621 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.699597 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 14:36:57.699942 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.699921 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nl5nj\"" Jul 07 14:36:57.700021 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.699921 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 14:36:57.700021 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.699955 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 14:36:57.708123 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.708103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq"] Jul 07 14:36:57.813095 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.813063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-metrics-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.813095 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.813095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.813286 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.813168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-manager-config\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.813286 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.813215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf29h\" (UniqueName: \"kubernetes.io/projected/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-kube-api-access-xf29h\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.914510 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.914470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-manager-config\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.914664 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.914540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf29h\" (UniqueName: \"kubernetes.io/projected/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-kube-api-access-xf29h\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.914664 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.914588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-metrics-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.914664 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.914610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.915213 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.915178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-manager-config\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.917023 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.917006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-metrics-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.917099 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.917077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-cert\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:57.932088 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:57.932066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf29h\" (UniqueName: \"kubernetes.io/projected/eb2f002a-ae6c-4f42-adf2-e4787a0a1519-kube-api-access-xf29h\") pod \"lws-controller-manager-7d96c4654c-jkqkq\" (UID: \"eb2f002a-ae6c-4f42-adf2-e4787a0a1519\") " pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:58.005936 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.005905 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:36:58.015564 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.015526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:58.018292 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.018267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d340abe5-93e7-4651-9242-a967bf3d0e47-tls-certs\") pod \"kube-auth-proxy-67499f45fb-pj5rl\" (UID: \"d340abe5-93e7-4651-9242-a967bf3d0e47\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:58.137814 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.137785 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq"] Jul 07 14:36:58.140118 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:36:58.140090 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2f002a_ae6c_4f42_adf2_e4787a0a1519.slice/crio-15ec54d0d1d8ff3bc5abc260230ec4227aad4ab9fc1754fe8c4744a49fa526cf WatchSource:0}: Error finding container 15ec54d0d1d8ff3bc5abc260230ec4227aad4ab9fc1754fe8c4744a49fa526cf: Status 404 returned error can't find the container with id 15ec54d0d1d8ff3bc5abc260230ec4227aad4ab9fc1754fe8c4744a49fa526cf Jul 07 14:36:58.242427 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.242395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" Jul 07 14:36:58.389895 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.389869 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl"] Jul 07 14:36:58.390307 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:36:58.390285 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd340abe5_93e7_4651_9242_a967bf3d0e47.slice/crio-b51d21c91fee881a4c3da9b4bfc3eed2f57b1c09c9f12c936404d046b5cf458c WatchSource:0}: Error finding container b51d21c91fee881a4c3da9b4bfc3eed2f57b1c09c9f12c936404d046b5cf458c: Status 404 returned error can't find the container with id b51d21c91fee881a4c3da9b4bfc3eed2f57b1c09c9f12c936404d046b5cf458c Jul 07 14:36:58.684575 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.684489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" event={"ID":"d340abe5-93e7-4651-9242-a967bf3d0e47","Type":"ContainerStarted","Data":"b51d21c91fee881a4c3da9b4bfc3eed2f57b1c09c9f12c936404d046b5cf458c"} Jul 07 14:36:58.685686 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:36:58.685663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" event={"ID":"eb2f002a-ae6c-4f42-adf2-e4787a0a1519","Type":"ContainerStarted","Data":"15ec54d0d1d8ff3bc5abc260230ec4227aad4ab9fc1754fe8c4744a49fa526cf"} Jul 07 14:37:00.696827 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:00.696786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" event={"ID":"eb2f002a-ae6c-4f42-adf2-e4787a0a1519","Type":"ContainerStarted","Data":"4bc597425b55ff7e8f1fec91e0eda3090d00d17c0329fabcf2761a21cddb98ae"} Jul 07 14:37:00.697315 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:00.696889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:37:00.717677 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:00.717611 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" podStartSLOduration=1.899008381 podStartE2EDuration="3.717587237s" totalImagesPullingTime="1.818578856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:00.715276332 +0000 UTC m=+382.225886264" watchObservedRunningTime="2026-07-07 14:37:00.717587237 +0000 UTC m=+382.228197171" Jul 07 14:37:01.702778 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:01.702726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" event={"ID":"d340abe5-93e7-4651-9242-a967bf3d0e47","Type":"ContainerStarted","Data":"bae3a7b373cb24cf7f1a437856c9cab58d5ee964011693a515aa4974d2a36368"} Jul 07 14:37:01.720959 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:01.720908 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67499f45fb-pj5rl" podStartSLOduration=2.025877949 podStartE2EDuration="4.720890697s" totalImagesPullingTime="2.695012748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:01.720106894 +0000 UTC m=+383.230716827" watchObservedRunningTime="2026-07-07 14:37:01.720890697 +0000 UTC m=+383.231500627" Jul 07 14:37:08.921422 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:08.921387 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-db7v8"] Jul 07 14:37:08.924562 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:08.924546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:08.929447 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:08.929425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 14:37:08.929585 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:08.929431 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-j7gm9\"" Jul 07 14:37:08.942798 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:08.942755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-db7v8"] Jul 07 14:37:09.013163 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.013124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8szg\" (UniqueName: \"kubernetes.io/projected/699003ea-4613-4419-a7a4-0ae091dad64a-kube-api-access-q8szg\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.013336 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.013189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/699003ea-4613-4419-a7a4-0ae091dad64a-cert\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.113940 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.113909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/699003ea-4613-4419-a7a4-0ae091dad64a-cert\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.114142 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.114004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8szg\" (UniqueName: \"kubernetes.io/projected/699003ea-4613-4419-a7a4-0ae091dad64a-kube-api-access-q8szg\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.116281 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.116257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/699003ea-4613-4419-a7a4-0ae091dad64a-cert\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.131500 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.131469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8szg\" (UniqueName: \"kubernetes.io/projected/699003ea-4613-4419-a7a4-0ae091dad64a-kube-api-access-q8szg\") pod \"kserve-controller-manager-d6f4b65b8-db7v8\" (UID: \"699003ea-4613-4419-a7a4-0ae091dad64a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.235259 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.235175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:09.407274 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.407242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-db7v8"] Jul 07 14:37:09.411136 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:37:09.411114 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699003ea_4613_4419_a7a4_0ae091dad64a.slice/crio-169c70e96c49c9067f26f0a2cf5bc16c65c7bbb5707ecd2640a699eee7e49d3a WatchSource:0}: Error finding container 169c70e96c49c9067f26f0a2cf5bc16c65c7bbb5707ecd2640a699eee7e49d3a: Status 404 returned error can't find the container with id 169c70e96c49c9067f26f0a2cf5bc16c65c7bbb5707ecd2640a699eee7e49d3a Jul 07 14:37:09.736933 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:09.736896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" event={"ID":"699003ea-4613-4419-a7a4-0ae091dad64a","Type":"ContainerStarted","Data":"169c70e96c49c9067f26f0a2cf5bc16c65c7bbb5707ecd2640a699eee7e49d3a"} Jul 07 14:37:11.705604 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:11.705574 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d96c4654c-jkqkq" Jul 07 14:37:12.753195 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:12.753160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" event={"ID":"699003ea-4613-4419-a7a4-0ae091dad64a","Type":"ContainerStarted","Data":"3cff3d3bbfc07b1c46e8ee3d02591d2c56dfa88b67a31ab1cb72fb0517ee4d5f"} Jul 07 14:37:12.753565 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:12.753238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:37:12.787439 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:12.787394 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" podStartSLOduration=1.94534038 podStartE2EDuration="4.787380266s" totalImagesPullingTime="2.842039886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:12.786232011 +0000 UTC m=+394.296841941" watchObservedRunningTime="2026-07-07 14:37:12.787380266 +0000 UTC m=+394.297990215" Jul 07 14:37:43.762215 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:37:43.762184 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-db7v8" Jul 07 14:38:53.930848 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.930819 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld"] Jul 07 14:38:53.933111 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.933095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:53.935934 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.935912 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lsz98\"" Jul 07 14:38:53.936070 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.935912 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 14:38:53.936070 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.935913 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 14:38:53.946484 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:53.946461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld"] Jul 07 14:38:54.087614 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.087584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/620cf3fb-b33b-4752-a54c-7408f3b70f31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.087801 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.087638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdpj\" (UniqueName: \"kubernetes.io/projected/620cf3fb-b33b-4752-a54c-7408f3b70f31-kube-api-access-gwdpj\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.188812 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.188723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/620cf3fb-b33b-4752-a54c-7408f3b70f31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.188943 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.188864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdpj\" (UniqueName: \"kubernetes.io/projected/620cf3fb-b33b-4752-a54c-7408f3b70f31-kube-api-access-gwdpj\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.189100 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.189082 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/620cf3fb-b33b-4752-a54c-7408f3b70f31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.201962 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.201932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdpj\" (UniqueName: \"kubernetes.io/projected/620cf3fb-b33b-4752-a54c-7408f3b70f31-kube-api-access-gwdpj\") pod \"kuadrant-operator-controller-manager-86878c769f-dnbld\" (UID: \"620cf3fb-b33b-4752-a54c-7408f3b70f31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.242720 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.242684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:38:54.374630 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:54.374605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld"] Jul 07 14:38:54.376915 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:38:54.376752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620cf3fb_b33b_4752_a54c_7408f3b70f31.slice/crio-bda9272ba9dd9506c07c9c6803ed39ef3197b2e3ac2fb68332f09d826b474aa4 WatchSource:0}: Error finding container bda9272ba9dd9506c07c9c6803ed39ef3197b2e3ac2fb68332f09d826b474aa4: Status 404 returned error can't find the container with id bda9272ba9dd9506c07c9c6803ed39ef3197b2e3ac2fb68332f09d826b474aa4 Jul 07 14:38:55.176174 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:38:55.176145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" event={"ID":"620cf3fb-b33b-4752-a54c-7408f3b70f31","Type":"ContainerStarted","Data":"bda9272ba9dd9506c07c9c6803ed39ef3197b2e3ac2fb68332f09d826b474aa4"} Jul 07 14:39:00.203012 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:00.202976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" event={"ID":"620cf3fb-b33b-4752-a54c-7408f3b70f31","Type":"ContainerStarted","Data":"21921e057eddc35518fdfed29f197ad817e1771c590241cf30eaf9d63639ed43"} Jul 07 14:39:00.203423 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:00.203084 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:39:00.226796 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:00.226726 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" podStartSLOduration=2.013704099 podStartE2EDuration="7.226709259s" totalImagesPullingTime="5.21300516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:00.226012645 +0000 UTC m=+501.736622576" watchObservedRunningTime="2026-07-07 14:39:00.226709259 +0000 UTC m=+501.737319190" Jul 07 14:39:11.210051 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:11.210018 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dnbld" Jul 07 14:39:30.816688 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:30.816611 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:30.826525 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:30.826499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:30.826665 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:30.826584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:30.828992 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:30.828968 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5pmv\"" Jul 07 14:39:30.902218 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:30.902185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5pq4\" (UniqueName: \"kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4\") pod \"authorino-58cd955675-lmmpz\" (UID: \"0e790061-dbe3-4861-b78a-0e559a2283c6\") " pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:31.002784 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:31.002736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5pq4\" (UniqueName: \"kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4\") pod \"authorino-58cd955675-lmmpz\" (UID: \"0e790061-dbe3-4861-b78a-0e559a2283c6\") " pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:31.011684 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:31.011659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5pq4\" (UniqueName: \"kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4\") pod \"authorino-58cd955675-lmmpz\" (UID: \"0e790061-dbe3-4861-b78a-0e559a2283c6\") " pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:31.136176 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:31.136096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:31.282698 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:31.282649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:31.285042 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:39:31.285019 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e790061_dbe3_4861_b78a_0e559a2283c6.slice/crio-f4f2c13801a249c0b22c77124bd96dcfaed6c813840c9095a78a5c267df86a3b WatchSource:0}: Error finding container f4f2c13801a249c0b22c77124bd96dcfaed6c813840c9095a78a5c267df86a3b: Status 404 returned error can't find the container with id f4f2c13801a249c0b22c77124bd96dcfaed6c813840c9095a78a5c267df86a3b Jul 07 14:39:31.335188 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:31.335153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmmpz" event={"ID":"0e790061-dbe3-4861-b78a-0e559a2283c6","Type":"ContainerStarted","Data":"f4f2c13801a249c0b22c77124bd96dcfaed6c813840c9095a78a5c267df86a3b"} Jul 07 14:39:35.357667 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:35.357631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmmpz" event={"ID":"0e790061-dbe3-4861-b78a-0e559a2283c6","Type":"ContainerStarted","Data":"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174"} Jul 07 14:39:35.373587 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:35.373541 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lmmpz" podStartSLOduration=2.277385366 podStartE2EDuration="5.373525917s" totalImagesPullingTime="3.096140551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:35.372181893 +0000 UTC m=+536.882791825" watchObservedRunningTime="2026-07-07 14:39:35.373525917 +0000 UTC m=+536.884135851" Jul 07 14:39:36.079169 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:36.079137 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:37.365513 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:37.365478 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lmmpz" podUID="0e790061-dbe3-4861-b78a-0e559a2283c6" containerName="authorino" containerID="cri-o://3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174" gracePeriod=30 Jul 07 14:39:37.610924 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:37.610902 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:37.760028 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:37.759994 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5pq4\" (UniqueName: \"kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4\") pod \"0e790061-dbe3-4861-b78a-0e559a2283c6\" (UID: \"0e790061-dbe3-4861-b78a-0e559a2283c6\") " Jul 07 14:39:37.762304 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:37.762276 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4" (OuterVolumeSpecName: "kube-api-access-d5pq4") pod "0e790061-dbe3-4861-b78a-0e559a2283c6" (UID: "0e790061-dbe3-4861-b78a-0e559a2283c6"). InnerVolumeSpecName "kube-api-access-d5pq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:37.860842 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:37.860796 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5pq4\" (UniqueName: \"kubernetes.io/projected/0e790061-dbe3-4861-b78a-0e559a2283c6-kube-api-access-d5pq4\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:39:38.371821 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.371789 2562 generic.go:356] "Generic (PLEG): container finished" podID="0e790061-dbe3-4861-b78a-0e559a2283c6" containerID="3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174" exitCode=0 Jul 07 14:39:38.372242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.371827 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmmpz" Jul 07 14:39:38.372242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.371870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmmpz" event={"ID":"0e790061-dbe3-4861-b78a-0e559a2283c6","Type":"ContainerDied","Data":"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174"} Jul 07 14:39:38.372242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.371906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmmpz" event={"ID":"0e790061-dbe3-4861-b78a-0e559a2283c6","Type":"ContainerDied","Data":"f4f2c13801a249c0b22c77124bd96dcfaed6c813840c9095a78a5c267df86a3b"} Jul 07 14:39:38.372242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.371924 2562 scope.go:117] "RemoveContainer" containerID="3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174" Jul 07 14:39:38.380043 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.380024 2562 scope.go:117] "RemoveContainer" containerID="3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174" Jul 07 14:39:38.380284 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:39:38.380268 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174\": container with ID starting with 3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174 not found: ID does not exist" containerID="3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174" Jul 07 14:39:38.380341 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.380292 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174"} err="failed to get container status \"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174\": rpc error: code = NotFound desc = could not find container \"3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174\": container with ID starting with 3de144051535d8458ab326b77411c0a43bb7f712cc4050abb3d712821d27b174 not found: ID does not exist" Jul 07 14:39:38.392810 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.392783 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:38.396447 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:38.396427 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmmpz"] Jul 07 14:39:39.039871 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:39.039840 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e790061-dbe3-4861-b78a-0e559a2283c6" path="/var/lib/kubelet/pods/0e790061-dbe3-4861-b78a-0e559a2283c6/volumes" Jul 07 14:39:51.697144 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.697106 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rctzf"] Jul 07 14:39:51.698022 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.697703 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e790061-dbe3-4861-b78a-0e559a2283c6" containerName="authorino" Jul 07 14:39:51.698022 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.697724 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e790061-dbe3-4861-b78a-0e559a2283c6" containerName="authorino" Jul 07 14:39:51.698022 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.697868 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e790061-dbe3-4861-b78a-0e559a2283c6" containerName="authorino" Jul 07 14:39:51.700986 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.700967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.703615 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.703594 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-npqx9\"" Jul 07 14:39:51.703615 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.703609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 14:39:51.707655 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.707633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rctzf"] Jul 07 14:39:51.780465 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.780430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21cd7d7c-01a6-4957-9392-ee29cc0f181b-data\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.780629 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.780498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jtl2\" (UniqueName: \"kubernetes.io/projected/21cd7d7c-01a6-4957-9392-ee29cc0f181b-kube-api-access-5jtl2\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.881434 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.881398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21cd7d7c-01a6-4957-9392-ee29cc0f181b-data\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.881618 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.881479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jtl2\" (UniqueName: \"kubernetes.io/projected/21cd7d7c-01a6-4957-9392-ee29cc0f181b-kube-api-access-5jtl2\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.881846 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.881826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21cd7d7c-01a6-4957-9392-ee29cc0f181b-data\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:51.890914 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:51.890884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jtl2\" (UniqueName: \"kubernetes.io/projected/21cd7d7c-01a6-4957-9392-ee29cc0f181b-kube-api-access-5jtl2\") pod \"postgres-69fb4594cf-rctzf\" (UID: \"21cd7d7c-01a6-4957-9392-ee29cc0f181b\") " pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:52.012832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:52.012795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:52.150561 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:52.150538 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rctzf"] Jul 07 14:39:52.153517 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:39:52.153492 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cd7d7c_01a6_4957_9392_ee29cc0f181b.slice/crio-57d32c65ac4d65f9a34bf1f10db99e10725ae04f648d5f419d465ec4dfdb9e8b WatchSource:0}: Error finding container 57d32c65ac4d65f9a34bf1f10db99e10725ae04f648d5f419d465ec4dfdb9e8b: Status 404 returned error can't find the container with id 57d32c65ac4d65f9a34bf1f10db99e10725ae04f648d5f419d465ec4dfdb9e8b Jul 07 14:39:52.431034 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:52.430942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rctzf" event={"ID":"21cd7d7c-01a6-4957-9392-ee29cc0f181b","Type":"ContainerStarted","Data":"57d32c65ac4d65f9a34bf1f10db99e10725ae04f648d5f419d465ec4dfdb9e8b"} Jul 07 14:39:57.458747 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:57.458707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rctzf" event={"ID":"21cd7d7c-01a6-4957-9392-ee29cc0f181b","Type":"ContainerStarted","Data":"662f95b5d4ec16322eb442157dedf41b881dd90427247b7b8717784925880e65"} Jul 07 14:39:57.459169 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:57.458829 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:39:57.474900 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:39:57.474847 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rctzf" podStartSLOduration=1.663928767 podStartE2EDuration="6.474832824s" totalImagesPullingTime="4.810904057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:57.474392681 +0000 UTC m=+558.985002612" watchObservedRunningTime="2026-07-07 14:39:57.474832824 +0000 UTC m=+558.985442756" Jul 07 14:40:03.492454 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:03.492426 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rctzf" Jul 07 14:40:04.343333 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.343299 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-586f46f454-5qf8r"] Jul 07 14:40:04.349550 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.349530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.352160 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.352133 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5pmv\"" Jul 07 14:40:04.353080 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.353056 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-586f46f454-5qf8r"] Jul 07 14:40:04.380902 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.380876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpwvm\" (UniqueName: \"kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm\") pod \"authorino-586f46f454-5qf8r\" (UID: \"311b4d6a-6207-4167-8cff-c96114e045a2\") " pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.449208 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.449176 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-586f46f454-5qf8r"] Jul 07 14:40:04.449449 ip-10-0-142-89 kubenswrapper[2562]: E0707 14:40:04.449428 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rpwvm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-586f46f454-5qf8r" podUID="311b4d6a-6207-4167-8cff-c96114e045a2" Jul 07 14:40:04.467159 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.467134 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55bf89948b-jr726"] Jul 07 14:40:04.470832 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.470816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.473238 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.473216 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 14:40:04.479876 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.479856 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55bf89948b-jr726"] Jul 07 14:40:04.481372 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.481356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5lrs\" (UniqueName: \"kubernetes.io/projected/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-kube-api-access-v5lrs\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.481440 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.481383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpwvm\" (UniqueName: \"kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm\") pod \"authorino-586f46f454-5qf8r\" (UID: \"311b4d6a-6207-4167-8cff-c96114e045a2\") " pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.481440 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.481423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-tls-cert\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.489487 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.489339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpwvm\" (UniqueName: \"kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm\") pod \"authorino-586f46f454-5qf8r\" (UID: \"311b4d6a-6207-4167-8cff-c96114e045a2\") " pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.491177 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.491156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.503375 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.503354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:04.582352 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.582323 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpwvm\" (UniqueName: \"kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm\") pod \"311b4d6a-6207-4167-8cff-c96114e045a2\" (UID: \"311b4d6a-6207-4167-8cff-c96114e045a2\") " Jul 07 14:40:04.582517 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.582423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5lrs\" (UniqueName: \"kubernetes.io/projected/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-kube-api-access-v5lrs\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.582517 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.582465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-tls-cert\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.584494 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.584462 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm" (OuterVolumeSpecName: "kube-api-access-rpwvm") pod "311b4d6a-6207-4167-8cff-c96114e045a2" (UID: "311b4d6a-6207-4167-8cff-c96114e045a2"). InnerVolumeSpecName "kube-api-access-rpwvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:04.584731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.584715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-tls-cert\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.590808 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.590757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5lrs\" (UniqueName: \"kubernetes.io/projected/b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7-kube-api-access-v5lrs\") pod \"authorino-55bf89948b-jr726\" (UID: \"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7\") " pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.683793 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.683672 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpwvm\" (UniqueName: \"kubernetes.io/projected/311b4d6a-6207-4167-8cff-c96114e045a2-kube-api-access-rpwvm\") on node \"ip-10-0-142-89.ec2.internal\" DevicePath \"\"" Jul 07 14:40:04.780755 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.780723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bf89948b-jr726" Jul 07 14:40:04.909398 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:04.909374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55bf89948b-jr726"] Jul 07 14:40:04.911258 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:40:04.911230 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb61ccc73_8834_4f7b_926b_cf0e4ae9f5b7.slice/crio-3226ce716e8dba9b59462038d6c908bda53cd1fb092c294eb3bfd8729589a40d WatchSource:0}: Error finding container 3226ce716e8dba9b59462038d6c908bda53cd1fb092c294eb3bfd8729589a40d: Status 404 returned error can't find the container with id 3226ce716e8dba9b59462038d6c908bda53cd1fb092c294eb3bfd8729589a40d Jul 07 14:40:05.497611 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:05.497579 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bf89948b-jr726" event={"ID":"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7","Type":"ContainerStarted","Data":"3226ce716e8dba9b59462038d6c908bda53cd1fb092c294eb3bfd8729589a40d"} Jul 07 14:40:05.497611 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:05.497603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586f46f454-5qf8r" Jul 07 14:40:05.523019 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:05.522991 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-586f46f454-5qf8r"] Jul 07 14:40:05.529071 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:05.529049 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-586f46f454-5qf8r"] Jul 07 14:40:06.504361 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:06.504327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bf89948b-jr726" event={"ID":"b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7","Type":"ContainerStarted","Data":"48ca6ea5b551e7faccfda96b25053dc1ceeeab163322c7cfeb258306a1d47c11"} Jul 07 14:40:06.520221 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:06.520169 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55bf89948b-jr726" podStartSLOduration=1.8919291 podStartE2EDuration="2.520153531s" totalImagesPullingTime="628.224431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:06.519928781 +0000 UTC m=+568.030538714" watchObservedRunningTime="2026-07-07 14:40:06.520153531 +0000 UTC m=+568.030763476" Jul 07 14:40:07.045389 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:07.045355 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311b4d6a-6207-4167-8cff-c96114e045a2" path="/var/lib/kubelet/pods/311b4d6a-6207-4167-8cff-c96114e045a2/volumes" Jul 07 14:40:38.911575 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:38.911549 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:40:38.913030 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:40:38.913012 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:45:38.940405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:45:38.940333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:45:38.940405 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:45:38.940355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:50:33.987814 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:33.987785 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55bf89948b-jr726_b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7/authorino/0.log" Jul 07 14:50:37.756523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:37.756493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-db7v8_699003ea-4613-4419-a7a4-0ae091dad64a/manager/0.log" Jul 07 14:50:38.654731 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:38.654703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-979q9_7c394094-0bad-4b60-b496-460fa6b95287/copy-manifests/0.log" Jul 07 14:50:38.668362 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:38.668341 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-979q9_7c394094-0bad-4b60-b496-460fa6b95287/manager/0.log" Jul 07 14:50:38.975889 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:38.975817 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:50:38.976302 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:38.976033 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pmxqn_bd5bfabf-1f65-4085-8bff-d722ea96b547/ovn-acl-logging/0.log" Jul 07 14:50:39.007964 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:39.007931 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rctzf_21cd7d7c-01a6-4957-9392-ee29cc0f181b/postgres/0.log" Jul 07 14:50:40.534720 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:40.534692 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55bf89948b-jr726_b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7/authorino/0.log" Jul 07 14:50:41.249230 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:41.249204 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dnbld_620cf3fb-b33b-4752-a54c-7408f3b70f31/manager/0.log" Jul 07 14:50:42.296878 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:42.296844 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-pj5rl_d340abe5-93e7-4651-9242-a967bf3d0e47/kube-auth-proxy/0.log" Jul 07 14:50:51.123819 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:51.123781 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qr6db_e2184369-b00f-42bd-b2f7-c44c7a551487/global-pull-secret-syncer/0.log" Jul 07 14:50:51.256988 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:51.256960 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p96tr_ca72bfba-f08c-4beb-8782-936206fa0725/konnectivity-agent/0.log" Jul 07 14:50:51.355419 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:51.355391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-89.ec2.internal_f9b30581dc755f3748ffdaa8433a2216/haproxy/0.log" Jul 07 14:50:56.340682 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:56.340655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55bf89948b-jr726_b61ccc73-8834-4f7b-926b-cf0e4ae9f5b7/authorino/0.log" Jul 07 14:50:56.604194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:56.604104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dnbld_620cf3fb-b33b-4752-a54c-7408f3b70f31/manager/0.log" Jul 07 14:50:58.449299 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.449271 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/alertmanager/0.log" Jul 07 14:50:58.489953 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.489926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/config-reloader/0.log" Jul 07 14:50:58.536441 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.536414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/kube-rbac-proxy-web/0.log" Jul 07 14:50:58.583005 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.582980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/kube-rbac-proxy/0.log" Jul 07 14:50:58.641430 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.641350 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/kube-rbac-proxy-metric/0.log" Jul 07 14:50:58.769975 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.769944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/prom-label-proxy/0.log" Jul 07 14:50:58.901697 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:58.901628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_254f7634-3fa7-427d-97e7-1ba2e8cbb0c2/init-config-reloader/0.log" Jul 07 14:50:59.655170 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:59.655141 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lv8vv_a35ab640-974c-48b7-a73c-d06106c18d20/node-exporter/0.log" Jul 07 14:50:59.714321 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:59.714292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lv8vv_a35ab640-974c-48b7-a73c-d06106c18d20/kube-rbac-proxy/0.log" Jul 07 14:50:59.750783 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:59.750742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lv8vv_a35ab640-974c-48b7-a73c-d06106c18d20/init-textfile/0.log" Jul 07 14:50:59.948739 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:50:59.948657 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-b6dlm_7d27e2f3-c4e0-441e-b8c0-0892446fdebc/kube-rbac-proxy-main/0.log" Jul 07 14:51:00.010252 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.010215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-b6dlm_7d27e2f3-c4e0-441e-b8c0-0892446fdebc/kube-rbac-proxy-self/0.log" Jul 07 14:51:00.070523 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.070493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-b6dlm_7d27e2f3-c4e0-441e-b8c0-0892446fdebc/openshift-state-metrics/0.log" Jul 07 14:51:00.135722 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.135681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/prometheus/0.log" Jul 07 14:51:00.199387 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.199315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/config-reloader/0.log" Jul 07 14:51:00.272199 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.272164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/thanos-sidecar/0.log" Jul 07 14:51:00.322431 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.322407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/kube-rbac-proxy-web/0.log" Jul 07 14:51:00.382881 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.382852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/kube-rbac-proxy/0.log" Jul 07 14:51:00.420554 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.420528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/kube-rbac-proxy-thanos/0.log" Jul 07 14:51:00.462122 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.462051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba32fcc8-359d-4c40-b87a-b6a2d510d20b/init-config-reloader/0.log" Jul 07 14:51:00.510404 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.510376 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-brn9s_c7f8dbdd-4a94-4777-85c6-fc27ccd54b03/prometheus-operator/0.log" Jul 07 14:51:00.541795 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.541756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-brn9s_c7f8dbdd-4a94-4777-85c6-fc27ccd54b03/kube-rbac-proxy/0.log" Jul 07 14:51:00.730590 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.730519 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/thanos-query/0.log" Jul 07 14:51:00.764840 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.764815 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/kube-rbac-proxy-web/0.log" Jul 07 14:51:00.807536 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.807506 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/kube-rbac-proxy/0.log" Jul 07 14:51:00.841194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.841166 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/prom-label-proxy/0.log" Jul 07 14:51:00.874115 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.874084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/kube-rbac-proxy-rules/0.log" Jul 07 14:51:00.919584 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:00.919555 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5598f999d7-nfj5w_ae06dc57-5a10-4b77-96c5-0f4b450073f3/kube-rbac-proxy-metrics/0.log" Jul 07 14:51:01.071669 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.071642 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t"] Jul 07 14:51:01.075194 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.075178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.078047 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.078025 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jxg2k\"/\"openshift-service-ca.crt\"" Jul 07 14:51:01.078047 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.078038 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jxg2k\"/\"default-dockercfg-mzhxt\"" Jul 07 14:51:01.078957 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.078941 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jxg2k\"/\"kube-root-ca.crt\"" Jul 07 14:51:01.084851 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.084825 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t"] Jul 07 14:51:01.249376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.249339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-sys\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.249376 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.249380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-podres\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.249579 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.249404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-proc\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.249579 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.249462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-lib-modules\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.249579 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.249546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndbx\" (UniqueName: \"kubernetes.io/projected/9a240884-f47b-4558-b703-78304e042621-kube-api-access-bndbx\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndbx\" (UniqueName: \"kubernetes.io/projected/9a240884-f47b-4558-b703-78304e042621-kube-api-access-bndbx\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-sys\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350130 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-podres\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-proc\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-lib-modules\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-proc\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350262 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-sys\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-podres\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.350396 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.350325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a240884-f47b-4558-b703-78304e042621-lib-modules\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.363381 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.363354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndbx\" (UniqueName: \"kubernetes.io/projected/9a240884-f47b-4558-b703-78304e042621-kube-api-access-bndbx\") pod \"perf-node-gather-daemonset-c4g9t\" (UID: \"9a240884-f47b-4558-b703-78304e042621\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.386017 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.385987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:01.519946 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:01.519750 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t"] Jul 07 14:51:01.522926 ip-10-0-142-89 kubenswrapper[2562]: W0707 14:51:01.522896 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a240884_f47b_4558_b703_78304e042621.slice/crio-eb36c4ec1f4c7fbc53c2db1547e019f7584810f16a0092c4d07fd7df68839c75 WatchSource:0}: Error finding container eb36c4ec1f4c7fbc53c2db1547e019f7584810f16a0092c4d07fd7df68839c75: Status 404 returned error can't find the container with id eb36c4ec1f4c7fbc53c2db1547e019f7584810f16a0092c4d07fd7df68839c75 Jul 07 14:51:02.392488 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:02.392455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" event={"ID":"9a240884-f47b-4558-b703-78304e042621","Type":"ContainerStarted","Data":"bcc9821e62d750b29ff40a25437422d0d86e0974c220ab95225d8e65514cc158"} Jul 07 14:51:02.392888 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:02.392506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" event={"ID":"9a240884-f47b-4558-b703-78304e042621","Type":"ContainerStarted","Data":"eb36c4ec1f4c7fbc53c2db1547e019f7584810f16a0092c4d07fd7df68839c75"} Jul 07 14:51:02.392888 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:02.392594 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:02.418242 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:02.418193 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" podStartSLOduration=1.418177582 podStartE2EDuration="1.418177582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:51:02.415572536 +0000 UTC m=+1223.926182467" watchObservedRunningTime="2026-07-07 14:51:02.418177582 +0000 UTC m=+1223.928787512" Jul 07 14:51:05.395171 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:05.395140 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4v87_c3011c07-ddb6-47d6-aa0d-7c74fcca2481/dns/0.log" Jul 07 14:51:05.447150 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:05.447111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4v87_c3011c07-ddb6-47d6-aa0d-7c74fcca2481/kube-rbac-proxy/0.log" Jul 07 14:51:05.546559 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:05.546532 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4nvdd_9b160095-18db-4087-bb85-a36a8eef0bf2/dns-node-resolver/0.log" Jul 07 14:51:06.308781 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:06.308726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlzbx_b0a6133e-0379-47ce-9bc4-7e5a8999c5a5/node-ca/0.log" Jul 07 14:51:07.610318 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:07.610288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-pj5rl_d340abe5-93e7-4651-9242-a967bf3d0e47/kube-auth-proxy/0.log" Jul 07 14:51:08.407648 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:08.407623 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-c4g9t" Jul 07 14:51:08.416154 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:08.416129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lgwn_65818df9-6f62-4e55-aafc-a2c1b34381e4/serve-healthcheck-canary/0.log" Jul 07 14:51:09.499059 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:09.499027 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvtn5_a8e2e783-a1ae-4284-98f4-f2ecf009e4a5/kube-rbac-proxy/0.log" Jul 07 14:51:09.550809 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:09.550783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvtn5_a8e2e783-a1ae-4284-98f4-f2ecf009e4a5/exporter/0.log" Jul 07 14:51:09.596445 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:09.596412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvtn5_a8e2e783-a1ae-4284-98f4-f2ecf009e4a5/extractor/0.log" Jul 07 14:51:11.783706 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:11.783680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-pj5rl_d340abe5-93e7-4651-9242-a967bf3d0e47/kube-auth-proxy/0.log" Jul 07 14:51:12.380822 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:12.380791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-db7v8_699003ea-4613-4419-a7a4-0ae091dad64a/manager/0.log" Jul 07 14:51:12.661520 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:12.661444 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-979q9_7c394094-0bad-4b60-b496-460fa6b95287/manager/0.log" Jul 07 14:51:12.710774 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:12.710726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-979q9_7c394094-0bad-4b60-b496-460fa6b95287/copy-manifests/0.log" Jul 07 14:51:12.847165 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:12.847135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rctzf_21cd7d7c-01a6-4957-9392-ee29cc0f181b/postgres/0.log" Jul 07 14:51:13.018677 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:13.018626 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-pj5rl_d340abe5-93e7-4651-9242-a967bf3d0e47/kube-auth-proxy/0.log" Jul 07 14:51:14.261015 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:14.260985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d96c4654c-jkqkq_eb2f002a-ae6c-4f42-adf2-e4787a0a1519/manager/0.log" Jul 07 14:51:14.299758 ip-10-0-142-89 kubenswrapper[2562]: I0707 14:51:14.299731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5lh8d_b7dd8c97-ce71-46ec-bd09-1364bb00337f/openshift-lws-operator/0.log"